Sep 28 09:16:10 devstack cinder-volume[75576]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 28 09:16:10 devstack cinder-volume[75576]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 09:16:10 devstack cinder-volume[75576]: we strongly recommend against using it for new projects. Sep 28 09:16:10 devstack cinder-volume[75576]: If you are already using Eventlet, we recommend migrating to a different Sep 28 09:16:10 devstack cinder-volume[75576]: framework. For more detail see Sep 28 09:16:10 devstack cinder-volume[75576]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 09:16:10 devstack cinder-volume[75576]: import eventlet # noqa Sep 28 09:16:13 devstack cinder-volume[75576]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75576) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 09:16:13 devstack cinder-volume[75576]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75576) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 09:16:13 devstack cinder-volume[75576]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75576) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 09:16:14 devstack cinder-volume[75576]: INFO dbcounter [None req-042ec364-45f1-49d5-baff-93656362014d None None] Registered counter for database cinder Sep 28 09:16:14 devstack cinder-volume[75576]: DEBUG oslo_db.sqlalchemy.engines [None req-042ec364-45f1-49d5-baff-93656362014d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75576) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 09:16:14 devstack cinder-volume[75576]: DEBUG dbcounter [-] [75576] Writer thread running {{(pid=75576) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 09:16:14 devstack cinder-volume[75576]: INFO cinder.rpc [None req-042ec364-45f1-49d5-baff-93656362014d None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 28 09:16:14 devstack cinder-volume[75576]: INFO cinder.rpc [None req-042ec364-45f1-49d5-baff-93656362014d None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_db.sqlalchemy.engines [None req-042ec364-45f1-49d5-baff-93656362014d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75576) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 09:16:15 devstack cinder-volume[75576]: INFO cinder.volume.manager [None req-042ec364-45f1-49d5-baff-93656362014d None None] Determined volume DB was empty at startup. Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG cinder.volume.manager [None req-042ec364-45f1-49d5-baff-93656362014d None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75576) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 28 09:16:15 devstack cinder-volume[75576]: INFO cinder.volume.manager [None req-042ec364-45f1-49d5-baff-93656362014d None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 28 09:16:15 devstack cinder-volume[75576]: WARNING stevedore.named [None req-042ec364-45f1-49d5-baff-93656362014d None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 09:16:15 devstack cinder-volume[75576]: WARNING castellan.key_manager [None req-042ec364-45f1-49d5-baff-93656362014d None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 09:16:15 devstack cinder-volume[75576]: WARNING cinder.keymgr.conf_key_mgr [None req-042ec364-45f1-49d5-baff-93656362014d None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG cinder.volume.drivers.lvm [None req-042ec364-45f1-49d5-baff-93656362014d None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75576) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-042ec364-45f1-49d5-baff-93656362014d None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-042ec364-45f1-49d5-baff-93656362014d None None] CMD "cinder-rtstool verify" returned: 0 in 0.555s {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_db.sqlalchemy.engines [None req-042ec364-45f1-49d5-baff-93656362014d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75576) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 09:16:15 devstack cinder-volume[75576]: INFO cinder.rpc [None req-042ec364-45f1-49d5-baff-93656362014d None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 28 09:16:15 devstack cinder-volume[75576]: INFO cinder.rpc [None req-042ec364-45f1-49d5-baff-93656362014d None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 28 09:16:15 devstack cinder-volume[75576]: WARNING stevedore.named [None req-042ec364-45f1-49d5-baff-93656362014d None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 09:16:15 devstack cinder-volume[75576]: WARNING castellan.key_manager [None req-042ec364-45f1-49d5-baff-93656362014d None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 09:16:15 devstack cinder-volume[75576]: INFO cinder.volume.manager [None req-042ec364-45f1-49d5-baff-93656362014d None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_db.sqlalchemy.engines [None req-042ec364-45f1-49d5-baff-93656362014d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75576) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 09:16:15 devstack cinder-volume[75576]: INFO oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] Starting 1 workers Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] Started child 75735 {{(pid=75576) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] Full set of CONF: {{(pid=75576) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] ******************************************************************************** {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] Configuration options gathered from: {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 28 09:16:15 devstack cinder-volume[75735]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] ================================================================================ {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] allow_availability_zone_fallback = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] allow_compression_on_image_upload = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] allowed_direct_url_schemes = [] {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] api_rate_limit = True {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] auth_strategy = keystone {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] az_cache_duration = 3600 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] backend_availability_zone = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] backend_host = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] backend_name = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] backend_stats_polling_interval = 60 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] backup_api_class = cinder.backup.api.API {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] backup_name_template = backup-%s {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] backup_use_same_host = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] backup_use_temp_snapshot = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] chap_password = **** {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] chap_username = {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] cinder_internal_tenant_project_id = f48d503e786343b2876c4d8f90731ae5 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] cinder_internal_tenant_user_id = 92abc6520dea4ca7acb8fbc19131fcb2 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] cloned_volume_same_az = True {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] cluster = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] compression_format = gzip {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] compute_api_class = cinder.compute.nova.API {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] config_dir = [] {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] config_source = [] {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] control_exchange = openstack {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] debug = True {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] default_availability_zone = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] default_group_type = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] default_volume_type = lvmdriver-1 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] disk_geometry = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] driver_client_cert = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] driver_client_cert_key = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] driver_data_namespace = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] driver_ssl_cert_path = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] driver_ssl_cert_verify = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] driver_use_ssl = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] enable_force_upload = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] enable_new_services = True {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] enable_unsupported_driver = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] enabled_backends = ['lvmdriver-1'] {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] enforce_multipath_for_image_xfer = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] filter_function = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] glance_api_insecure = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] glance_api_servers = ['http://192.168.122.64/image'] {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] glance_api_ssl_compression = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] glance_ca_certificates_file = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] glance_catalog_info = image:glance:publicURL {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] glance_certfile = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] glance_keyfile = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] glance_num_retries = 3 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] glance_request_timeout = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] goodness_function = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] graceful_shutdown_timeout = 5 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] group_api_class = cinder.group.api.API {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] host = devstack {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] image_compress_on_upload = True {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] image_conversion_address_space_limit = 1 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] image_conversion_cpu_limit = 60 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] image_conversion_disable = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] image_introspection_address_space_limit = 1 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] image_introspection_cpu_limit = 60 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] image_upload_use_cinder_backend = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] image_upload_use_internal_tenant = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] image_volume_cache_enabled = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] image_volume_cache_max_count = 0 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] image_volume_cache_max_size_gb = 0 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] init_host_max_objects_retrieval = 0 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] instance_format = [instance: %(uuid)s] {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] iscsi_target_flags = {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] iscsi_write_cache = on {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] iser_helper = tgtadm {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] iser_ip_address = 192.168.122.64 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] iser_port = 3260 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75735]: INFO cinder.volume.manager [None req-ec9ee322-26e8-4863-a4fb-3606a9c9e515 None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 28 09:16:15 devstack cinder-volume[75735]: DEBUG oslo_concurrency.processutils [None req-ec9ee322-26e8-4863-a4fb-3606a9c9e515 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75735) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] log_color = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] log_config_append = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] log_dir = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] log_file = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] log_options = True {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] log_rotate_interval = 1 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] log_rotate_interval_type = days {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] log_rotation_type = none {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] max_age = 0 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] max_logfile_count = 30 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] max_logfile_size_mb = 200 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] max_over_subscription_ratio = 20.0 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] message_reap_interval = 86400 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] message_ttl = 2592000 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] migration_create_volume_timeout_secs = 300 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] monkey_patch = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] monkey_patch_modules = [] {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] my_ip = 192.168.122.64 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] no_snapshot_gb_quota = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] num_iser_scan_tries = 3 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] num_shell_tries = 3 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] num_volume_device_scan_tries = 3 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] nvmeof_conn_info_version = 1 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] nvmet_ns_id = 10 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] nvmet_port_id = 1 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] osapi_max_limit = 1000 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] osapi_volume_ext_list = [] {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] osapi_volume_listen = 0.0.0.0 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] osapi_volume_listen_port = 8776 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] osapi_volume_use_ssl = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] osapi_volume_workers = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] per_volume_size_limit = -1 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] periodic_fuzzy_delay = 60 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] periodic_interval = 60 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] project_id_regex = [0-9a-f\-]+ {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] public_endpoint = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] publish_errors = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] quota_backup_gigabytes = 1000 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] quota_backups = 10 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] quota_gigabytes = 1000 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] quota_groups = 10 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] quota_snapshots = 10 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] quota_volumes = 10 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] rate_limit_burst = 0 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] rate_limit_except_level = CRITICAL {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] rate_limit_interval = 0 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] reinit_driver_count = 3 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] replication_device = **** {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] report_discard_supported = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] report_interval = 120 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] reservation_clean_interval = 86400 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] reservation_expire = 86400 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] reserved_image_namespaces = [] {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] reserved_percentage = 0 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] rpc_response_timeout = 120 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] run_external_periodic_tasks = True {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] scst_target_driver = iscsi {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] scst_target_iqn_name = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] service_down_time = 720 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] shell_completion = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] snapshot_name_template = snapshot-%s {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] snapshot_same_host = True {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] split_loggers = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] state_path = /opt/stack/data/cinder {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] storage_availability_zone = nova {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] storage_protocol = iSCSI {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] syslog_log_facility = LOG_USER {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] target_helper = lioadm {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] target_ip_address = 192.168.122.64 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] target_port = 3260 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] target_protocol = iscsi {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] target_secondary_ip_addresses = [] {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] trace_flags = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] transfer_api_class = cinder.transfer.api.API {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] transport_url = **** {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75735]: DEBUG oslo_concurrency.processutils [None req-ec9ee322-26e8-4863-a4fb-3606a9c9e515 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.042s {{(pid=75735) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:16:15 devstack cinder-volume[75735]: DEBUG oslo_concurrency.processutils [None req-ec9ee322-26e8-4863-a4fb-3606a9c9e515 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75735) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] until_refresh = 0 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] use_chap_auth = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] use_default_quota_class = True {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] use_journal = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] use_json = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] use_multipath_for_image_xfer = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] use_stderr = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] use_syslog = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] verify_glance_signatures = enabled {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] volume_api_class = cinder.volume.api.API {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] volume_backend_name = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] volume_clear = zero {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] volume_clear_ionice = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] volume_clear_size = 0 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] volume_copy_bps_limit = 0 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] volume_dd_blocksize = 1M {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] volume_name_template = volume-%s {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] volume_service_inithost_offload = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] volume_usage_audit_period = month {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] zoning_mode = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] oslo_concurrency.disable_process_locking = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] keystone_authtoken.auth_section = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] keystone_authtoken.auth_type = password {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] keystone_authtoken.auth_version = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] keystone_authtoken.cache = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] keystone_authtoken.certfile = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] keystone_authtoken.delay_auth_decision = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] keystone_authtoken.http_connect_timeout = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] keystone_authtoken.include_service_catalog = True {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] keystone_authtoken.insecure = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] keystone_authtoken.interface = public {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] keystone_authtoken.keyfile = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] keystone_authtoken.memcache_password = **** {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:15 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] keystone_authtoken.memcache_username = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] keystone_authtoken.region_name = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] keystone_authtoken.service_token_roles_required = True {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] keystone_authtoken.service_type = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] keystone_authtoken.token_cache_time = 300 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.64/identity {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] cache.backend = dogpile.cache.null {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] cache.backend_argument = **** {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] cache.backend_expiration_time = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] cache.config_prefix = cache.oslo {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] cache.debug_cache_backend = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] cache.enable_retry_client = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] cache.enable_socket_keepalive = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] cache.enabled = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] cache.expiration_time = 600 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] cache.hashclient_retry_attempts = 2 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] cache.memcache_dead_retry = 300 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] cache.memcache_pool_maxsize = 10 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] cache.memcache_sasl_enabled = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] cache.password = **** {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] cache.proxies = [] {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] cache.redis_db = 0 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] cache.redis_sentinel_service_name = mymaster {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] cache.redis_server = localhost:6379 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] cache.retry_attempts = 2 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] cache.retry_delay = 0.0 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] cache.socket_keepalive_count = 1 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] cache.socket_keepalive_idle = 1 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] cache.socket_keepalive_interval = 1 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] cache.socket_timeout = 1.0 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] cache.tls_allowed_ciphers = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] cache.tls_cafile = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] cache.tls_certfile = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] cache.tls_enabled = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] cache.tls_keyfile = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] cache.username = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] coordination.backend_url = **** {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] database.asyncio_connection = **** {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] database.asyncio_slave_connection = **** {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] database.backend = sqlalchemy {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75735]: DEBUG oslo_concurrency.processutils [None req-ec9ee322-26e8-4863-a4fb-3606a9c9e515 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.046s {{(pid=75735) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:16:16 devstack cinder-volume[75735]: DEBUG oslo_concurrency.processutils [None req-ec9ee322-26e8-4863-a4fb-3606a9c9e515 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75735) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] database.connection = **** {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] database.connection_debug = 0 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] database.connection_parameters = {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] database.connection_recycle_time = 3600 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] database.connection_trace = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] database.db_inc_retry_interval = True {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] database.db_max_retries = 20 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] database.db_max_retry_interval = 10 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] database.db_retry_interval = 1 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] database.max_overflow = 50 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] database.max_pool_size = 5 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] database.max_retries = 10 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] database.mysql_wsrep_sync_wait = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] database.pool_timeout = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] database.retry_interval = 10 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] database.slave_connection = **** {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] database.sqlite_synchronous = True {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] database.synchronous_reader = True {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] database.use_db_reconnect = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] oslo_messaging_tracing.insecure = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] profiler.connection_string = messaging:// {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] profiler.enabled = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] profiler.es_doc_type = notification {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] profiler.es_scroll_size = 10000 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] profiler.es_scroll_time = 2m {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] profiler.filter_error_trace = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] profiler.hmac_keys = **** {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] profiler.sentinel_service_name = mymaster {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] profiler.socket_timeout = 0.1 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] profiler.trace_requests = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] profiler.trace_sqlalchemy = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] profiler_jaeger.process_tags = {} {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] profiler_jaeger.service_name_prefix = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] profiler_otlp.service_name_prefix = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] oslo_policy.enforce_new_defaults = True {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] oslo_policy.policy_default_rule = default {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] oslo_policy.policy_file = policy.yaml {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] oslo_policy.remote_timeout = 60.0 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] privsep_osbrick.group = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] privsep_osbrick.helper_command = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] privsep_osbrick.user = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] cinder_sys_admin.group = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] cinder_sys_admin.helper_command = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] cinder_sys_admin.user = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] service_user.auth_section = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] service_user.auth_type = password {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] service_user.cafile = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] service_user.certfile = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] service_user.collect_timing = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] service_user.insecure = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] service_user.keyfile = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] service_user.send_service_user_token = True {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] service_user.split_loggers = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] service_user.timeout = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] service_user.tls_ciphers = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] service_user.tls_min_version = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] glance.auth_section = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] glance.auth_type = password {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] glance.certfile = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] glance.collect_timing = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] glance.insecure = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] glance.keyfile = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] glance.region_name = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] glance.split_loggers = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] glance.timeout = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] glance.tls_ciphers = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] glance.tls_min_version = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] backend_defaults.backend_availability_zone = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] backend_defaults.chap_password = **** {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] backend_defaults.chap_username = {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] backend_defaults.disk_geometry = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] backend_defaults.driver_client_cert = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] backend_defaults.driver_client_cert_key = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] backend_defaults.driver_data_namespace = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] backend_defaults.driver_use_ssl = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] backend_defaults.enable_unsupported_driver = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] backend_defaults.extra_capabilities = {} {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] backend_defaults.filter_function = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] backend_defaults.goodness_function = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75735]: DEBUG oslo_concurrency.processutils [None req-ec9ee322-26e8-4863-a4fb-3606a9c9e515 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.044s {{(pid=75735) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:16:16 devstack cinder-volume[75735]: DEBUG oslo_concurrency.processutils [None req-ec9ee322-26e8-4863-a4fb-3606a9c9e515 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75735) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] backend_defaults.iscsi_target_flags = {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] backend_defaults.iscsi_write_cache = on {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] backend_defaults.iser_helper = tgtadm {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] backend_defaults.iser_ip_address = 192.168.122.64 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] backend_defaults.iser_port = 3260 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] backend_defaults.lvm_mirrors = 0 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] backend_defaults.lvm_share_target = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] backend_defaults.lvm_type = auto {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] backend_defaults.num_shell_tries = 3 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] backend_defaults.nvmet_port_id = 1 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] backend_defaults.replication_device = **** {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] backend_defaults.report_discard_supported = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] backend_defaults.reserved_percentage = 0 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] backend_defaults.scst_target_driver = iscsi {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] backend_defaults.scst_target_iqn_name = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] backend_defaults.storage_protocol = iSCSI {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] backend_defaults.target_helper = tgtadm {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] backend_defaults.target_ip_address = 192.168.122.64 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] backend_defaults.target_port = 3260 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] backend_defaults.target_protocol = iscsi {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] backend_defaults.trace_flags = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] backend_defaults.unique_fqdn_network = True {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] backend_defaults.use_chap_auth = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] backend_defaults.volume_backend_name = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] backend_defaults.volume_clear = zero {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] backend_defaults.volume_clear_ionice = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] backend_defaults.volume_clear_size = 0 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] backend_defaults.volume_group = cinder-volumes {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] oslo_reports.file_event_handler = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] oslo_reports.log_dir = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] lvmdriver-1.backend_availability_zone = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] lvmdriver-1.backend_host = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] lvmdriver-1.chap_password = **** {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] lvmdriver-1.chap_username = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] lvmdriver-1.chiscsi_conf = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] lvmdriver-1.disk_geometry = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] lvmdriver-1.driver_client_cert = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] lvmdriver-1.driver_data_namespace = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] lvmdriver-1.driver_use_ssl = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] lvmdriver-1.extra_capabilities = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] lvmdriver-1.filter_function = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] lvmdriver-1.goodness_function = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] lvmdriver-1.iser_helper = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] lvmdriver-1.iser_ip_address = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] lvmdriver-1.iser_port = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] lvmdriver-1.iser_target_prefix = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] lvmdriver-1.lvm_conf_file = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] lvmdriver-1.lvm_mirrors = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] lvmdriver-1.lvm_share_target = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] lvmdriver-1.lvm_type = auto {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] lvmdriver-1.num_shell_tries = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] lvmdriver-1.nvmet_port_id = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] lvmdriver-1.replication_device = **** {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] lvmdriver-1.report_discard_supported = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] lvmdriver-1.reserved_percentage = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] lvmdriver-1.scst_target_driver = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] lvmdriver-1.storage_protocol = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] lvmdriver-1.target_helper = lioadm {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] lvmdriver-1.target_ip_address = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] lvmdriver-1.target_port = 3260 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] lvmdriver-1.target_protocol = iscsi {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] lvmdriver-1.trace_flags = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] lvmdriver-1.use_chap_auth = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] lvmdriver-1.volume_clear = zero {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] lvmdriver-1.volume_clear_size = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] lvmdriver-1.volumes_dir = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack sudo[75742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] oslo_messaging_rabbit.ssl = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] oslo_messaging_rabbit.ssl_version = {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] oslo_messaging_notifications.driver = [] {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] oslo_messaging_notifications.retry = -1 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack sudo[75742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] oslo_messaging_notifications.transport_url = **** {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] key_manager.fixed_key = **** {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] barbican.barbican_api_version = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] barbican.barbican_endpoint = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] barbican.barbican_endpoint_type = public {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] barbican.barbican_region_name = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] barbican.cafile = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] barbican.certfile = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] barbican.collect_timing = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] barbican.insecure = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] barbican.keyfile = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] barbican.number_of_retries = 60 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] barbican.retry_delay = 1 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] barbican.send_service_user_token = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] barbican.split_loggers = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] barbican.timeout = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] barbican.tls_ciphers = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] barbican.tls_min_version = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] barbican.verify_ssl = True {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] barbican.verify_ssl_path = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] barbican_service_user.auth_section = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] barbican_service_user.auth_type = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] barbican_service_user.cafile = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] barbican_service_user.certfile = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] barbican_service_user.collect_timing = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] barbican_service_user.insecure = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] barbican_service_user.keyfile = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] barbican_service_user.split_loggers = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] barbican_service_user.timeout = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] barbican_service_user.tls_ciphers = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] barbican_service_user.tls_min_version = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] vault.approle_role_id = **** {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] vault.approle_secret_id = **** {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] vault.auth_method = approle {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] vault.auth_path = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] vault.kv_mountpoint = secret {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] vault.kv_path = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] vault.kv_version = 2 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] vault.namespace = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] vault.root_token_id = **** {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] vault.ssl_ca_crt_file = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] vault.timeout = 60.0 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] vault.token_file = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] vault.token_role = None {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] vault.use_ssl = False {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:16:16 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] ******************************************************************************** {{(pid=75576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 28 09:16:16 devstack sudo[75742]: pam_unix(sudo:session): session closed for user root Sep 28 09:16:16 devstack cinder-volume[75735]: DEBUG oslo_concurrency.processutils [None req-ec9ee322-26e8-4863-a4fb-3606a9c9e515 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.313s {{(pid=75735) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:16:16 devstack cinder-volume[75735]: DEBUG oslo_concurrency.processutils [None req-ec9ee322-26e8-4863-a4fb-3606a9c9e515 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75735) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:16:16 devstack sudo[75831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 09:16:16 devstack sudo[75831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:16:16 devstack sudo[75831]: pam_unix(sudo:session): session closed for user root Sep 28 09:16:16 devstack cinder-volume[75735]: DEBUG oslo_concurrency.processutils [None req-ec9ee322-26e8-4863-a4fb-3606a9c9e515 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.252s {{(pid=75735) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:16:16 devstack cinder-volume[75735]: DEBUG oslo_concurrency.processutils [None req-ec9ee322-26e8-4863-a4fb-3606a9c9e515 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75735) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 09:16:16 devstack cinder-volume[75735]: INFO cinder.brick.local_dev.lvm [None req-ec9ee322-26e8-4863-a4fb-3606a9c9e515 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 28 09:16:16 devstack cinder-volume[75735]: DEBUG oslo_concurrency.processutils [None req-ec9ee322-26e8-4863-a4fb-3606a9c9e515 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75735) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:16:16 devstack cinder-volume[75735]: DEBUG oslo_concurrency.processutils [None req-ec9ee322-26e8-4863-a4fb-3606a9c9e515 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75735) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:16:16 devstack cinder-volume[75735]: DEBUG oslo_concurrency.processutils [None req-ec9ee322-26e8-4863-a4fb-3606a9c9e515 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75735) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:16:16 devstack sudo[75942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 09:16:16 devstack sudo[75942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:16:16 devstack sudo[75942]: pam_unix(sudo:session): session closed for user root Sep 28 09:16:16 devstack cinder-volume[75735]: DEBUG oslo_concurrency.processutils [None req-ec9ee322-26e8-4863-a4fb-3606a9c9e515 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=75735) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:16:16 devstack cinder-volume[75735]: DEBUG cinder.brick.local_dev.lvm [None req-ec9ee322-26e8-4863-a4fb-3606a9c9e515 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75735) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 28 09:16:16 devstack cinder-volume[75735]: DEBUG oslo_concurrency.processutils [None req-ec9ee322-26e8-4863-a4fb-3606a9c9e515 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75735) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:16:16 devstack sudo[76046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 09:16:16 devstack sudo[76046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:16:17 devstack sudo[76046]: pam_unix(sudo:session): session closed for user root Sep 28 09:16:17 devstack cinder-volume[75735]: DEBUG oslo_concurrency.processutils [None req-ec9ee322-26e8-4863-a4fb-3606a9c9e515 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.494s {{(pid=75735) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:16:17 devstack cinder-volume[75735]: DEBUG oslo_concurrency.processutils [None req-ec9ee322-26e8-4863-a4fb-3606a9c9e515 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75735) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:16:17 devstack cinder-volume[75735]: DEBUG oslo_concurrency.processutils [None req-ec9ee322-26e8-4863-a4fb-3606a9c9e515 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75735) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:16:17 devstack cinder-volume[75735]: DEBUG oslo_concurrency.processutils [None req-ec9ee322-26e8-4863-a4fb-3606a9c9e515 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75735) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:16:17 devstack sudo[76250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 09:16:17 devstack sudo[76250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:16:17 devstack sudo[76250]: pam_unix(sudo:session): session closed for user root Sep 28 09:16:17 devstack cinder-volume[75735]: DEBUG oslo_concurrency.processutils [None req-ec9ee322-26e8-4863-a4fb-3606a9c9e515 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.355s {{(pid=75735) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:16:17 devstack cinder-volume[75735]: DEBUG oslo_concurrency.processutils [None req-ec9ee322-26e8-4863-a4fb-3606a9c9e515 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75735) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:16:17 devstack cinder-volume[75735]: DEBUG oslo_concurrency.processutils [None req-ec9ee322-26e8-4863-a4fb-3606a9c9e515 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=75735) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:16:17 devstack cinder-volume[75735]: DEBUG oslo_concurrency.processutils [None req-ec9ee322-26e8-4863-a4fb-3606a9c9e515 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75735) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:16:17 devstack sudo[76346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 28 09:16:17 devstack sudo[76346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:16:18 devstack sudo[76346]: pam_unix(sudo:session): session closed for user root Sep 28 09:16:18 devstack cinder-volume[75735]: DEBUG oslo_concurrency.processutils [None req-ec9ee322-26e8-4863-a4fb-3606a9c9e515 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.250s {{(pid=75735) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:16:18 devstack cinder-volume[75735]: DEBUG oslo_concurrency.processutils [None req-ec9ee322-26e8-4863-a4fb-3606a9c9e515 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75735) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:16:18 devstack sudo[76349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 09:16:18 devstack sudo[76349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:16:18 devstack sudo[76349]: pam_unix(sudo:session): session closed for user root Sep 28 09:16:18 devstack cinder-volume[75735]: DEBUG oslo_concurrency.processutils [None req-ec9ee322-26e8-4863-a4fb-3606a9c9e515 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.337s {{(pid=75735) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:16:18 devstack cinder-volume[75735]: DEBUG oslo_concurrency.processutils [None req-ec9ee322-26e8-4863-a4fb-3606a9c9e515 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75735) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:16:18 devstack sudo[76433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 09:16:18 devstack sudo[76433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:16:18 devstack sudo[76433]: pam_unix(sudo:session): session closed for user root Sep 28 09:16:18 devstack cinder-volume[75735]: DEBUG oslo_concurrency.processutils [None req-ec9ee322-26e8-4863-a4fb-3606a9c9e515 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=75735) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:16:18 devstack cinder-volume[75735]: DEBUG oslo_concurrency.processutils [None req-ec9ee322-26e8-4863-a4fb-3606a9c9e515 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75735) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:16:18 devstack sudo[76437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 09:16:18 devstack sudo[76437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:16:18 devstack sudo[76437]: pam_unix(sudo:session): session closed for user root Sep 28 09:16:18 devstack cinder-volume[75735]: DEBUG oslo_concurrency.processutils [None req-ec9ee322-26e8-4863-a4fb-3606a9c9e515 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.309s {{(pid=75735) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:16:18 devstack cinder-volume[75735]: DEBUG oslo_concurrency.processutils [None req-ec9ee322-26e8-4863-a4fb-3606a9c9e515 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75735) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:16:18 devstack sudo[76512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 09:16:18 devstack sudo[76512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:16:19 devstack sudo[76512]: pam_unix(sudo:session): session closed for user root Sep 28 09:16:19 devstack cinder-volume[75735]: DEBUG oslo_concurrency.processutils [None req-ec9ee322-26e8-4863-a4fb-3606a9c9e515 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.288s {{(pid=75735) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:16:19 devstack cinder-volume[75735]: DEBUG oslo_concurrency.processutils [None req-ec9ee322-26e8-4863-a4fb-3606a9c9e515 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75735) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:16:19 devstack cinder-volume[75735]: DEBUG oslo_concurrency.processutils [None req-ec9ee322-26e8-4863-a4fb-3606a9c9e515 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75735) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:16:19 devstack cinder-volume[75735]: DEBUG oslo_concurrency.processutils [None req-ec9ee322-26e8-4863-a4fb-3606a9c9e515 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75735) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:16:19 devstack sudo[76529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 09:16:19 devstack sudo[76529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:16:19 devstack sudo[76529]: pam_unix(sudo:session): session closed for user root Sep 28 09:16:19 devstack cinder-volume[75735]: DEBUG oslo_concurrency.processutils [None req-ec9ee322-26e8-4863-a4fb-3606a9c9e515 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.255s {{(pid=75735) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:16:19 devstack cinder-volume[75735]: INFO cinder.volume.drivers.lvm [None req-ec9ee322-26e8-4863-a4fb-3606a9c9e515 None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 28 09:16:19 devstack cinder-volume[75735]: DEBUG oslo_concurrency.processutils [None req-ec9ee322-26e8-4863-a4fb-3606a9c9e515 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75735) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:16:19 devstack cinder-volume[75735]: DEBUG oslo_concurrency.processutils [None req-ec9ee322-26e8-4863-a4fb-3606a9c9e515 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75735) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:16:19 devstack cinder-volume[75735]: DEBUG oslo_concurrency.processutils [None req-ec9ee322-26e8-4863-a4fb-3606a9c9e515 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75735) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:16:19 devstack sudo[76539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 09:16:19 devstack sudo[76539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:16:19 devstack sudo[76539]: pam_unix(sudo:session): session closed for user root Sep 28 09:16:19 devstack cinder-volume[75735]: DEBUG oslo_concurrency.processutils [None req-ec9ee322-26e8-4863-a4fb-3606a9c9e515 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.250s {{(pid=75735) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:16:19 devstack cinder-volume[75735]: DEBUG cinder.volume.drivers.lvm [None req-ec9ee322-26e8-4863-a4fb-3606a9c9e515 None None] Updating volume stats {{(pid=75735) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 09:16:19 devstack cinder-volume[75735]: DEBUG oslo_concurrency.processutils [None req-ec9ee322-26e8-4863-a4fb-3606a9c9e515 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75735) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:16:19 devstack sudo[76542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 09:16:19 devstack sudo[76542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:16:20 devstack sudo[76542]: pam_unix(sudo:session): session closed for user root Sep 28 09:16:20 devstack cinder-volume[75735]: DEBUG oslo_concurrency.processutils [None req-ec9ee322-26e8-4863-a4fb-3606a9c9e515 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=75735) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:16:20 devstack cinder-volume[75735]: DEBUG oslo_concurrency.processutils [None req-ec9ee322-26e8-4863-a4fb-3606a9c9e515 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75735) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:16:20 devstack sudo[76545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 09:16:20 devstack sudo[76545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:16:20 devstack sudo[76545]: pam_unix(sudo:session): session closed for user root Sep 28 09:16:20 devstack cinder-volume[75735]: DEBUG oslo_concurrency.processutils [None req-ec9ee322-26e8-4863-a4fb-3606a9c9e515 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=75735) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:16:20 devstack cinder-volume[75735]: DEBUG oslo_concurrency.processutils [None req-ec9ee322-26e8-4863-a4fb-3606a9c9e515 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75735) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:16:20 devstack sudo[76548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 09:16:20 devstack sudo[76548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:16:20 devstack sudo[76548]: pam_unix(sudo:session): session closed for user root Sep 28 09:16:20 devstack cinder-volume[75735]: DEBUG oslo_concurrency.processutils [None req-ec9ee322-26e8-4863-a4fb-3606a9c9e515 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.261s {{(pid=75735) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:16:20 devstack cinder-volume[75735]: DEBUG oslo_concurrency.processutils [None req-ec9ee322-26e8-4863-a4fb-3606a9c9e515 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75735) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:16:20 devstack sudo[76551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 09:16:20 devstack sudo[76551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:16:20 devstack sudo[76551]: pam_unix(sudo:session): session closed for user root Sep 28 09:16:20 devstack cinder-volume[75735]: DEBUG oslo_concurrency.processutils [None req-ec9ee322-26e8-4863-a4fb-3606a9c9e515 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.278s {{(pid=75735) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:16:20 devstack cinder-volume[75735]: INFO cinder.volume.driver [None req-ec9ee322-26e8-4863-a4fb-3606a9c9e515 None None] Driver hasn't implemented _init_vendor_properties() Sep 28 09:16:20 devstack cinder-volume[75735]: DEBUG cinder.volume.driver [None req-ec9ee322-26e8-4863-a4fb-3606a9c9e515 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75735) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 28 09:16:20 devstack cinder-volume[75735]: DEBUG oslo_db.sqlalchemy.engines [None req-ec9ee322-26e8-4863-a4fb-3606a9c9e515 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75735) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 09:16:20 devstack cinder-volume[75735]: DEBUG dbcounter [-] [75735] Writer thread running {{(pid=75735) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 09:16:20 devstack cinder-volume[75735]: DEBUG cinder.db.api [None req-ec9ee322-26e8-4863-a4fb-3606a9c9e515 None None] Building query based on filter {{(pid=75735) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 28 09:16:20 devstack cinder-volume[75735]: DEBUG cinder.image.image_utils [None req-ec9ee322-26e8-4863-a4fb-3606a9c9e515 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75735) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 28 09:16:20 devstack cinder-volume[75735]: INFO cinder.keymgr.migration [None req-1860fafc-9ae4-4dac-856e-1adbae3a98e8 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 28 09:16:20 devstack cinder-volume[75735]: DEBUG cinder.volume.drivers.lvm [None req-ec9ee322-26e8-4863-a4fb-3606a9c9e515 None None] Updating volume stats {{(pid=75735) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 09:16:20 devstack cinder-volume[75735]: DEBUG oslo_concurrency.processutils [None req-ec9ee322-26e8-4863-a4fb-3606a9c9e515 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75735) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:16:21 devstack sudo[76555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 09:16:21 devstack sudo[76555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:16:21 devstack sudo[76555]: pam_unix(sudo:session): session closed for user root Sep 28 09:16:21 devstack cinder-volume[75735]: DEBUG oslo_concurrency.processutils [None req-ec9ee322-26e8-4863-a4fb-3606a9c9e515 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=75735) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:16:21 devstack cinder-volume[75735]: DEBUG oslo_concurrency.processutils [None req-ec9ee322-26e8-4863-a4fb-3606a9c9e515 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75735) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:16:21 devstack sudo[76560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 09:16:21 devstack sudo[76560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:16:21 devstack sudo[76560]: pam_unix(sudo:session): session closed for user root Sep 28 09:16:21 devstack cinder-volume[75735]: DEBUG oslo_concurrency.processutils [None req-ec9ee322-26e8-4863-a4fb-3606a9c9e515 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.242s {{(pid=75735) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:16:21 devstack cinder-volume[75735]: DEBUG oslo_concurrency.processutils [None req-ec9ee322-26e8-4863-a4fb-3606a9c9e515 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75735) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:16:21 devstack sudo[76563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 09:16:21 devstack sudo[76563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:16:21 devstack sudo[76563]: pam_unix(sudo:session): session closed for user root Sep 28 09:16:21 devstack cinder-volume[75735]: DEBUG oslo_concurrency.processutils [None req-ec9ee322-26e8-4863-a4fb-3606a9c9e515 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.280s {{(pid=75735) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:16:21 devstack cinder-volume[75735]: DEBUG oslo_concurrency.processutils [None req-ec9ee322-26e8-4863-a4fb-3606a9c9e515 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75735) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:16:21 devstack sudo[76566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 09:16:21 devstack sudo[76566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:16:22 devstack sudo[76566]: pam_unix(sudo:session): session closed for user root Sep 28 09:16:22 devstack cinder-volume[75735]: DEBUG oslo_concurrency.processutils [None req-ec9ee322-26e8-4863-a4fb-3606a9c9e515 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=75735) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:16:22 devstack cinder-volume[75735]: DEBUG cinder.manager [None req-ec9ee322-26e8-4863-a4fb-3606a9c9e515 None None] Notifying Schedulers of capabilities ... {{(pid=75735) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:16:22 devstack cinder-volume[75735]: INFO cinder.volume.manager [None req-ec9ee322-26e8-4863-a4fb-3606a9c9e515 None None] Driver initialization completed successfully. Sep 28 09:16:22 devstack cinder-volume[75735]: INFO cinder.manager [None req-ec9ee322-26e8-4863-a4fb-3606a9c9e515 None None] Initiating service 2 cleanup Sep 28 09:16:22 devstack cinder-volume[75735]: INFO cinder.manager [None req-ec9ee322-26e8-4863-a4fb-3606a9c9e515 None None] Service 2 cleanup completed. Sep 28 09:16:22 devstack cinder-volume[75735]: DEBUG cinder.service [None req-ec9ee322-26e8-4863-a4fb-3606a9c9e515 None None] Creating RPC server for service cinder-volume {{(pid=75735) start /opt/stack/cinder/cinder/service.py:231}} Sep 28 09:16:22 devstack cinder-volume[75735]: DEBUG cinder.service [None req-ec9ee322-26e8-4863-a4fb-3606a9c9e515 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75735) start /opt/stack/cinder/cinder/service.py:237}} Sep 28 09:16:22 devstack cinder-volume[75735]: INFO cinder.volume.manager [None req-ec9ee322-26e8-4863-a4fb-3606a9c9e515 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 28 09:16:22 devstack cinder-volume[75735]: DEBUG cinder.volume.drivers.lvm [None req-ec9ee322-26e8-4863-a4fb-3606a9c9e515 None None] Updating volume stats {{(pid=75735) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 09:16:22 devstack cinder-volume[75735]: DEBUG oslo_concurrency.processutils [None req-ec9ee322-26e8-4863-a4fb-3606a9c9e515 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75735) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:16:22 devstack sudo[76569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 09:16:22 devstack sudo[76569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:16:22 devstack sudo[76569]: pam_unix(sudo:session): session closed for user root Sep 28 09:16:22 devstack cinder-volume[75735]: DEBUG oslo_concurrency.processutils [None req-ec9ee322-26e8-4863-a4fb-3606a9c9e515 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=75735) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:16:22 devstack cinder-volume[75735]: DEBUG oslo_concurrency.processutils [None req-ec9ee322-26e8-4863-a4fb-3606a9c9e515 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75735) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:16:22 devstack sudo[76574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 09:16:22 devstack sudo[76574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:16:22 devstack sudo[76574]: pam_unix(sudo:session): session closed for user root Sep 28 09:16:22 devstack cinder-volume[75735]: DEBUG oslo_concurrency.processutils [None req-ec9ee322-26e8-4863-a4fb-3606a9c9e515 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=75735) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:16:22 devstack cinder-volume[75735]: DEBUG oslo_concurrency.processutils [None req-ec9ee322-26e8-4863-a4fb-3606a9c9e515 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75735) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:16:22 devstack sudo[76580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 09:16:22 devstack sudo[76580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:16:23 devstack sudo[76580]: pam_unix(sudo:session): session closed for user root Sep 28 09:16:23 devstack cinder-volume[75735]: DEBUG oslo_concurrency.processutils [None req-ec9ee322-26e8-4863-a4fb-3606a9c9e515 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.270s {{(pid=75735) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:16:23 devstack cinder-volume[75735]: DEBUG oslo_concurrency.processutils [None req-ec9ee322-26e8-4863-a4fb-3606a9c9e515 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75735) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:16:23 devstack sudo[76583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 09:16:23 devstack sudo[76583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:16:23 devstack sudo[76583]: pam_unix(sudo:session): session closed for user root Sep 28 09:16:23 devstack cinder-volume[75735]: DEBUG oslo_concurrency.processutils [None req-ec9ee322-26e8-4863-a4fb-3606a9c9e515 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.278s {{(pid=75735) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:16:23 devstack cinder-volume[75735]: INFO cinder.volume.manager [None req-ec9ee322-26e8-4863-a4fb-3606a9c9e515 None None] Driver post RPC initialization completed successfully. Sep 28 09:16:25 devstack cinder-volume[75576]: DEBUG dbcounter [-] [75576] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75576) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 09:16:32 devstack cinder-volume[75735]: DEBUG dbcounter [-] [75735] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75735) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 09:16:33 devstack cinder-volume[75735]: DEBUG dbcounter [-] [75735] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=75735) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 09:17:12 devstack cinder-volume[75735]: DEBUG oslo_service.periodic_task [None req-521937a5-0edf-4d99-9f37-0021ba7dab51 None None] Running periodic task VolumeManager._thread_info {{(pid=75735) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 09:17:12 devstack cinder-volume[75735]: DEBUG cinder.volume.manager [None req-521937a5-0edf-4d99-9f37-0021ba7dab51 None None] thread count: 6 {{(pid=75735) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 09:17:12 devstack cinder-volume[75735]: DEBUG cinder.volume.manager [None req-521937a5-0edf-4d99-9f37-0021ba7dab51 None None] thread info: [<_MainThread(MainThread, started 129989230694528)>, , , , , ] {{(pid=75735) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 09:18:12 devstack cinder-volume[75735]: DEBUG oslo_service.periodic_task [None req-521937a5-0edf-4d99-9f37-0021ba7dab51 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75735) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 09:18:12 devstack cinder-volume[75735]: DEBUG cinder.volume.drivers.lvm [None req-521937a5-0edf-4d99-9f37-0021ba7dab51 None None] Updating volume stats {{(pid=75735) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 09:18:12 devstack cinder-volume[75735]: DEBUG oslo_concurrency.processutils [None req-521937a5-0edf-4d99-9f37-0021ba7dab51 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75735) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:18:12 devstack sudo[81810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 09:18:12 devstack sudo[81810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:18:12 devstack sudo[81810]: pam_unix(sudo:session): session closed for user root Sep 28 09:18:12 devstack cinder-volume[75735]: DEBUG oslo_concurrency.processutils [None req-521937a5-0edf-4d99-9f37-0021ba7dab51 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=75735) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:18:12 devstack cinder-volume[75735]: DEBUG oslo_concurrency.processutils [None req-521937a5-0edf-4d99-9f37-0021ba7dab51 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75735) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:18:12 devstack sudo[81813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 09:18:12 devstack sudo[81813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:18:12 devstack sudo[81813]: pam_unix(sudo:session): session closed for user root Sep 28 09:18:12 devstack cinder-volume[75735]: DEBUG oslo_concurrency.processutils [None req-521937a5-0edf-4d99-9f37-0021ba7dab51 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=75735) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:18:12 devstack cinder-volume[75735]: DEBUG oslo_concurrency.processutils [None req-521937a5-0edf-4d99-9f37-0021ba7dab51 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75735) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:18:12 devstack sudo[81816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 09:18:12 devstack sudo[81816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:18:13 devstack sudo[81816]: pam_unix(sudo:session): session closed for user root Sep 28 09:18:13 devstack cinder-volume[75735]: DEBUG oslo_concurrency.processutils [None req-521937a5-0edf-4d99-9f37-0021ba7dab51 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.263s {{(pid=75735) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:18:13 devstack cinder-volume[75735]: DEBUG oslo_concurrency.processutils [None req-521937a5-0edf-4d99-9f37-0021ba7dab51 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75735) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:18:13 devstack sudo[81819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 09:18:13 devstack sudo[81819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:18:13 devstack sudo[81819]: pam_unix(sudo:session): session closed for user root Sep 28 09:18:13 devstack cinder-volume[75735]: DEBUG oslo_concurrency.processutils [None req-521937a5-0edf-4d99-9f37-0021ba7dab51 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=75735) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:18:13 devstack cinder-volume[75735]: DEBUG cinder.manager [None req-521937a5-0edf-4d99-9f37-0021ba7dab51 None None] Notifying Schedulers of capabilities ... {{(pid=75735) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:18:13 devstack cinder-volume[75735]: DEBUG oslo_service.periodic_task [None req-521937a5-0edf-4d99-9f37-0021ba7dab51 None None] Running periodic task VolumeManager._thread_info {{(pid=75735) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 09:18:13 devstack cinder-volume[75735]: DEBUG cinder.volume.manager [None req-521937a5-0edf-4d99-9f37-0021ba7dab51 None None] thread count: 6 {{(pid=75735) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 09:18:13 devstack cinder-volume[75735]: DEBUG cinder.volume.manager [None req-521937a5-0edf-4d99-9f37-0021ba7dab51 None None] thread info: [<_MainThread(MainThread, started 129989230694528)>, , , , , ] {{(pid=75735) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 09:18:33 devstack cinder-volume[75735]: DEBUG dbcounter [-] [75735] Writing DB stats cinder:SELECT=1 {{(pid=75735) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 09:18:33 devstack cinder-volume[75735]: DEBUG dbcounter [-] [75735] Writing DB stats cinder:UPDATE=1 {{(pid=75735) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 09:19:12 devstack cinder-volume[75735]: DEBUG oslo_service.periodic_task [None req-521937a5-0edf-4d99-9f37-0021ba7dab51 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75735) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 09:19:12 devstack cinder-volume[75735]: DEBUG cinder.volume.drivers.lvm [None req-521937a5-0edf-4d99-9f37-0021ba7dab51 None None] Updating volume stats {{(pid=75735) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 09:19:12 devstack cinder-volume[75735]: DEBUG oslo_concurrency.processutils [None req-521937a5-0edf-4d99-9f37-0021ba7dab51 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75735) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:19:12 devstack sudo[83628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 09:19:12 devstack sudo[83628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:19:12 devstack sudo[83628]: pam_unix(sudo:session): session closed for user root Sep 28 09:19:12 devstack cinder-volume[75735]: DEBUG oslo_concurrency.processutils [None req-521937a5-0edf-4d99-9f37-0021ba7dab51 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.315s {{(pid=75735) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:19:12 devstack cinder-volume[75735]: DEBUG oslo_concurrency.processutils [None req-521937a5-0edf-4d99-9f37-0021ba7dab51 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75735) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:19:12 devstack sudo[83640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 09:19:12 devstack sudo[83640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:19:12 devstack sudo[83640]: pam_unix(sudo:session): session closed for user root Sep 28 09:19:12 devstack cinder-volume[75735]: DEBUG oslo_concurrency.processutils [None req-521937a5-0edf-4d99-9f37-0021ba7dab51 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=75735) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:19:12 devstack cinder-volume[75735]: DEBUG oslo_concurrency.processutils [None req-521937a5-0edf-4d99-9f37-0021ba7dab51 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75735) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:19:12 devstack sudo[83645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 09:19:12 devstack sudo[83645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:19:13 devstack sudo[83645]: pam_unix(sudo:session): session closed for user root Sep 28 09:19:13 devstack cinder-volume[75735]: DEBUG oslo_concurrency.processutils [None req-521937a5-0edf-4d99-9f37-0021ba7dab51 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.288s {{(pid=75735) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:19:13 devstack cinder-volume[75735]: DEBUG oslo_concurrency.processutils [None req-521937a5-0edf-4d99-9f37-0021ba7dab51 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75735) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:19:13 devstack sudo[83668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 09:19:13 devstack sudo[83668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:19:13 devstack sudo[83668]: pam_unix(sudo:session): session closed for user root Sep 28 09:19:13 devstack cinder-volume[75735]: DEBUG oslo_concurrency.processutils [None req-521937a5-0edf-4d99-9f37-0021ba7dab51 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=75735) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:19:13 devstack cinder-volume[75735]: DEBUG cinder.manager [None req-521937a5-0edf-4d99-9f37-0021ba7dab51 None None] Notifying Schedulers of capabilities ... {{(pid=75735) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:19:13 devstack cinder-volume[75735]: DEBUG oslo_service.periodic_task [None req-521937a5-0edf-4d99-9f37-0021ba7dab51 None None] Running periodic task VolumeManager._thread_info {{(pid=75735) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 09:19:13 devstack cinder-volume[75735]: DEBUG cinder.volume.manager [None req-521937a5-0edf-4d99-9f37-0021ba7dab51 None None] thread count: 6 {{(pid=75735) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 09:19:13 devstack cinder-volume[75735]: DEBUG cinder.volume.manager [None req-521937a5-0edf-4d99-9f37-0021ba7dab51 None None] thread info: [<_MainThread(MainThread, started 129989230694528)>, , , , , ] {{(pid=75735) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 09:20:12 devstack cinder-volume[75735]: DEBUG oslo_service.periodic_task [None req-521937a5-0edf-4d99-9f37-0021ba7dab51 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75735) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 09:20:12 devstack cinder-volume[75735]: DEBUG cinder.volume.drivers.lvm [None req-521937a5-0edf-4d99-9f37-0021ba7dab51 None None] Updating volume stats {{(pid=75735) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 09:20:12 devstack cinder-volume[75735]: DEBUG oslo_concurrency.processutils [None req-521937a5-0edf-4d99-9f37-0021ba7dab51 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75735) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:20:12 devstack sudo[84933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 09:20:12 devstack sudo[84933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:20:12 devstack sudo[84933]: pam_unix(sudo:session): session closed for user root Sep 28 09:20:12 devstack cinder-volume[75735]: DEBUG oslo_concurrency.processutils [None req-521937a5-0edf-4d99-9f37-0021ba7dab51 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=75735) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:20:12 devstack cinder-volume[75735]: DEBUG oslo_concurrency.processutils [None req-521937a5-0edf-4d99-9f37-0021ba7dab51 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75735) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:20:12 devstack sudo[84936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 09:20:12 devstack sudo[84936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:20:12 devstack sudo[84936]: pam_unix(sudo:session): session closed for user root Sep 28 09:20:12 devstack cinder-volume[75735]: DEBUG oslo_concurrency.processutils [None req-521937a5-0edf-4d99-9f37-0021ba7dab51 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=75735) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:20:12 devstack cinder-volume[75735]: DEBUG oslo_concurrency.processutils [None req-521937a5-0edf-4d99-9f37-0021ba7dab51 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75735) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:20:12 devstack sudo[84939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 09:20:12 devstack sudo[84939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:20:13 devstack sudo[84939]: pam_unix(sudo:session): session closed for user root Sep 28 09:20:13 devstack cinder-volume[75735]: DEBUG oslo_concurrency.processutils [None req-521937a5-0edf-4d99-9f37-0021ba7dab51 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.257s {{(pid=75735) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:20:13 devstack cinder-volume[75735]: DEBUG oslo_concurrency.processutils [None req-521937a5-0edf-4d99-9f37-0021ba7dab51 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75735) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:20:13 devstack sudo[84942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 09:20:13 devstack sudo[84942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:20:13 devstack sudo[84942]: pam_unix(sudo:session): session closed for user root Sep 28 09:20:13 devstack cinder-volume[75735]: DEBUG oslo_concurrency.processutils [None req-521937a5-0edf-4d99-9f37-0021ba7dab51 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=75735) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:20:13 devstack cinder-volume[75735]: DEBUG cinder.manager [None req-521937a5-0edf-4d99-9f37-0021ba7dab51 None None] Notifying Schedulers of capabilities ... {{(pid=75735) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:20:33 devstack cinder-volume[75735]: DEBUG dbcounter [-] [75735] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75735) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 09:20:47 devstack cinder-volume[75576]: INFO oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] Caught SIGTERM, stopping children Sep 28 09:20:47 devstack cinder-volume[75576]: DEBUG oslo_concurrency.lockutils [None req-042ec364-45f1-49d5-baff-93656362014d None None] Acquiring lock "singleton_lock" {{(pid=75576) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 09:20:47 devstack cinder-volume[75576]: DEBUG oslo_concurrency.lockutils [None req-042ec364-45f1-49d5-baff-93656362014d None None] Acquired lock "singleton_lock" {{(pid=75576) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 09:20:47 devstack cinder-volume[75576]: DEBUG oslo_concurrency.lockutils [None req-042ec364-45f1-49d5-baff-93656362014d None None] Releasing lock "singleton_lock" {{(pid=75576) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 09:20:47 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] Stop services. {{(pid=75576) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 28 09:20:47 devstack cinder-volume[75576]: DEBUG oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] Killing children. {{(pid=75576) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 28 09:20:47 devstack cinder-volume[75576]: INFO oslo_service.backend._eventlet.service [None req-042ec364-45f1-49d5-baff-93656362014d None None] Waiting on 1 children to exit Sep 28 09:20:52 devstack cinder-volume[75735]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Sep 28 09:20:52 devstack cinder-volume[85714]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 28 09:20:52 devstack cinder-volume[85714]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 09:20:52 devstack cinder-volume[85714]: we strongly recommend against using it for new projects. Sep 28 09:20:52 devstack cinder-volume[85714]: If you are already using Eventlet, we recommend migrating to a different Sep 28 09:20:52 devstack cinder-volume[85714]: framework. For more detail see Sep 28 09:20:52 devstack cinder-volume[85714]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 09:20:52 devstack cinder-volume[85714]: import eventlet # noqa Sep 28 09:20:54 devstack cinder-volume[85714]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85714) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 09:20:54 devstack cinder-volume[85714]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85714) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 09:20:54 devstack cinder-volume[85714]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85714) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 09:20:55 devstack cinder-volume[85714]: INFO dbcounter [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] Registered counter for database cinder Sep 28 09:20:55 devstack cinder-volume[85714]: DEBUG oslo_db.sqlalchemy.engines [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85714) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 09:20:55 devstack cinder-volume[85714]: DEBUG dbcounter [-] [85714] Writer thread running {{(pid=85714) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 09:20:55 devstack cinder-volume[85714]: INFO cinder.rpc [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 28 09:20:55 devstack cinder-volume[85714]: INFO cinder.rpc [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_db.sqlalchemy.engines [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85714) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 09:20:56 devstack cinder-volume[85714]: INFO cinder.volume.manager [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] Determined volume DB was empty at startup. Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG cinder.volume.manager [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85714) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 28 09:20:56 devstack cinder-volume[85714]: INFO cinder.volume.manager [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 28 09:20:56 devstack cinder-volume[85714]: WARNING stevedore.named [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 09:20:56 devstack cinder-volume[85714]: WARNING castellan.key_manager [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 09:20:56 devstack cinder-volume[85714]: WARNING cinder.keymgr.conf_key_mgr [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 09:20:56 devstack cinder-volume[85714]: INFO cinder.volume.manager [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_db.sqlalchemy.engines [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85714) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 09:20:56 devstack cinder-volume[85714]: INFO oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] Starting 1 workers Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] Started child 85931 {{(pid=85714) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] Full set of CONF: {{(pid=85714) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] ******************************************************************************** {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] Configuration options gathered from: {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] ================================================================================ {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] allow_availability_zone_fallback = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] allow_compression_on_image_upload = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] allowed_direct_url_schemes = [] {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85931]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] api_rate_limit = True {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] auth_strategy = keystone {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] backend_availability_zone = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] backend_host = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] backend_name = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] backend_stats_polling_interval = 60 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] backup_api_class = cinder.backup.api.API {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] backup_name_template = backup-%s {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] backup_use_same_host = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] backup_use_temp_snapshot = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] chap_password = **** {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] chap_username = {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] cinder_internal_tenant_project_id = f48d503e786343b2876c4d8f90731ae5 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] cinder_internal_tenant_user_id = 92abc6520dea4ca7acb8fbc19131fcb2 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] cluster = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] compression_format = gzip {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] compute_api_class = cinder.compute.nova.API {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] config_dir = [] {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] config_source = [] {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] control_exchange = openstack {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] debug = True {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] default_availability_zone = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] default_group_type = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] default_volume_type = QuobyteHD {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] disk_geometry = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] driver_client_cert = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] driver_client_cert_key = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] driver_data_namespace = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] driver_ssl_cert_path = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] driver_ssl_cert_verify = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] driver_use_ssl = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] enable_new_services = True {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] enable_unsupported_driver = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] enabled_backends = ['QuobyteHD'] {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] enforce_multipath_for_image_xfer = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] filter_function = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] glance_api_insecure = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] glance_api_servers = ['http://192.168.122.64/image'] {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] glance_api_ssl_compression = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] glance_ca_certificates_file = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] glance_catalog_info = image:glance:publicURL {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] glance_certfile = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] glance_keyfile = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] glance_num_retries = 3 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] glance_request_timeout = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] goodness_function = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] graceful_shutdown_timeout = 5 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] group_api_class = cinder.group.api.API {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] host = devstack {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] image_compress_on_upload = True {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] image_conversion_address_space_limit = 1 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] image_conversion_cpu_limit = 60 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] image_conversion_disable = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] image_introspection_address_space_limit = 1 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] image_introspection_cpu_limit = 60 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] image_upload_use_cinder_backend = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] image_upload_use_internal_tenant = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] image_volume_cache_enabled = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] image_volume_cache_max_count = 0 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] image_volume_cache_max_size_gb = 0 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] init_host_max_objects_retrieval = 0 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] instance_format = [instance: %(uuid)s] {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] iscsi_target_flags = {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] iscsi_write_cache = on {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] iser_helper = tgtadm {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] iser_ip_address = 192.168.122.64 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] iser_port = 3260 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] log_color = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] log_config_append = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85931]: INFO cinder.volume.manager [None req-4f9baba9-1b63-4858-88e8-395d57a282a1 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 28 09:20:56 devstack cinder-volume[85931]: DEBUG cinder.volume.drivers.remotefs [None req-4f9baba9-1b63-4858-88e8-395d57a282a1 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85931) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] log_dir = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] log_file = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] log_options = True {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] log_rotate_interval = 1 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] log_rotate_interval_type = days {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] log_rotation_type = none {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] max_age = 0 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] max_logfile_count = 30 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] max_logfile_size_mb = 200 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] max_over_subscription_ratio = 20.0 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] message_reap_interval = 86400 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] message_ttl = 2592000 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] migration_create_volume_timeout_secs = 300 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] monkey_patch = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] monkey_patch_modules = [] {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] my_ip = 192.168.122.64 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] no_snapshot_gb_quota = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] num_iser_scan_tries = 3 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] num_shell_tries = 3 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] num_volume_device_scan_tries = 3 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] nvmeof_conn_info_version = 1 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] nvmet_ns_id = 10 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] nvmet_port_id = 1 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] osapi_max_limit = 1000 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] osapi_volume_ext_list = [] {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] osapi_volume_listen = 0.0.0.0 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] osapi_volume_listen_port = 8776 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] osapi_volume_use_ssl = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] osapi_volume_workers = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] per_volume_size_limit = -1 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] periodic_fuzzy_delay = 60 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] periodic_interval = 60 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] project_id_regex = [0-9a-f\-]+ {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] public_endpoint = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] publish_errors = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] quota_backup_gigabytes = 1000 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] quota_backups = 10 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] quota_gigabytes = 1000 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] quota_groups = 10 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] quota_snapshots = 10 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] quota_volumes = 10 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] rate_limit_burst = 0 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] rate_limit_except_level = CRITICAL {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] rate_limit_interval = 0 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] reinit_driver_count = 3 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] replication_device = **** {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] report_discard_supported = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] report_interval = 120 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] reservation_clean_interval = 86400 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] reservation_expire = 86400 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] reserved_image_namespaces = [] {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] reserved_percentage = 0 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] rpc_response_timeout = 120 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] run_external_periodic_tasks = True {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] scst_target_driver = iscsi {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] scst_target_iqn_name = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] service_down_time = 720 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] shell_completion = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] snapshot_name_template = snapshot-%s {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] split_loggers = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] state_path = /opt/stack/data/cinder {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] storage_availability_zone = nova {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] storage_protocol = iSCSI {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] syslog_log_facility = LOG_USER {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] target_helper = lioadm {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] target_ip_address = 192.168.122.64 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] target_port = 3260 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] target_protocol = iscsi {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] target_secondary_ip_addresses = [] {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] trace_flags = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] transfer_api_class = cinder.transfer.api.API {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] transport_url = **** {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] until_refresh = 0 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] use_chap_auth = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] use_default_quota_class = True {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] use_journal = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] use_json = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] use_multipath_for_image_xfer = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] use_stderr = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] use_syslog = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] verify_glance_signatures = enabled {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] volume_api_class = cinder.volume.api.API {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] volume_backend_name = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] volume_clear = zero {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] volume_clear_ionice = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] volume_clear_size = 0 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] volume_copy_bps_limit = 0 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] volume_dd_blocksize = 1M {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] volume_name_template = volume-%s {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] volume_service_inithost_offload = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] volume_usage_audit_period = month {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] zoning_mode = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] oslo_concurrency.disable_process_locking = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] keystone_authtoken.auth_section = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] keystone_authtoken.auth_type = password {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] keystone_authtoken.auth_version = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] keystone_authtoken.cache = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] keystone_authtoken.certfile = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] keystone_authtoken.include_service_catalog = True {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] keystone_authtoken.insecure = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] keystone_authtoken.interface = public {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] keystone_authtoken.keyfile = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] keystone_authtoken.memcache_password = **** {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] keystone_authtoken.memcache_username = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] keystone_authtoken.region_name = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] keystone_authtoken.service_token_roles_required = True {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] keystone_authtoken.service_type = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.64/identity {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] cache.backend = dogpile.cache.null {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] cache.backend_argument = **** {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] cache.backend_expiration_time = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] cache.config_prefix = cache.oslo {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] cache.debug_cache_backend = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] cache.enable_retry_client = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] cache.enable_socket_keepalive = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] cache.enabled = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] cache.expiration_time = 600 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] cache.hashclient_retry_attempts = 2 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] cache.memcache_dead_retry = 300 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] cache.memcache_pool_maxsize = 10 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] cache.memcache_sasl_enabled = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] cache.password = **** {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] cache.proxies = [] {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] cache.redis_db = 0 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] cache.redis_server = localhost:6379 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] cache.retry_attempts = 2 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] cache.retry_delay = 0.0 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] cache.socket_keepalive_count = 1 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] cache.socket_keepalive_idle = 1 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] cache.socket_keepalive_interval = 1 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] cache.socket_timeout = 1.0 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] cache.tls_allowed_ciphers = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] cache.tls_cafile = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] cache.tls_certfile = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] cache.tls_enabled = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] cache.tls_keyfile = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] cache.username = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] coordination.backend_url = **** {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] database.asyncio_connection = **** {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] database.asyncio_slave_connection = **** {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] database.backend = sqlalchemy {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] database.connection = **** {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] database.connection_debug = 0 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] database.connection_parameters = {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85931]: DEBUG cinder.volume.drivers.quobyte [None req-4f9baba9-1b63-4858-88e8-395d57a282a1 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85931) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 28 09:20:56 devstack cinder-volume[85931]: WARNING cinder.volume.drivers.quobyte [None req-4f9baba9-1b63-4858-88e8-395d57a282a1 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 28 09:20:56 devstack cinder-volume[85931]: WARNING cinder.volume.drivers.quobyte [None req-4f9baba9-1b63-4858-88e8-395d57a282a1 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] database.connection_recycle_time = 3600 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] database.connection_trace = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] database.db_inc_retry_interval = True {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] database.db_max_retries = 20 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] database.db_max_retry_interval = 10 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] database.db_retry_interval = 1 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] database.max_overflow = 50 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] database.max_pool_size = 5 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] database.max_retries = 10 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] database.mysql_wsrep_sync_wait = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85931]: DEBUG oslo_concurrency.processutils [None req-4f9baba9-1b63-4858-88e8-395d57a282a1 None None] Running cmd (subprocess): mount.quobyte {{(pid=85931) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] database.pool_timeout = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] database.retry_interval = 10 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] database.slave_connection = **** {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] database.sqlite_synchronous = True {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] database.synchronous_reader = True {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] database.use_db_reconnect = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] oslo_messaging_tracing.insecure = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] profiler.connection_string = messaging:// {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] profiler.enabled = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] profiler.es_doc_type = notification {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] profiler.es_scroll_size = 10000 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] profiler.es_scroll_time = 2m {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] profiler.filter_error_trace = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] profiler.hmac_keys = **** {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] profiler.sentinel_service_name = mymaster {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] profiler.socket_timeout = 0.1 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] profiler.trace_requests = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] profiler.trace_sqlalchemy = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] profiler_jaeger.process_tags = {} {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] profiler_jaeger.service_name_prefix = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] profiler_otlp.service_name_prefix = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] oslo_policy.enforce_new_defaults = True {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] oslo_policy.policy_default_rule = default {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] oslo_policy.policy_file = policy.yaml {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] oslo_policy.remote_timeout = 60.0 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] privsep_osbrick.group = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] privsep_osbrick.helper_command = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] privsep_osbrick.user = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] cinder_sys_admin.group = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] cinder_sys_admin.helper_command = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] cinder_sys_admin.user = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] service_user.auth_section = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] service_user.auth_type = password {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] service_user.cafile = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] service_user.certfile = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] service_user.collect_timing = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] service_user.insecure = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] service_user.keyfile = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] service_user.send_service_user_token = True {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] service_user.split_loggers = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] service_user.timeout = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] service_user.tls_ciphers = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] service_user.tls_min_version = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] glance.auth_section = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] glance.auth_type = password {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] glance.certfile = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] glance.collect_timing = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] glance.insecure = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] glance.keyfile = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] glance.region_name = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] glance.split_loggers = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] glance.timeout = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] glance.tls_ciphers = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] glance.tls_min_version = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] backend_defaults.backend_availability_zone = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] backend_defaults.chap_password = **** {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] backend_defaults.chap_username = {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] backend_defaults.disk_geometry = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] backend_defaults.driver_client_cert = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] backend_defaults.driver_client_cert_key = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] backend_defaults.driver_data_namespace = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] backend_defaults.driver_use_ssl = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] backend_defaults.extra_capabilities = {} {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] backend_defaults.filter_function = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] backend_defaults.goodness_function = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] backend_defaults.iscsi_target_flags = {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] backend_defaults.iscsi_write_cache = on {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] backend_defaults.iser_helper = tgtadm {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] backend_defaults.iser_ip_address = 192.168.122.64 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] backend_defaults.iser_port = 3260 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] backend_defaults.nas_host = {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] backend_defaults.nas_login = admin {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] backend_defaults.nas_mount_options = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] backend_defaults.nas_password = **** {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] backend_defaults.nas_private_key = {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] backend_defaults.nas_share_path = {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] backend_defaults.nas_ssh_port = 22 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] backend_defaults.num_shell_tries = 3 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] backend_defaults.quobyte_volume_url = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] backend_defaults.replication_device = **** {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] backend_defaults.report_discard_supported = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] backend_defaults.reserved_percentage = 0 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] backend_defaults.target_helper = tgtadm {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] backend_defaults.target_ip_address = 192.168.122.64 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] backend_defaults.target_port = 3260 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] backend_defaults.target_protocol = iscsi {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] backend_defaults.trace_flags = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] backend_defaults.unique_fqdn_network = True {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] backend_defaults.use_chap_auth = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] backend_defaults.volume_backend_name = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] backend_defaults.volume_clear = zero {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] backend_defaults.volume_clear_ionice = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] backend_defaults.volume_clear_size = 0 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] oslo_reports.file_event_handler = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] oslo_reports.log_dir = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] QuobyteHD.backend_availability_zone = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] QuobyteHD.backend_host = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] QuobyteHD.chap_password = **** {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] QuobyteHD.chap_username = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] QuobyteHD.chiscsi_conf = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] QuobyteHD.disk_geometry = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] QuobyteHD.driver_client_cert = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] QuobyteHD.driver_data_namespace = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] QuobyteHD.driver_use_ssl = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] QuobyteHD.extra_capabilities = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] QuobyteHD.filter_function = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] QuobyteHD.goodness_function = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] QuobyteHD.iscsi_target_flags = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] QuobyteHD.iscsi_write_cache = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] QuobyteHD.iser_helper = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] QuobyteHD.iser_ip_address = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] QuobyteHD.iser_port = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] QuobyteHD.iser_target_prefix = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] QuobyteHD.nas_host = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] QuobyteHD.nas_login = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] QuobyteHD.nas_mount_options = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] QuobyteHD.nas_password = **** {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] QuobyteHD.nas_private_key = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] QuobyteHD.nas_share_path = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] QuobyteHD.nas_ssh_port = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] QuobyteHD.num_shell_tries = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] QuobyteHD.nvmet_ns_id = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] QuobyteHD.nvmet_port_id = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] QuobyteHD.replication_device = **** {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] QuobyteHD.report_discard_supported = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] QuobyteHD.reserved_percentage = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] QuobyteHD.scst_target_driver = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] QuobyteHD.storage_protocol = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] QuobyteHD.target_helper = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] QuobyteHD.target_ip_address = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] QuobyteHD.target_port = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] QuobyteHD.target_prefix = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] QuobyteHD.target_protocol = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] QuobyteHD.trace_flags = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] QuobyteHD.unique_fqdn_network = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] QuobyteHD.use_chap_auth = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] QuobyteHD.volume_clear = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] QuobyteHD.volume_clear_ionice = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] QuobyteHD.volume_clear_size = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] QuobyteHD.volumes_dir = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack quobyte-client[85936]: Reading configuration file: /etc/quobyte/client.cfg Sep 28 09:20:56 devstack quobyte-client[85936]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85931]: DEBUG oslo_concurrency.processutils [None req-4f9baba9-1b63-4858-88e8-395d57a282a1 None None] CMD "mount.quobyte" returned: 1 in 0.150s {{(pid=85931) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] oslo_messaging_rabbit.ssl = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85931]: DEBUG oslo_concurrency.lockutils [None req-4f9baba9-1b63-4858-88e8-395d57a282a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85931) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:20:56 devstack cinder-volume[85931]: DEBUG oslo_concurrency.lockutils [None req-4f9baba9-1b63-4858-88e8-395d57a282a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=85931) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:20:56 devstack cinder-volume[85931]: DEBUG cinder.volume.drivers.quobyte [None req-4f9baba9-1b63-4858-88e8-395d57a282a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=85931) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85931]: INFO cinder.volume.drivers.quobyte [None req-4f9baba9-1b63-4858-88e8-395d57a282a1 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d ... Sep 28 09:20:56 devstack cinder-volume[85931]: DEBUG oslo_concurrency.processutils [None req-4f9baba9-1b63-4858-88e8-395d57a282a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa -c /etc/quobyte/client-cinder.cfg {{(pid=85931) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] oslo_messaging_rabbit.ssl_version = {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] oslo_messaging_notifications.driver = [] {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] oslo_messaging_notifications.retry = -1 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] key_manager.fixed_key = **** {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] barbican.barbican_api_version = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] barbican.barbican_endpoint = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] barbican.barbican_endpoint_type = public {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] barbican.barbican_region_name = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] barbican.cafile = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] barbican.certfile = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] barbican.collect_timing = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] barbican.insecure = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] barbican.keyfile = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] barbican.number_of_retries = 60 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] barbican.retry_delay = 1 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] barbican.send_service_user_token = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] barbican.split_loggers = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] barbican.timeout = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] barbican.tls_ciphers = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] barbican.tls_min_version = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] barbican.verify_ssl = True {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] barbican.verify_ssl_path = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] barbican_service_user.auth_section = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] barbican_service_user.auth_type = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] barbican_service_user.cafile = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] barbican_service_user.certfile = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] barbican_service_user.collect_timing = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] barbican_service_user.insecure = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] barbican_service_user.keyfile = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] barbican_service_user.split_loggers = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] barbican_service_user.timeout = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] barbican_service_user.tls_ciphers = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] barbican_service_user.tls_min_version = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] vault.approle_role_id = **** {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] vault.approle_secret_id = **** {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] vault.auth_method = approle {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] vault.auth_path = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] vault.kv_mountpoint = secret {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] vault.kv_path = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] vault.kv_version = 2 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] vault.namespace = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] vault.root_token_id = **** {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] vault.ssl_ca_crt_file = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] vault.timeout = 60.0 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] vault.token_file = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] vault.token_role = None {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] vault.use_ssl = False {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:20:56 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] ******************************************************************************** {{(pid=85714) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 28 09:20:56 devstack sudo[85937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa -c /etc/quobyte/client-cinder.cfg Sep 28 09:20:56 devstack sudo[85937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:20:57 devstack cinder-volume[75735]: DEBUG oslo_concurrency.lockutils [None req-042ec364-45f1-49d5-baff-93656362014d None None] Acquiring lock "singleton_lock" {{(pid=75735) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 09:20:57 devstack cinder-volume[75735]: DEBUG oslo_concurrency.lockutils [None req-042ec364-45f1-49d5-baff-93656362014d None None] Acquired lock "singleton_lock" {{(pid=75735) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 09:20:57 devstack cinder-volume[75735]: DEBUG oslo_concurrency.lockutils [None req-042ec364-45f1-49d5-baff-93656362014d None None] Releasing lock "singleton_lock" {{(pid=75735) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 09:20:57 devstack cinder-volume[75735]: WARNING amqp [None req-042ec364-45f1-49d5-baff-93656362014d None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 09:20:57 devstack sudo[85937]: pam_unix(sudo:session): session closed for user root Sep 28 09:20:57 devstack cinder-volume[85931]: DEBUG oslo_concurrency.processutils [None req-4f9baba9-1b63-4858-88e8-395d57a282a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.455s {{(pid=85931) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:20:57 devstack cinder-volume[85931]: INFO cinder.volume.drivers.quobyte [None req-4f9baba9-1b63-4858-88e8-395d57a282a1 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d succeeded Sep 28 09:20:57 devstack cinder-volume[75735]: WARNING amqp [None req-042ec364-45f1-49d5-baff-93656362014d None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 09:20:57 devstack cinder-volume[85931]: DEBUG cinder.volume.drivers.quobyte [None req-4f9baba9-1b63-4858-88e8-395d57a282a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=85931) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:20:57 devstack cinder-volume[85931]: DEBUG oslo_concurrency.lockutils [None req-4f9baba9-1b63-4858-88e8-395d57a282a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.473s {{(pid=85931) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:20:57 devstack cinder-volume[85931]: DEBUG oslo_concurrency.processutils [None req-4f9baba9-1b63-4858-88e8-395d57a282a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=85931) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:20:57 devstack sudo[86038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:20:57 devstack sudo[86038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:20:57 devstack sudo[86038]: pam_unix(sudo:session): session closed for user root Sep 28 09:20:57 devstack cinder-volume[85931]: DEBUG oslo_concurrency.processutils [None req-4f9baba9-1b63-4858-88e8-395d57a282a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.309s {{(pid=85931) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:20:57 devstack cinder-volume[85931]: INFO cinder.volume.driver [None req-4f9baba9-1b63-4858-88e8-395d57a282a1 None None] Driver hasn't implemented _init_vendor_properties() Sep 28 09:20:57 devstack cinder-volume[85931]: DEBUG cinder.volume.driver [None req-4f9baba9-1b63-4858-88e8-395d57a282a1 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.1194190979004, 'free_capacity_gb': 1775.1194190979004, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85931) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 28 09:20:57 devstack cinder-volume[85931]: DEBUG oslo_db.sqlalchemy.engines [None req-4f9baba9-1b63-4858-88e8-395d57a282a1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85931) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 09:20:57 devstack cinder-volume[85931]: DEBUG dbcounter [-] [85931] Writer thread running {{(pid=85931) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 09:20:57 devstack cinder-volume[85931]: DEBUG cinder.db.api [None req-4f9baba9-1b63-4858-88e8-395d57a282a1 None None] Building query based on filter {{(pid=85931) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 28 09:20:57 devstack cinder-volume[85931]: DEBUG cinder.image.image_utils [None req-4f9baba9-1b63-4858-88e8-395d57a282a1 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85931) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 28 09:20:57 devstack cinder-volume[85931]: INFO cinder.keymgr.migration [None req-b0809611-72f6-491f-a897-5982a3ccfcda None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 28 09:20:57 devstack cinder-volume[85931]: DEBUG oslo_concurrency.lockutils [None req-4f9baba9-1b63-4858-88e8-395d57a282a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85931) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:20:57 devstack cinder-volume[85931]: DEBUG oslo_concurrency.lockutils [None req-4f9baba9-1b63-4858-88e8-395d57a282a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85931) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:20:57 devstack cinder-volume[85931]: DEBUG cinder.volume.drivers.quobyte [None req-4f9baba9-1b63-4858-88e8-395d57a282a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=85931) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:20:57 devstack cinder-volume[85931]: DEBUG cinder.volume.drivers.quobyte [None req-4f9baba9-1b63-4858-88e8-395d57a282a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=85931) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:20:57 devstack cinder-volume[85931]: DEBUG oslo_concurrency.lockutils [None req-4f9baba9-1b63-4858-88e8-395d57a282a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85931) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:20:57 devstack cinder-volume[85931]: DEBUG oslo_concurrency.processutils [None req-4f9baba9-1b63-4858-88e8-395d57a282a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=85931) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:20:57 devstack sudo[86065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:20:57 devstack sudo[86065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:20:57 devstack sudo[86065]: pam_unix(sudo:session): session closed for user root Sep 28 09:20:57 devstack cinder-volume[85931]: DEBUG oslo_concurrency.processutils [None req-4f9baba9-1b63-4858-88e8-395d57a282a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.270s {{(pid=85931) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:20:57 devstack cinder-volume[85931]: DEBUG cinder.manager [None req-4f9baba9-1b63-4858-88e8-395d57a282a1 None None] Notifying Schedulers of capabilities ... {{(pid=85931) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:20:58 devstack cinder-volume[85931]: INFO cinder.volume.manager [None req-4f9baba9-1b63-4858-88e8-395d57a282a1 None None] Driver initialization completed successfully. Sep 28 09:20:58 devstack cinder-volume[85931]: INFO cinder.manager [None req-4f9baba9-1b63-4858-88e8-395d57a282a1 None None] Initiating service 3 cleanup Sep 28 09:20:58 devstack cinder-volume[85931]: INFO cinder.manager [None req-4f9baba9-1b63-4858-88e8-395d57a282a1 None None] Service 3 cleanup completed. Sep 28 09:20:58 devstack cinder-volume[85931]: DEBUG cinder.service [None req-4f9baba9-1b63-4858-88e8-395d57a282a1 None None] Creating RPC server for service cinder-volume {{(pid=85931) start /opt/stack/cinder/cinder/service.py:231}} Sep 28 09:20:58 devstack cinder-volume[85931]: DEBUG cinder.service [None req-4f9baba9-1b63-4858-88e8-395d57a282a1 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85931) start /opt/stack/cinder/cinder/service.py:237}} Sep 28 09:20:58 devstack cinder-volume[85931]: INFO cinder.volume.manager [None req-4f9baba9-1b63-4858-88e8-395d57a282a1 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 28 09:20:58 devstack cinder-volume[85931]: DEBUG oslo_concurrency.lockutils [None req-4f9baba9-1b63-4858-88e8-395d57a282a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85931) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:20:58 devstack cinder-volume[85931]: DEBUG oslo_concurrency.lockutils [None req-4f9baba9-1b63-4858-88e8-395d57a282a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85931) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:20:58 devstack cinder-volume[85931]: DEBUG cinder.volume.drivers.quobyte [None req-4f9baba9-1b63-4858-88e8-395d57a282a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=85931) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:20:58 devstack cinder-volume[85931]: DEBUG cinder.volume.drivers.quobyte [None req-4f9baba9-1b63-4858-88e8-395d57a282a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=85931) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:20:58 devstack cinder-volume[85931]: DEBUG oslo_concurrency.lockutils [None req-4f9baba9-1b63-4858-88e8-395d57a282a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85931) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:20:58 devstack cinder-volume[85931]: DEBUG oslo_concurrency.processutils [None req-4f9baba9-1b63-4858-88e8-395d57a282a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=85931) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:20:58 devstack sudo[86074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:20:58 devstack sudo[86074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:20:58 devstack sudo[86074]: pam_unix(sudo:session): session closed for user root Sep 28 09:20:58 devstack cinder-volume[85931]: DEBUG oslo_concurrency.processutils [None req-4f9baba9-1b63-4858-88e8-395d57a282a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.411s {{(pid=85931) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:20:58 devstack cinder-volume[85931]: INFO cinder.volume.manager [None req-4f9baba9-1b63-4858-88e8-395d57a282a1 None None] Driver post RPC initialization completed successfully. Sep 28 09:21:01 devstack cinder-volume[85714]: INFO oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] Caught SIGTERM, stopping children Sep 28 09:21:01 devstack cinder-volume[85714]: DEBUG oslo_concurrency.lockutils [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] Acquiring lock "singleton_lock" {{(pid=85714) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 09:21:01 devstack cinder-volume[85714]: DEBUG oslo_concurrency.lockutils [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] Acquired lock "singleton_lock" {{(pid=85714) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 09:21:01 devstack cinder-volume[85714]: DEBUG oslo_concurrency.lockutils [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] Releasing lock "singleton_lock" {{(pid=85714) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 09:21:01 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] Stop services. {{(pid=85714) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 28 09:21:01 devstack cinder-volume[85714]: DEBUG oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] Killing children. {{(pid=85714) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 28 09:21:01 devstack cinder-volume[85714]: INFO oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] Waiting on 1 children to exit Sep 28 09:21:02 devstack cinder-volume[85931]: DEBUG oslo_concurrency.lockutils [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] Acquiring lock "singleton_lock" {{(pid=85931) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 09:21:02 devstack cinder-volume[85931]: DEBUG oslo_concurrency.lockutils [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] Acquired lock "singleton_lock" {{(pid=85931) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 09:21:02 devstack cinder-volume[85931]: DEBUG oslo_concurrency.lockutils [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] Releasing lock "singleton_lock" {{(pid=85931) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 09:21:02 devstack cinder-volume[85931]: WARNING amqp [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 09:21:02 devstack cinder-volume[85931]: WARNING amqp [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 09:21:02 devstack cinder-volume[85714]: INFO oslo_service.backend._eventlet.service [None req-afc3160f-3cf2-402d-8351-1dd6a27b5d30 None None] Child 85931 exited with status 0 Sep 28 09:21:02 devstack cinder-volume[86238]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 28 09:21:02 devstack cinder-volume[86238]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 09:21:02 devstack cinder-volume[86238]: we strongly recommend against using it for new projects. Sep 28 09:21:02 devstack cinder-volume[86238]: If you are already using Eventlet, we recommend migrating to a different Sep 28 09:21:02 devstack cinder-volume[86238]: framework. For more detail see Sep 28 09:21:02 devstack cinder-volume[86238]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 09:21:02 devstack cinder-volume[86238]: import eventlet # noqa Sep 28 09:21:06 devstack cinder-volume[86238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86238) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 09:21:06 devstack cinder-volume[86238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86238) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 09:21:06 devstack cinder-volume[86238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86238) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 09:21:07 devstack cinder-volume[86238]: INFO dbcounter [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] Registered counter for database cinder Sep 28 09:21:07 devstack cinder-volume[86238]: DEBUG oslo_db.sqlalchemy.engines [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86238) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG dbcounter [-] [86238] Writer thread running {{(pid=86238) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 09:21:08 devstack cinder-volume[86238]: INFO cinder.rpc [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 28 09:21:08 devstack cinder-volume[86238]: INFO cinder.rpc [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_db.sqlalchemy.engines [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86238) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 09:21:08 devstack cinder-volume[86238]: INFO cinder.volume.manager [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] Determined volume DB was empty at startup. Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG cinder.volume.manager [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86238) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 28 09:21:08 devstack cinder-volume[86238]: WARNING stevedore.named [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 09:21:08 devstack cinder-volume[86238]: WARNING castellan.key_manager [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 09:21:08 devstack cinder-volume[86238]: WARNING cinder.keymgr.conf_key_mgr [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 09:21:08 devstack cinder-volume[86238]: INFO cinder.volume.manager [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_db.sqlalchemy.engines [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86238) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 09:21:08 devstack cinder-volume[86238]: INFO oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] Starting 1 workers Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] Started child 86553 {{(pid=86238) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] Full set of CONF: {{(pid=86238) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] ******************************************************************************** {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] Configuration options gathered from: {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 28 09:21:08 devstack cinder-volume[86553]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] ================================================================================ {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] allow_availability_zone_fallback = False {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] allow_compression_on_image_upload = False {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] allowed_direct_url_schemes = [] {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] api_rate_limit = True {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] auth_strategy = keystone {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] backend_availability_zone = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] backend_host = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] backend_name = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] backend_stats_polling_interval = 60 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] backup_api_class = cinder.backup.api.API {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] backup_name_template = backup-%s {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] backup_use_same_host = False {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] backup_use_temp_snapshot = False {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] chap_password = **** {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] chap_username = {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] cinder_internal_tenant_project_id = f48d503e786343b2876c4d8f90731ae5 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] cinder_internal_tenant_user_id = 92abc6520dea4ca7acb8fbc19131fcb2 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] cluster = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] compression_format = gzip {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] compute_api_class = cinder.compute.nova.API {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] config_dir = [] {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] config_source = [] {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] control_exchange = openstack {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] debug = True {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] default_availability_zone = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] default_group_type = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] default_volume_type = QuobyteHD {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] disk_geometry = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] driver_client_cert = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] driver_client_cert_key = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] driver_data_namespace = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] driver_ssl_cert_path = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] driver_ssl_cert_verify = False {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] driver_use_ssl = False {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] enable_new_services = True {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] enable_unsupported_driver = False {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] enabled_backends = ['QuobyteHD'] {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] enforce_multipath_for_image_xfer = False {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] filter_function = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] glance_api_insecure = False {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] glance_api_servers = ['http://192.168.122.64/image'] {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] glance_api_ssl_compression = False {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] glance_ca_certificates_file = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] glance_catalog_info = image:glance:publicURL {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] glance_certfile = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] glance_keyfile = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] glance_num_retries = 3 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] glance_request_timeout = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] goodness_function = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] graceful_shutdown_timeout = 5 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] group_api_class = cinder.group.api.API {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] host = devstack {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] image_compress_on_upload = True {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] image_conversion_address_space_limit = 1 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] image_conversion_cpu_limit = 60 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] image_conversion_disable = False {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] image_introspection_address_space_limit = 1 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] image_introspection_cpu_limit = 60 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] image_upload_use_cinder_backend = False {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] image_upload_use_internal_tenant = False {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] image_volume_cache_enabled = False {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-3bd22104-6c2f-4bd6-9de4-5100fb352fee None None] Starting volume driver QuobyteDriver (1.2.1) Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] image_volume_cache_max_count = 0 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] image_volume_cache_max_size_gb = 0 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] init_host_max_objects_retrieval = 0 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] instance_format = [instance: %(uuid)s] {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] iscsi_target_flags = {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] iscsi_write_cache = on {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] iser_helper = tgtadm {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-3bd22104-6c2f-4bd6-9de4-5100fb352fee None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86553) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] iser_ip_address = 192.168.122.64 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] iser_port = 3260 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] log_color = False {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] log_config_append = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] log_dir = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] log_file = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] log_options = True {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] log_rotate_interval = 1 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] log_rotate_interval_type = days {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] log_rotation_type = none {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] max_age = 0 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] max_logfile_count = 30 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] max_logfile_size_mb = 200 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] max_over_subscription_ratio = 20.0 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] message_reap_interval = 86400 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] message_ttl = 2592000 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] migration_create_volume_timeout_secs = 300 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] monkey_patch = False {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] monkey_patch_modules = [] {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] my_ip = 192.168.122.64 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] no_snapshot_gb_quota = False {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] num_iser_scan_tries = 3 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] num_shell_tries = 3 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] num_volume_device_scan_tries = 3 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] nvmeof_conn_info_version = 1 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] nvmet_ns_id = 10 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] nvmet_port_id = 1 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] osapi_max_limit = 1000 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] osapi_volume_ext_list = [] {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] osapi_volume_listen_port = 8776 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] osapi_volume_use_ssl = False {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] osapi_volume_workers = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] per_volume_size_limit = -1 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] periodic_fuzzy_delay = 60 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] periodic_interval = 60 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] public_endpoint = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] publish_errors = False {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] quota_backup_gigabytes = 1000 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] quota_backups = 10 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] quota_gigabytes = 1000 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] quota_groups = 10 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] quota_snapshots = 10 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] quota_volumes = 10 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] rate_limit_burst = 0 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] rate_limit_except_level = CRITICAL {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] rate_limit_interval = 0 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] reinit_driver_count = 3 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] replication_device = **** {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] report_discard_supported = False {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] report_interval = 120 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] reservation_clean_interval = 86400 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] reservation_expire = 86400 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] reserved_image_namespaces = [] {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] reserved_percentage = 0 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] rpc_response_timeout = 120 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] run_external_periodic_tasks = True {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] scst_target_driver = iscsi {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] scst_target_iqn_name = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] service_down_time = 720 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] shell_completion = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] snapshot_name_template = snapshot-%s {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] split_loggers = False {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] state_path = /opt/stack/data/cinder {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] storage_availability_zone = nova {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] storage_protocol = iSCSI {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] syslog_log_facility = LOG_USER {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] target_helper = lioadm {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] target_ip_address = 192.168.122.64 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] target_port = 3260 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] target_protocol = iscsi {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] target_secondary_ip_addresses = [] {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] trace_flags = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] transport_url = **** {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] until_refresh = 0 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] use_chap_auth = False {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] use_default_quota_class = True {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] use_journal = False {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] use_json = False {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] use_multipath_for_image_xfer = False {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] use_stderr = False {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] use_syslog = False {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] verify_glance_signatures = enabled {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] volume_api_class = cinder.volume.api.API {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] volume_backend_name = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] volume_clear = zero {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] volume_clear_ionice = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] volume_clear_size = 0 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] volume_copy_bps_limit = 0 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] volume_dd_blocksize = 1M {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] volume_name_template = volume-%s {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] volume_service_inithost_offload = False {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] volume_usage_audit_period = month {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] zoning_mode = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] oslo_concurrency.disable_process_locking = False {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:08 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-3bd22104-6c2f-4bd6-9de4-5100fb352fee None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86553) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 28 09:21:08 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.quobyte [None req-3bd22104-6c2f-4bd6-9de4-5100fb352fee None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 28 09:21:08 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.quobyte [None req-3bd22104-6c2f-4bd6-9de4-5100fb352fee None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:08 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3bd22104-6c2f-4bd6-9de4-5100fb352fee None None] Running cmd (subprocess): mount.quobyte {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] keystone_authtoken.auth_section = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] keystone_authtoken.auth_type = password {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] keystone_authtoken.auth_version = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] keystone_authtoken.cache = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] keystone_authtoken.certfile = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] keystone_authtoken.include_service_catalog = True {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] keystone_authtoken.insecure = False {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] keystone_authtoken.interface = public {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] keystone_authtoken.keyfile = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] keystone_authtoken.memcache_password = **** {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] keystone_authtoken.memcache_username = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] keystone_authtoken.region_name = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] keystone_authtoken.service_type = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.64/identity {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] cache.backend = dogpile.cache.null {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] cache.backend_argument = **** {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] cache.backend_expiration_time = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] cache.config_prefix = cache.oslo {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] cache.debug_cache_backend = False {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] cache.enable_retry_client = False {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] cache.enable_socket_keepalive = False {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] cache.enabled = False {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] cache.expiration_time = 600 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] cache.hashclient_retry_attempts = 2 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] cache.memcache_dead_retry = 300 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] cache.memcache_pool_maxsize = 10 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] cache.memcache_sasl_enabled = False {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:08 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] cache.password = **** {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] cache.proxies = [] {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] cache.redis_db = 0 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] cache.redis_server = localhost:6379 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] cache.retry_attempts = 2 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] cache.retry_delay = 0.0 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] cache.socket_keepalive_count = 1 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] cache.socket_keepalive_idle = 1 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] cache.socket_keepalive_interval = 1 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] cache.socket_timeout = 1.0 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] cache.tls_allowed_ciphers = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] cache.tls_cafile = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] cache.tls_certfile = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] cache.tls_enabled = False {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] cache.tls_keyfile = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] cache.username = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] coordination.backend_url = **** {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] database.asyncio_connection = **** {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] database.asyncio_slave_connection = **** {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] database.backend = sqlalchemy {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] database.connection = **** {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] database.connection_debug = 0 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] database.connection_parameters = {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] database.connection_recycle_time = 3600 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] database.connection_trace = False {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] database.db_inc_retry_interval = True {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack sudo[86565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] database.db_max_retries = 20 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] database.db_max_retry_interval = 10 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] database.db_retry_interval = 1 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] database.max_overflow = 50 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] database.max_pool_size = 5 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] database.max_retries = 10 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack sudo[86565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] database.mysql_wsrep_sync_wait = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] database.pool_timeout = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] database.retry_interval = 10 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] database.slave_connection = **** {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] database.sqlite_synchronous = True {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] database.synchronous_reader = True {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] database.use_db_reconnect = False {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] oslo_messaging_tracing.insecure = False {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] profiler.connection_string = messaging:// {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] profiler.enabled = False {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] profiler.es_doc_type = notification {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] profiler.es_scroll_size = 10000 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] profiler.es_scroll_time = 2m {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] profiler.filter_error_trace = False {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] profiler.hmac_keys = **** {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] profiler.sentinel_service_name = mymaster {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] profiler.socket_timeout = 0.1 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] profiler.trace_requests = False {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] profiler.trace_sqlalchemy = False {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] profiler_jaeger.process_tags = {} {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] profiler_jaeger.service_name_prefix = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] profiler_otlp.service_name_prefix = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] oslo_policy.enforce_new_defaults = True {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] oslo_policy.policy_default_rule = default {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] oslo_policy.policy_file = policy.yaml {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] privsep_osbrick.group = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] privsep_osbrick.helper_command = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] privsep_osbrick.user = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] cinder_sys_admin.group = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] cinder_sys_admin.helper_command = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] cinder_sys_admin.user = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] service_user.auth_section = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] service_user.auth_type = password {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] service_user.cafile = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] service_user.certfile = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] service_user.collect_timing = False {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] service_user.insecure = False {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] service_user.keyfile = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] service_user.send_service_user_token = True {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] service_user.split_loggers = False {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] service_user.timeout = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3bd22104-6c2f-4bd6-9de4-5100fb352fee None None] CMD "mount.quobyte" returned: 1 in 0.138s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:21:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-3bd22104-6c2f-4bd6-9de4-5100fb352fee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:21:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-3bd22104-6c2f-4bd6-9de4-5100fb352fee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:21:09 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-3bd22104-6c2f-4bd6-9de4-5100fb352fee None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] service_user.tls_ciphers = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] service_user.tls_min_version = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] glance.auth_section = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] glance.auth_type = password {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] glance.certfile = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] glance.collect_timing = False {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] glance.insecure = False {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] glance.keyfile = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] glance.region_name = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] glance.split_loggers = False {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] glance.timeout = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] glance.tls_ciphers = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] glance.tls_min_version = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] backend_defaults.backend_availability_zone = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] backend_defaults.chap_password = **** {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] backend_defaults.chap_username = {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] backend_defaults.disk_geometry = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] backend_defaults.driver_client_cert = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] backend_defaults.driver_client_cert_key = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] backend_defaults.driver_data_namespace = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] backend_defaults.driver_use_ssl = False {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] backend_defaults.extra_capabilities = {} {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] backend_defaults.filter_function = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] backend_defaults.goodness_function = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] backend_defaults.iscsi_target_flags = {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] backend_defaults.iscsi_write_cache = on {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] backend_defaults.iser_helper = tgtadm {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] backend_defaults.iser_ip_address = 192.168.122.64 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] backend_defaults.iser_port = 3260 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-3bd22104-6c2f-4bd6-9de4-5100fb352fee None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:21:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-3bd22104-6c2f-4bd6-9de4-5100fb352fee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:21:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3bd22104-6c2f-4bd6-9de4-5100fb352fee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] backend_defaults.nas_host = {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] backend_defaults.nas_login = admin {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] backend_defaults.nas_mount_options = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] backend_defaults.nas_password = **** {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] backend_defaults.nas_private_key = {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] backend_defaults.nas_share_path = {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] backend_defaults.num_shell_tries = 3 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] backend_defaults.quobyte_volume_url = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] backend_defaults.replication_device = **** {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] backend_defaults.report_discard_supported = False {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] backend_defaults.reserved_percentage = 0 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] backend_defaults.target_helper = tgtadm {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] backend_defaults.target_ip_address = 192.168.122.64 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] backend_defaults.target_port = 3260 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] backend_defaults.target_protocol = iscsi {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] backend_defaults.trace_flags = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] backend_defaults.unique_fqdn_network = True {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] backend_defaults.use_chap_auth = False {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] backend_defaults.volume_backend_name = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] backend_defaults.volume_clear = zero {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] backend_defaults.volume_clear_ionice = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] backend_defaults.volume_clear_size = 0 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] oslo_reports.file_event_handler = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] oslo_reports.log_dir = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] QuobyteHD.backend_availability_zone = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] QuobyteHD.backend_host = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] QuobyteHD.chap_password = **** {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] QuobyteHD.chap_username = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] QuobyteHD.chiscsi_conf = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] QuobyteHD.disk_geometry = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] QuobyteHD.driver_client_cert = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] QuobyteHD.driver_data_namespace = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] QuobyteHD.driver_use_ssl = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] QuobyteHD.extra_capabilities = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] QuobyteHD.filter_function = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] QuobyteHD.goodness_function = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] QuobyteHD.iser_helper = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] QuobyteHD.iser_ip_address = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] QuobyteHD.iser_port = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] QuobyteHD.iser_target_prefix = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] QuobyteHD.nas_host = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] QuobyteHD.nas_login = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] QuobyteHD.nas_mount_options = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] QuobyteHD.nas_password = **** {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] QuobyteHD.nas_private_key = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] QuobyteHD.nas_share_path = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] QuobyteHD.nas_ssh_port = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] QuobyteHD.num_shell_tries = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] QuobyteHD.nvmet_port_id = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] QuobyteHD.replication_device = **** {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] QuobyteHD.report_discard_supported = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] QuobyteHD.reserved_percentage = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] QuobyteHD.scst_target_driver = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] QuobyteHD.storage_protocol = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] QuobyteHD.target_helper = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] QuobyteHD.target_ip_address = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] QuobyteHD.target_port = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] QuobyteHD.target_prefix = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] QuobyteHD.target_protocol = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] QuobyteHD.trace_flags = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] QuobyteHD.use_chap_auth = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] QuobyteHD.volume_clear = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] QuobyteHD.volume_clear_size = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] QuobyteHD.volumes_dir = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] oslo_messaging_rabbit.ssl = False {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] oslo_messaging_notifications.driver = [] {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] oslo_messaging_notifications.retry = -1 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] key_manager.fixed_key = **** {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] barbican.barbican_api_version = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] barbican.barbican_endpoint = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] barbican.barbican_endpoint_type = public {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] barbican.barbican_region_name = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] barbican.cafile = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] barbican.certfile = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] barbican.collect_timing = False {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] barbican.insecure = False {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] barbican.keyfile = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] barbican.number_of_retries = 60 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] barbican.retry_delay = 1 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] barbican.send_service_user_token = False {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] barbican.split_loggers = False {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] barbican.timeout = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] barbican.tls_ciphers = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] barbican.tls_min_version = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] barbican.verify_ssl = True {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] barbican.verify_ssl_path = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] barbican_service_user.auth_section = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] barbican_service_user.auth_type = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] barbican_service_user.cafile = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] barbican_service_user.certfile = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] barbican_service_user.collect_timing = False {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] barbican_service_user.insecure = False {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] barbican_service_user.keyfile = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] barbican_service_user.split_loggers = False {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] barbican_service_user.timeout = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] barbican_service_user.tls_ciphers = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] barbican_service_user.tls_min_version = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] vault.approle_role_id = **** {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] vault.approle_secret_id = **** {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] vault.auth_method = approle {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] vault.auth_path = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] vault.kv_mountpoint = secret {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] vault.kv_path = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] vault.kv_version = 2 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] vault.namespace = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] vault.root_token_id = **** {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] vault.ssl_ca_crt_file = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] vault.timeout = 60.0 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] vault.token_file = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] vault.token_role = None {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] vault.use_ssl = False {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 09:21:09 devstack cinder-volume[86238]: DEBUG oslo_service.backend._eventlet.service [None req-d6afdab2-509c-4f23-8b24-3fa391b42883 None None] ******************************************************************************** {{(pid=86238) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 28 09:21:09 devstack sudo[86565]: pam_unix(sudo:session): session closed for user root Sep 28 09:21:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3bd22104-6c2f-4bd6-9de4-5100fb352fee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.458s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:21:09 devstack cinder-volume[86553]: INFO cinder.volume.driver [None req-3bd22104-6c2f-4bd6-9de4-5100fb352fee None None] Driver hasn't implemented _init_vendor_properties() Sep 28 09:21:09 devstack cinder-volume[86553]: DEBUG cinder.volume.driver [None req-3bd22104-6c2f-4bd6-9de4-5100fb352fee None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.1194190979004, 'free_capacity_gb': 1775.1194190979004, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86553) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 28 09:21:09 devstack cinder-volume[86553]: DEBUG oslo_db.sqlalchemy.engines [None req-3bd22104-6c2f-4bd6-9de4-5100fb352fee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86553) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 09:21:09 devstack cinder-volume[86553]: DEBUG dbcounter [-] [86553] Writer thread running {{(pid=86553) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 09:21:09 devstack cinder-volume[86553]: DEBUG cinder.db.api [None req-3bd22104-6c2f-4bd6-9de4-5100fb352fee None None] Building query based on filter {{(pid=86553) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 28 09:21:09 devstack cinder-volume[86553]: DEBUG cinder.image.image_utils [None req-3bd22104-6c2f-4bd6-9de4-5100fb352fee None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86553) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 28 09:21:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-3bd22104-6c2f-4bd6-9de4-5100fb352fee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:21:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-3bd22104-6c2f-4bd6-9de4-5100fb352fee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:21:09 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-3bd22104-6c2f-4bd6-9de4-5100fb352fee None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:21:09 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-3bd22104-6c2f-4bd6-9de4-5100fb352fee None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:21:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-3bd22104-6c2f-4bd6-9de4-5100fb352fee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:21:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3bd22104-6c2f-4bd6-9de4-5100fb352fee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:21:09 devstack cinder-volume[86553]: INFO cinder.keymgr.migration [None req-edf28169-de7b-4ade-acee-0f1a9fe26cd7 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 28 09:21:09 devstack sudo[86569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:21:09 devstack sudo[86569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:21:10 devstack sudo[86569]: pam_unix(sudo:session): session closed for user root Sep 28 09:21:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3bd22104-6c2f-4bd6-9de4-5100fb352fee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.469s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:21:10 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-3bd22104-6c2f-4bd6-9de4-5100fb352fee None None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:21:10 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-3bd22104-6c2f-4bd6-9de4-5100fb352fee None None] Driver initialization completed successfully. Sep 28 09:21:10 devstack cinder-volume[86553]: INFO cinder.manager [None req-3bd22104-6c2f-4bd6-9de4-5100fb352fee None None] Initiating service 3 cleanup Sep 28 09:21:10 devstack cinder-volume[86553]: INFO cinder.manager [None req-3bd22104-6c2f-4bd6-9de4-5100fb352fee None None] Service 3 cleanup completed. Sep 28 09:21:10 devstack cinder-volume[86553]: DEBUG cinder.service [None req-3bd22104-6c2f-4bd6-9de4-5100fb352fee None None] Creating RPC server for service cinder-volume {{(pid=86553) start /opt/stack/cinder/cinder/service.py:231}} Sep 28 09:21:10 devstack cinder-volume[86553]: DEBUG cinder.service [None req-3bd22104-6c2f-4bd6-9de4-5100fb352fee None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86553) start /opt/stack/cinder/cinder/service.py:237}} Sep 28 09:21:10 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-3bd22104-6c2f-4bd6-9de4-5100fb352fee None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 28 09:21:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-3bd22104-6c2f-4bd6-9de4-5100fb352fee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:21:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-3bd22104-6c2f-4bd6-9de4-5100fb352fee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:21:10 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-3bd22104-6c2f-4bd6-9de4-5100fb352fee None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:21:10 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-3bd22104-6c2f-4bd6-9de4-5100fb352fee None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:21:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-3bd22104-6c2f-4bd6-9de4-5100fb352fee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:21:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3bd22104-6c2f-4bd6-9de4-5100fb352fee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:21:10 devstack sudo[86582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:21:10 devstack sudo[86582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:21:10 devstack sudo[86582]: pam_unix(sudo:session): session closed for user root Sep 28 09:21:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3bd22104-6c2f-4bd6-9de4-5100fb352fee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.260s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:21:10 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-3bd22104-6c2f-4bd6-9de4-5100fb352fee None None] Driver post RPC initialization completed successfully. Sep 28 09:21:18 devstack cinder-volume[86238]: DEBUG dbcounter [-] [86238] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86238) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 09:21:20 devstack cinder-volume[86553]: DEBUG dbcounter [-] [86553] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=86553) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 09:21:20 devstack cinder-volume[86553]: DEBUG dbcounter [-] [86553] Writing DB stats cinder:SELECT=3 {{(pid=86553) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 09:21:21 devstack cinder-volume[86553]: DEBUG oslo_service.periodic_task [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Running periodic task VolumeManager._thread_info {{(pid=86553) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 09:21:21 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] thread count: 6 {{(pid=86553) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 09:21:21 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] thread info: [<_MainThread(MainThread, started 134684877779072)>, , , , , ] {{(pid=86553) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 09:22:09 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [req-18e14b2b-9619-4883-bb48-9d3d626a7752 req-d546ce92-9a5e-4107-a3d5-71c744430bd1 tempest-VolumesGetTestJSON-443947339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:22:09 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [req-18e14b2b-9619-4883-bb48-9d3d626a7752 req-d546ce92-9a5e-4107-a3d5-71c744430bd1 tempest-VolumesGetTestJSON-443947339 None] Flow 'volume_create_manager' (55119381-47a9-4ea3-b44c-bd96fab5c68a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:22:09 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [req-18e14b2b-9619-4883-bb48-9d3d626a7752 req-d546ce92-9a5e-4107-a3d5-71c744430bd1 tempest-VolumesGetTestJSON-443947339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9d82dc1-a16e-4f9b-b70d-558583559b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:22:09 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [req-18e14b2b-9619-4883-bb48-9d3d626a7752 req-d546ce92-9a5e-4107-a3d5-71c744430bd1 tempest-VolumesGetTestJSON-443947339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9d82dc1-a16e-4f9b-b70d-558583559b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:21:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-736016585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3edcbbdc-cb1e-4cdb-bbf5-05015a3b221e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e79423c190fd4189a385d3b3b431ab62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:22:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:22:10Z,use_quota=True,user_id='57f7c4ce0842423f915ac0acdb60f48f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:22:09 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [req-18e14b2b-9619-4883-bb48-9d3d626a7752 req-d546ce92-9a5e-4107-a3d5-71c744430bd1 tempest-VolumesGetTestJSON-443947339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8db50d56-aae5-4534-b097-e748cb1b2b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:22:09 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [req-18e14b2b-9619-4883-bb48-9d3d626a7752 req-d546ce92-9a5e-4107-a3d5-71c744430bd1 tempest-VolumesGetTestJSON-443947339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8db50d56-aae5-4534-b097-e748cb1b2b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:22:09 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [req-18e14b2b-9619-4883-bb48-9d3d626a7752 req-d546ce92-9a5e-4107-a3d5-71c744430bd1 tempest-VolumesGetTestJSON-443947339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aefe4048-dc91-4849-853e-a082a1c127e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:22:09 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [req-18e14b2b-9619-4883-bb48-9d3d626a7752 req-d546ce92-9a5e-4107-a3d5-71c744430bd1 tempest-VolumesGetTestJSON-443947339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aefe4048-dc91-4849-853e-a082a1c127e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3edcbbdc-cb1e-4cdb-bbf5-05015a3b221e', 'volume_name': 'volume-3edcbbdc-cb1e-4cdb-bbf5-05015a3b221e', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:22:09 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [req-18e14b2b-9619-4883-bb48-9d3d626a7752 req-d546ce92-9a5e-4107-a3d5-71c744430bd1 tempest-VolumesGetTestJSON-443947339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b404cc9-40e7-4b62-be99-fa668377b689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:22:09 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [req-18e14b2b-9619-4883-bb48-9d3d626a7752 req-d546ce92-9a5e-4107-a3d5-71c744430bd1 tempest-VolumesGetTestJSON-443947339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b404cc9-40e7-4b62-be99-fa668377b689) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:22:09 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [req-18e14b2b-9619-4883-bb48-9d3d626a7752 req-d546ce92-9a5e-4107-a3d5-71c744430bd1 tempest-VolumesGetTestJSON-443947339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93a46158-b664-43df-9eaf-d6ed77a399de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:22:09 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [req-18e14b2b-9619-4883-bb48-9d3d626a7752 req-d546ce92-9a5e-4107-a3d5-71c744430bd1 tempest-VolumesGetTestJSON-443947339 None] Volume 3edcbbdc-cb1e-4cdb-bbf5-05015a3b221e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3edcbbdc-cb1e-4cdb-bbf5-05015a3b221e', 'volume_size': 1} Sep 28 09:22:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-18e14b2b-9619-4883-bb48-9d3d626a7752 req-d546ce92-9a5e-4107-a3d5-71c744430bd1 tempest-VolumesGetTestJSON-443947339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:22:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-18e14b2b-9619-4883-bb48-9d3d626a7752 req-d546ce92-9a5e-4107-a3d5-71c744430bd1 tempest-VolumesGetTestJSON-443947339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:22:09 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [req-18e14b2b-9619-4883-bb48-9d3d626a7752 req-d546ce92-9a5e-4107-a3d5-71c744430bd1 tempest-VolumesGetTestJSON-443947339 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:21:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-736016585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3edcbbdc-cb1e-4cdb-bbf5-05015a3b221e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e79423c190fd4189a385d3b3b431ab62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:22:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:22:10Z,use_quota=True,user_id='57f7c4ce0842423f915ac0acdb60f48f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:22:09 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [req-18e14b2b-9619-4883-bb48-9d3d626a7752 req-d546ce92-9a5e-4107-a3d5-71c744430bd1 tempest-VolumesGetTestJSON-443947339 None] Creating volume 3edcbbdc-cb1e-4cdb-bbf5-05015a3b221e {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:22:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-18e14b2b-9619-4883-bb48-9d3d626a7752 req-d546ce92-9a5e-4107-a3d5-71c744430bd1 tempest-VolumesGetTestJSON-443947339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:22:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-18e14b2b-9619-4883-bb48-9d3d626a7752 req-d546ce92-9a5e-4107-a3d5-71c744430bd1 tempest-VolumesGetTestJSON-443947339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:22:09 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [req-18e14b2b-9619-4883-bb48-9d3d626a7752 req-d546ce92-9a5e-4107-a3d5-71c744430bd1 tempest-VolumesGetTestJSON-443947339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:22:09 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [req-18e14b2b-9619-4883-bb48-9d3d626a7752 req-d546ce92-9a5e-4107-a3d5-71c744430bd1 tempest-VolumesGetTestJSON-443947339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:22:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-18e14b2b-9619-4883-bb48-9d3d626a7752 req-d546ce92-9a5e-4107-a3d5-71c744430bd1 tempest-VolumesGetTestJSON-443947339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:22:09 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [req-18e14b2b-9619-4883-bb48-9d3d626a7752 req-d546ce92-9a5e-4107-a3d5-71c744430bd1 tempest-VolumesGetTestJSON-443947339 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:22:09 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [req-18e14b2b-9619-4883-bb48-9d3d626a7752 req-d546ce92-9a5e-4107-a3d5-71c744430bd1 tempest-VolumesGetTestJSON-443947339 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:22:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [req-18e14b2b-9619-4883-bb48-9d3d626a7752 req-d546ce92-9a5e-4107-a3d5-71c744430bd1 tempest-VolumesGetTestJSON-443947339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3edcbbdc-cb1e-4cdb-bbf5-05015a3b221e 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:22:09 devstack sudo[87149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3edcbbdc-cb1e-4cdb-bbf5-05015a3b221e 1073741824 Sep 28 09:22:09 devstack sudo[87149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:22:09 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-bebe8d67-5bd2-48cb-8f42-a36843ab68c5 tempest-TaggedAttachmentsTest-1637253403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:22:09 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-bebe8d67-5bd2-48cb-8f42-a36843ab68c5 tempest-TaggedAttachmentsTest-1637253403 None] Flow 'volume_create_manager' (69cdfe47-9889-4a12-b03c-77e3b88ed881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:22:09 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-bebe8d67-5bd2-48cb-8f42-a36843ab68c5 tempest-TaggedAttachmentsTest-1637253403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9a0ce39-0101-4d2b-95e0-1fe4a537c4c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:22:09 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-bebe8d67-5bd2-48cb-8f42-a36843ab68c5 tempest-TaggedAttachmentsTest-1637253403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9a0ce39-0101-4d2b-95e0-1fe4a537c4c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:21:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-257981241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ebfe33d-3afd-419d-abbb-5da85e3a3bb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2968957ddc924b4bb362b94ee498ec53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:22:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:22:10Z,use_quota=True,user_id='798993038edd49f4924216db39f01c84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:22:10 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-bebe8d67-5bd2-48cb-8f42-a36843ab68c5 tempest-TaggedAttachmentsTest-1637253403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f860b59-9994-42b8-ab15-de7dad711026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:22:10 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-bebe8d67-5bd2-48cb-8f42-a36843ab68c5 tempest-TaggedAttachmentsTest-1637253403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f860b59-9994-42b8-ab15-de7dad711026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:22:10 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-bebe8d67-5bd2-48cb-8f42-a36843ab68c5 tempest-TaggedAttachmentsTest-1637253403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5f74f05-c001-4a7b-b020-09501c74e57c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:22:10 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-bebe8d67-5bd2-48cb-8f42-a36843ab68c5 tempest-TaggedAttachmentsTest-1637253403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5f74f05-c001-4a7b-b020-09501c74e57c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ebfe33d-3afd-419d-abbb-5da85e3a3bb4', 'volume_name': 'volume-7ebfe33d-3afd-419d-abbb-5da85e3a3bb4', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:22:10 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-bebe8d67-5bd2-48cb-8f42-a36843ab68c5 tempest-TaggedAttachmentsTest-1637253403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ce201e6-5da1-4680-8e79-43d315da0845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:22:10 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-bebe8d67-5bd2-48cb-8f42-a36843ab68c5 tempest-TaggedAttachmentsTest-1637253403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ce201e6-5da1-4680-8e79-43d315da0845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:22:10 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-bebe8d67-5bd2-48cb-8f42-a36843ab68c5 tempest-TaggedAttachmentsTest-1637253403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (669c3ded-2c2f-4ca5-a159-0c2d916b09e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:22:10 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-bebe8d67-5bd2-48cb-8f42-a36843ab68c5 tempest-TaggedAttachmentsTest-1637253403 None] Volume 7ebfe33d-3afd-419d-abbb-5da85e3a3bb4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ebfe33d-3afd-419d-abbb-5da85e3a3bb4', 'volume_size': 1} Sep 28 09:22:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-bebe8d67-5bd2-48cb-8f42-a36843ab68c5 tempest-TaggedAttachmentsTest-1637253403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:22:10 devstack sudo[87149]: pam_unix(sudo:session): session closed for user root Sep 28 09:22:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [req-18e14b2b-9619-4883-bb48-9d3d626a7752 req-d546ce92-9a5e-4107-a3d5-71c744430bd1 tempest-VolumesGetTestJSON-443947339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3edcbbdc-cb1e-4cdb-bbf5-05015a3b221e 1073741824" returned: 0 in 0.604s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:22:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [req-18e14b2b-9619-4883-bb48-9d3d626a7752 req-d546ce92-9a5e-4107-a3d5-71c744430bd1 tempest-VolumesGetTestJSON-443947339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3edcbbdc-cb1e-4cdb-bbf5-05015a3b221e {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:22:10 devstack sudo[87471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3edcbbdc-cb1e-4cdb-bbf5-05015a3b221e Sep 28 09:22:10 devstack sudo[87471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:22:10 devstack sudo[87471]: pam_unix(sudo:session): session closed for user root Sep 28 09:22:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [req-18e14b2b-9619-4883-bb48-9d3d626a7752 req-d546ce92-9a5e-4107-a3d5-71c744430bd1 tempest-VolumesGetTestJSON-443947339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3edcbbdc-cb1e-4cdb-bbf5-05015a3b221e" returned: 0 in 0.312s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:22:10 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [req-18e14b2b-9619-4883-bb48-9d3d626a7752 req-d546ce92-9a5e-4107-a3d5-71c744430bd1 tempest-VolumesGetTestJSON-443947339 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:22:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-18e14b2b-9619-4883-bb48-9d3d626a7752 req-d546ce92-9a5e-4107-a3d5-71c744430bd1 tempest-VolumesGetTestJSON-443947339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:22:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-bebe8d67-5bd2-48cb-8f42-a36843ab68c5 tempest-TaggedAttachmentsTest-1637253403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.795s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:22:10 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-bebe8d67-5bd2-48cb-8f42-a36843ab68c5 tempest-TaggedAttachmentsTest-1637253403 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:21:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-257981241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ebfe33d-3afd-419d-abbb-5da85e3a3bb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2968957ddc924b4bb362b94ee498ec53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:22:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:22:10Z,use_quota=True,user_id='798993038edd49f4924216db39f01c84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:22:10 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-bebe8d67-5bd2-48cb-8f42-a36843ab68c5 tempest-TaggedAttachmentsTest-1637253403 None] Creating volume 7ebfe33d-3afd-419d-abbb-5da85e3a3bb4 {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:22:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-bebe8d67-5bd2-48cb-8f42-a36843ab68c5 tempest-TaggedAttachmentsTest-1637253403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:22:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-bebe8d67-5bd2-48cb-8f42-a36843ab68c5 tempest-TaggedAttachmentsTest-1637253403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:22:10 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-bebe8d67-5bd2-48cb-8f42-a36843ab68c5 tempest-TaggedAttachmentsTest-1637253403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:22:10 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-bebe8d67-5bd2-48cb-8f42-a36843ab68c5 tempest-TaggedAttachmentsTest-1637253403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:22:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-bebe8d67-5bd2-48cb-8f42-a36843ab68c5 tempest-TaggedAttachmentsTest-1637253403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:22:10 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-bebe8d67-5bd2-48cb-8f42-a36843ab68c5 tempest-TaggedAttachmentsTest-1637253403 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:22:10 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-bebe8d67-5bd2-48cb-8f42-a36843ab68c5 tempest-TaggedAttachmentsTest-1637253403 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:22:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-bebe8d67-5bd2-48cb-8f42-a36843ab68c5 tempest-TaggedAttachmentsTest-1637253403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-7ebfe33d-3afd-419d-abbb-5da85e3a3bb4 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:22:10 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [req-18e14b2b-9619-4883-bb48-9d3d626a7752 req-d546ce92-9a5e-4107-a3d5-71c744430bd1 tempest-VolumesGetTestJSON-443947339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93a46158-b664-43df-9eaf-d6ed77a399de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3edcbbdc-cb1e-4cdb-bbf5-05015a3b221e', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:22:10 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [req-18e14b2b-9619-4883-bb48-9d3d626a7752 req-d546ce92-9a5e-4107-a3d5-71c744430bd1 tempest-VolumesGetTestJSON-443947339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31637b62-829d-40f3-bf57-8111b2b6dad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:22:10 devstack sudo[87475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-7ebfe33d-3afd-419d-abbb-5da85e3a3bb4 1073741824 Sep 28 09:22:10 devstack sudo[87475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:22:10 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [req-18e14b2b-9619-4883-bb48-9d3d626a7752 req-d546ce92-9a5e-4107-a3d5-71c744430bd1 tempest-VolumesGetTestJSON-443947339 None] Volume volume-3edcbbdc-cb1e-4cdb-bbf5-05015a3b221e (3edcbbdc-cb1e-4cdb-bbf5-05015a3b221e): created successfully Sep 28 09:22:10 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [req-18e14b2b-9619-4883-bb48-9d3d626a7752 req-d546ce92-9a5e-4107-a3d5-71c744430bd1 tempest-VolumesGetTestJSON-443947339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31637b62-829d-40f3-bf57-8111b2b6dad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:22:10 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [req-18e14b2b-9619-4883-bb48-9d3d626a7752 req-d546ce92-9a5e-4107-a3d5-71c744430bd1 tempest-VolumesGetTestJSON-443947339 None] Flow 'volume_create_manager' (55119381-47a9-4ea3-b44c-bd96fab5c68a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:22:10 devstack cinder-volume[86553]: INFO cinder.volume.manager [req-18e14b2b-9619-4883-bb48-9d3d626a7752 req-d546ce92-9a5e-4107-a3d5-71c744430bd1 tempest-VolumesGetTestJSON-443947339 None] Created volume successfully. Sep 28 09:22:11 devstack sudo[87475]: pam_unix(sudo:session): session closed for user root Sep 28 09:22:11 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-bebe8d67-5bd2-48cb-8f42-a36843ab68c5 tempest-TaggedAttachmentsTest-1637253403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-7ebfe33d-3afd-419d-abbb-5da85e3a3bb4 1073741824" returned: 0 in 0.495s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:22:11 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-bebe8d67-5bd2-48cb-8f42-a36843ab68c5 tempest-TaggedAttachmentsTest-1637253403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-7ebfe33d-3afd-419d-abbb-5da85e3a3bb4 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:22:11 devstack sudo[87481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-7ebfe33d-3afd-419d-abbb-5da85e3a3bb4 Sep 28 09:22:11 devstack sudo[87481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:22:11 devstack sudo[87481]: pam_unix(sudo:session): session closed for user root Sep 28 09:22:11 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-bebe8d67-5bd2-48cb-8f42-a36843ab68c5 tempest-TaggedAttachmentsTest-1637253403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-7ebfe33d-3afd-419d-abbb-5da85e3a3bb4" returned: 0 in 0.250s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:22:11 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-bebe8d67-5bd2-48cb-8f42-a36843ab68c5 tempest-TaggedAttachmentsTest-1637253403 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:22:11 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-bebe8d67-5bd2-48cb-8f42-a36843ab68c5 tempest-TaggedAttachmentsTest-1637253403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:22:11 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-bebe8d67-5bd2-48cb-8f42-a36843ab68c5 tempest-TaggedAttachmentsTest-1637253403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (669c3ded-2c2f-4ca5-a159-0c2d916b09e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ebfe33d-3afd-419d-abbb-5da85e3a3bb4', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:22:11 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-bebe8d67-5bd2-48cb-8f42-a36843ab68c5 tempest-TaggedAttachmentsTest-1637253403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (602ba1b3-f4bb-44f1-85d9-8e0395f2ae2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:22:11 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-bebe8d67-5bd2-48cb-8f42-a36843ab68c5 tempest-TaggedAttachmentsTest-1637253403 None] Volume volume-7ebfe33d-3afd-419d-abbb-5da85e3a3bb4 (7ebfe33d-3afd-419d-abbb-5da85e3a3bb4): created successfully Sep 28 09:22:11 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-bebe8d67-5bd2-48cb-8f42-a36843ab68c5 tempest-TaggedAttachmentsTest-1637253403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (602ba1b3-f4bb-44f1-85d9-8e0395f2ae2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:22:11 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-bebe8d67-5bd2-48cb-8f42-a36843ab68c5 tempest-TaggedAttachmentsTest-1637253403 None] Flow 'volume_create_manager' (69cdfe47-9889-4a12-b03c-77e3b88ed881) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:22:11 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-bebe8d67-5bd2-48cb-8f42-a36843ab68c5 tempest-TaggedAttachmentsTest-1637253403 None] Created volume successfully. Sep 28 09:22:12 devstack cinder-volume[86553]: DEBUG cinder.coordination [req-ecfca604-bb29-4322-ab4a-e4f5a861c642 req-61225b48-bf9b-4f1b-b4c3-e4dd563c4e7a tempest-VolumesGetTestJSON-443947339 None] Acquiring lock "cinder-3edcbbdc-cb1e-4cdb-bbf5-05015a3b221e-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:22:12 devstack cinder-volume[86553]: DEBUG cinder.coordination [req-ecfca604-bb29-4322-ab4a-e4f5a861c642 req-61225b48-bf9b-4f1b-b4c3-e4dd563c4e7a tempest-VolumesGetTestJSON-443947339 None] Lock "cinder-3edcbbdc-cb1e-4cdb-bbf5-05015a3b221e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:22:12 devstack cinder-volume[86553]: DEBUG cinder.coordination [req-ecfca604-bb29-4322-ab4a-e4f5a861c642 req-61225b48-bf9b-4f1b-b4c3-e4dd563c4e7a tempest-VolumesGetTestJSON-443947339 None] Acquiring lock "cinder-quobyte-3edcbbdc-cb1e-4cdb-bbf5-05015a3b221e" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:22:12 devstack cinder-volume[86553]: DEBUG cinder.coordination [req-ecfca604-bb29-4322-ab4a-e4f5a861c642 req-61225b48-bf9b-4f1b-b4c3-e4dd563c4e7a tempest-VolumesGetTestJSON-443947339 None] Lock "cinder-quobyte-3edcbbdc-cb1e-4cdb-bbf5-05015a3b221e" acquired by "delete_volume" :: waited 0.021s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:22:12 devstack cinder-volume[86553]: INFO oslo.privsep.daemon [req-ecfca604-bb29-4322-ab4a-e4f5a861c642 req-61225b48-bf9b-4f1b-b4c3-e4dd563c4e7a tempest-VolumesGetTestJSON-443947339 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpoccjvhqq/privsep.sock'] Sep 28 09:22:12 devstack sudo[87484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpoccjvhqq/privsep.sock Sep 28 09:22:12 devstack sudo[87484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:22:13 devstack cinder-volume[86553]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 28 09:22:13 devstack cinder-volume[86553]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 09:22:13 devstack cinder-volume[86553]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 28 09:22:13 devstack cinder-volume[86553]: WARNING oslo.privsep.daemon [-] privsep log: Sep 28 09:22:13 devstack cinder-volume[86553]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 28 09:22:13 devstack cinder-volume[86553]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 28 09:22:13 devstack cinder-volume[86553]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 09:22:13 devstack cinder-volume[86553]: WARNING oslo.privsep.daemon [-] privsep log: Sep 28 09:22:13 devstack cinder-volume[86553]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 28 09:22:13 devstack sudo[87484]: pam_unix(sudo:session): session closed for user root Sep 28 09:22:13 devstack cinder-volume[86553]: INFO oslo.privsep.daemon [req-ecfca604-bb29-4322-ab4a-e4f5a861c642 req-61225b48-bf9b-4f1b-b4c3-e4dd563c4e7a tempest-VolumesGetTestJSON-443947339 None] Spawned new privsep daemon via rootwrap Sep 28 09:22:13 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [req-ecfca604-bb29-4322-ab4a-e4f5a861c642 req-61225b48-bf9b-4f1b-b4c3-e4dd563c4e7a tempest-VolumesGetTestJSON-443947339 None] Accepted privsep connection to /tmp/tmpoccjvhqq/privsep.sock {{(pid=86553) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 28 09:22:13 devstack cinder-volume[86553]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 28 09:22:13 devstack cinder-volume[86553]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 28 09:22:13 devstack cinder-volume[86553]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 28 09:22:13 devstack cinder-volume[86553]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87488 Sep 28 09:22:13 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f67fc3-2faa-442c-8c0e-cdc58a6a8598]: (2,) {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:22:13 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[140724bd-e7ed-4733-8366-69a50768d425]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:22:13 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [req-ecfca604-bb29-4322-ab4a-e4f5a861c642 req-61225b48-bf9b-4f1b-b4c3-e4dd563c4e7a tempest-VolumesGetTestJSON-443947339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3edcbbdc-cb1e-4cdb-bbf5-05015a3b221e {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:22:14 devstack sudo[87490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3edcbbdc-cb1e-4cdb-bbf5-05015a3b221e Sep 28 09:22:14 devstack sudo[87490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:22:14 devstack sudo[87490]: pam_unix(sudo:session): session closed for user root Sep 28 09:22:14 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [req-ecfca604-bb29-4322-ab4a-e4f5a861c642 req-61225b48-bf9b-4f1b-b4c3-e4dd563c4e7a tempest-VolumesGetTestJSON-443947339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3edcbbdc-cb1e-4cdb-bbf5-05015a3b221e" returned: 0 in 0.591s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:22:14 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [req-ecfca604-bb29-4322-ab4a-e4f5a861c642 req-61225b48-bf9b-4f1b-b4c3-e4dd563c4e7a tempest-VolumesGetTestJSON-443947339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3edcbbdc-cb1e-4cdb-bbf5-05015a3b221e {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:22:14 devstack sudo[87496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3edcbbdc-cb1e-4cdb-bbf5-05015a3b221e Sep 28 09:22:14 devstack sudo[87496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:22:14 devstack sudo[87496]: pam_unix(sudo:session): session closed for user root Sep 28 09:22:14 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [req-ecfca604-bb29-4322-ab4a-e4f5a861c642 req-61225b48-bf9b-4f1b-b4c3-e4dd563c4e7a tempest-VolumesGetTestJSON-443947339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3edcbbdc-cb1e-4cdb-bbf5-05015a3b221e" returned: 0 in 0.323s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:22:14 devstack cinder-volume[86553]: DEBUG cinder.coordination [req-ecfca604-bb29-4322-ab4a-e4f5a861c642 req-61225b48-bf9b-4f1b-b4c3-e4dd563c4e7a tempest-VolumesGetTestJSON-443947339 None] Lock "cinder-quobyte-3edcbbdc-cb1e-4cdb-bbf5-05015a3b221e" released by "delete_volume" :: held 2.590s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:22:14 devstack cinder-volume[86553]: WARNING cinder.quota [req-ecfca604-bb29-4322-ab4a-e4f5a861c642 req-61225b48-bf9b-4f1b-b4c3-e4dd563c4e7a tempest-VolumesGetTestJSON-443947339 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 28 09:22:14 devstack cinder-volume[86553]: WARNING cinder.quota [req-ecfca604-bb29-4322-ab4a-e4f5a861c642 req-61225b48-bf9b-4f1b-b4c3-e4dd563c4e7a tempest-VolumesGetTestJSON-443947339 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 28 09:22:14 devstack cinder-volume[86553]: DEBUG cinder.quota [req-ecfca604-bb29-4322-ab4a-e4f5a861c642 req-61225b48-bf9b-4f1b-b4c3-e4dd563c4e7a tempest-VolumesGetTestJSON-443947339 None] Created reservations ['1b0415d6-77f8-43d4-b822-e57dd582e2ab', '686ec585-2a62-4522-97b0-9a0c2c089660', '65669648-6a77-480e-8f88-e70aed3b8888', 'a3293d42-2371-4f0f-92db-703ec5e873d1'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:22:15 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-ecfca604-bb29-4322-ab4a-e4f5a861c642 req-61225b48-bf9b-4f1b-b4c3-e4dd563c4e7a tempest-VolumesGetTestJSON-443947339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:22:15 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-ecfca604-bb29-4322-ab4a-e4f5a861c642 req-61225b48-bf9b-4f1b-b4c3-e4dd563c4e7a tempest-VolumesGetTestJSON-443947339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:22:15 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [req-ecfca604-bb29-4322-ab4a-e4f5a861c642 req-61225b48-bf9b-4f1b-b4c3-e4dd563c4e7a tempest-VolumesGetTestJSON-443947339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:22:15 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [req-ecfca604-bb29-4322-ab4a-e4f5a861c642 req-61225b48-bf9b-4f1b-b4c3-e4dd563c4e7a tempest-VolumesGetTestJSON-443947339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:22:15 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-ecfca604-bb29-4322-ab4a-e4f5a861c642 req-61225b48-bf9b-4f1b-b4c3-e4dd563c4e7a tempest-VolumesGetTestJSON-443947339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:22:15 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [req-ecfca604-bb29-4322-ab4a-e4f5a861c642 req-61225b48-bf9b-4f1b-b4c3-e4dd563c4e7a tempest-VolumesGetTestJSON-443947339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:22:15 devstack sudo[87500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:22:15 devstack sudo[87500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:22:15 devstack sudo[87500]: pam_unix(sudo:session): session closed for user root Sep 28 09:22:15 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [req-ecfca604-bb29-4322-ab4a-e4f5a861c642 req-61225b48-bf9b-4f1b-b4c3-e4dd563c4e7a tempest-VolumesGetTestJSON-443947339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.385s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:22:15 devstack cinder-volume[86553]: DEBUG cinder.manager [req-ecfca604-bb29-4322-ab4a-e4f5a861c642 req-61225b48-bf9b-4f1b-b4c3-e4dd563c4e7a tempest-VolumesGetTestJSON-443947339 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:22:15 devstack cinder-volume[86553]: INFO cinder.volume.manager [req-ecfca604-bb29-4322-ab4a-e4f5a861c642 req-61225b48-bf9b-4f1b-b4c3-e4dd563c4e7a tempest-VolumesGetTestJSON-443947339 None] Deleted volume successfully. Sep 28 09:22:15 devstack cinder-volume[86553]: DEBUG cinder.coordination [req-ecfca604-bb29-4322-ab4a-e4f5a861c642 req-61225b48-bf9b-4f1b-b4c3-e4dd563c4e7a tempest-VolumesGetTestJSON-443947339 None] Lock "cinder-3edcbbdc-cb1e-4cdb-bbf5-05015a3b221e-delete_volume" released by "delete_volume" :: held 3.344s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:22:21 devstack cinder-volume[86553]: DEBUG oslo_service.periodic_task [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86553) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 09:22:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:22:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:22:21 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:22:21 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:22:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:22:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:22:21 devstack sudo[87594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:22:21 devstack sudo[87594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:22:21 devstack sudo[87594]: pam_unix(sudo:session): session closed for user root Sep 28 09:22:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.262s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:22:21 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:22:21 devstack cinder-volume[86553]: DEBUG oslo_service.periodic_task [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Running periodic task VolumeManager._thread_info {{(pid=86553) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 09:22:21 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] thread count: 8 {{(pid=86553) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 09:22:21 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] thread info: [<_MainThread(MainThread, started 134684877779072)>, , , , , , , ] {{(pid=86553) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 09:22:25 devstack cinder-volume[86553]: DEBUG dbcounter [-] [86553] Writing DB stats cinder:SELECT=9,cinder:UPDATE=15,cinder:INSERT=2,cinder:DELETE=2 {{(pid=86553) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 09:22:25 devstack cinder-volume[86553]: DEBUG dbcounter [-] [86553] Writing DB stats cinder:UPDATE=13,cinder:SELECT=9,cinder:INSERT=4,cinder:DELETE=1 {{(pid=86553) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 09:22:27 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-81e335a6-4f35-4ca2-afaf-20ba797a4c6b tempest-ServerActionsTestOtherA-711372344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:22:27 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-81e335a6-4f35-4ca2-afaf-20ba797a4c6b tempest-ServerActionsTestOtherA-711372344 None] Flow 'volume_create_manager' (491cf6c0-b293-4d30-a91d-5b6769daee97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:22:27 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-81e335a6-4f35-4ca2-afaf-20ba797a4c6b tempest-ServerActionsTestOtherA-711372344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (786efff7-992e-4984-9edb-56df66b132e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:22:27 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-81e335a6-4f35-4ca2-afaf-20ba797a4c6b tempest-ServerActionsTestOtherA-711372344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (786efff7-992e-4984-9edb-56df66b132e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:22:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1882007040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06c42fcd-9687-401a-95f2-bcd257ff5ec8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbcfee92ae24456da32e409ba3c3bd90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:22:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:22:28Z,use_quota=True,user_id='b362b982dcdc42cf8b1041a20b0e9f8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:22:27 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-81e335a6-4f35-4ca2-afaf-20ba797a4c6b tempest-ServerActionsTestOtherA-711372344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (201b7f89-8102-4b84-ba4c-61d6174ab0c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:22:27 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-81e335a6-4f35-4ca2-afaf-20ba797a4c6b tempest-ServerActionsTestOtherA-711372344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (201b7f89-8102-4b84-ba4c-61d6174ab0c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:22:27 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-81e335a6-4f35-4ca2-afaf-20ba797a4c6b tempest-ServerActionsTestOtherA-711372344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15a3abc2-6549-4c74-a516-c6a372d24216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:22:27 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-81e335a6-4f35-4ca2-afaf-20ba797a4c6b tempest-ServerActionsTestOtherA-711372344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15a3abc2-6549-4c74-a516-c6a372d24216) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06c42fcd-9687-401a-95f2-bcd257ff5ec8', 'volume_name': 'volume-06c42fcd-9687-401a-95f2-bcd257ff5ec8', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:22:27 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-81e335a6-4f35-4ca2-afaf-20ba797a4c6b tempest-ServerActionsTestOtherA-711372344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9828eec3-f735-4dd9-a1ee-5820fd5f5f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:22:27 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-81e335a6-4f35-4ca2-afaf-20ba797a4c6b tempest-ServerActionsTestOtherA-711372344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9828eec3-f735-4dd9-a1ee-5820fd5f5f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:22:27 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-81e335a6-4f35-4ca2-afaf-20ba797a4c6b tempest-ServerActionsTestOtherA-711372344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1c55046-4b29-4ddf-a53c-42fea83a954e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:22:27 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-81e335a6-4f35-4ca2-afaf-20ba797a4c6b tempest-ServerActionsTestOtherA-711372344 None] Volume 06c42fcd-9687-401a-95f2-bcd257ff5ec8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06c42fcd-9687-401a-95f2-bcd257ff5ec8', 'volume_size': 1} Sep 28 09:22:27 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-81e335a6-4f35-4ca2-afaf-20ba797a4c6b tempest-ServerActionsTestOtherA-711372344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:22:27 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-81e335a6-4f35-4ca2-afaf-20ba797a4c6b tempest-ServerActionsTestOtherA-711372344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:22:27 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-81e335a6-4f35-4ca2-afaf-20ba797a4c6b tempest-ServerActionsTestOtherA-711372344 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:22:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1882007040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06c42fcd-9687-401a-95f2-bcd257ff5ec8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbcfee92ae24456da32e409ba3c3bd90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:22:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:22:28Z,use_quota=True,user_id='b362b982dcdc42cf8b1041a20b0e9f8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:22:27 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-81e335a6-4f35-4ca2-afaf-20ba797a4c6b tempest-ServerActionsTestOtherA-711372344 None] Creating volume 06c42fcd-9687-401a-95f2-bcd257ff5ec8 {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:22:27 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-81e335a6-4f35-4ca2-afaf-20ba797a4c6b tempest-ServerActionsTestOtherA-711372344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:22:27 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-81e335a6-4f35-4ca2-afaf-20ba797a4c6b tempest-ServerActionsTestOtherA-711372344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:22:27 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-81e335a6-4f35-4ca2-afaf-20ba797a4c6b tempest-ServerActionsTestOtherA-711372344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:22:27 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-81e335a6-4f35-4ca2-afaf-20ba797a4c6b tempest-ServerActionsTestOtherA-711372344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:22:27 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-81e335a6-4f35-4ca2-afaf-20ba797a4c6b tempest-ServerActionsTestOtherA-711372344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:22:27 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-81e335a6-4f35-4ca2-afaf-20ba797a4c6b tempest-ServerActionsTestOtherA-711372344 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:22:27 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-81e335a6-4f35-4ca2-afaf-20ba797a4c6b tempest-ServerActionsTestOtherA-711372344 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:22:27 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-81e335a6-4f35-4ca2-afaf-20ba797a4c6b tempest-ServerActionsTestOtherA-711372344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-06c42fcd-9687-401a-95f2-bcd257ff5ec8 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:22:27 devstack sudo[87693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-06c42fcd-9687-401a-95f2-bcd257ff5ec8 1073741824 Sep 28 09:22:27 devstack sudo[87693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:22:28 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-2f77532d-9ea8-4a05-8a0d-8c9f51c0f05a tempest-GroupsV320Test-416534927 None] Group tempest-GroupsV320Test-Group-555983886: creating Sep 28 09:22:28 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-2f77532d-9ea8-4a05-8a0d-8c9f51c0f05a tempest-GroupsV320Test-416534927 None] Group tempest-GroupsV320Test-Group-555983886: created successfully Sep 28 09:22:28 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-2f77532d-9ea8-4a05-8a0d-8c9f51c0f05a tempest-GroupsV320Test-416534927 None] Create group completed successfully. Sep 28 09:22:28 devstack sudo[87693]: pam_unix(sudo:session): session closed for user root Sep 28 09:22:28 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-81e335a6-4f35-4ca2-afaf-20ba797a4c6b tempest-ServerActionsTestOtherA-711372344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-06c42fcd-9687-401a-95f2-bcd257ff5ec8 1073741824" returned: 0 in 1.069s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:22:28 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-81e335a6-4f35-4ca2-afaf-20ba797a4c6b tempest-ServerActionsTestOtherA-711372344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-06c42fcd-9687-401a-95f2-bcd257ff5ec8 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:22:28 devstack sudo[87711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-06c42fcd-9687-401a-95f2-bcd257ff5ec8 Sep 28 09:22:28 devstack sudo[87711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:22:29 devstack sudo[87711]: pam_unix(sudo:session): session closed for user root Sep 28 09:22:29 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-81e335a6-4f35-4ca2-afaf-20ba797a4c6b tempest-ServerActionsTestOtherA-711372344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-06c42fcd-9687-401a-95f2-bcd257ff5ec8" returned: 0 in 0.347s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:22:29 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-81e335a6-4f35-4ca2-afaf-20ba797a4c6b tempest-ServerActionsTestOtherA-711372344 None] <== create_volume: return (1471ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:22:29 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-81e335a6-4f35-4ca2-afaf-20ba797a4c6b tempest-ServerActionsTestOtherA-711372344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.474s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:22:29 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-81e335a6-4f35-4ca2-afaf-20ba797a4c6b tempest-ServerActionsTestOtherA-711372344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1c55046-4b29-4ddf-a53c-42fea83a954e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06c42fcd-9687-401a-95f2-bcd257ff5ec8', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:22:29 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-81e335a6-4f35-4ca2-afaf-20ba797a4c6b tempest-ServerActionsTestOtherA-711372344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d7ab7c9-fa22-4b35-8d8a-07eaed2149e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:22:29 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-81e335a6-4f35-4ca2-afaf-20ba797a4c6b tempest-ServerActionsTestOtherA-711372344 None] Volume volume-06c42fcd-9687-401a-95f2-bcd257ff5ec8 (06c42fcd-9687-401a-95f2-bcd257ff5ec8): created successfully Sep 28 09:22:29 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-81e335a6-4f35-4ca2-afaf-20ba797a4c6b tempest-ServerActionsTestOtherA-711372344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d7ab7c9-fa22-4b35-8d8a-07eaed2149e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:22:29 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-81e335a6-4f35-4ca2-afaf-20ba797a4c6b tempest-ServerActionsTestOtherA-711372344 None] Flow 'volume_create_manager' (491cf6c0-b293-4d30-a91d-5b6769daee97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:22:29 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-81e335a6-4f35-4ca2-afaf-20ba797a4c6b tempest-ServerActionsTestOtherA-711372344 None] Created volume successfully. Sep 28 09:22:30 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-f3737128-b3a3-40c6-b1d1-b353edef8b91 tempest-GroupsV320Test-416534927 None] Created reservations ['ee32d491-4ec0-47f1-9b9a-fe5f97d49e2d'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:22:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-f3737128-b3a3-40c6-b1d1-b353edef8b91 tempest-GroupsV320Test-416534927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:22:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-f3737128-b3a3-40c6-b1d1-b353edef8b91 tempest-GroupsV320Test-416534927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:22:30 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-f3737128-b3a3-40c6-b1d1-b353edef8b91 tempest-GroupsV320Test-416534927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:22:30 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-f3737128-b3a3-40c6-b1d1-b353edef8b91 tempest-GroupsV320Test-416534927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:22:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-f3737128-b3a3-40c6-b1d1-b353edef8b91 tempest-GroupsV320Test-416534927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:22:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f3737128-b3a3-40c6-b1d1-b353edef8b91 tempest-GroupsV320Test-416534927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:22:30 devstack sudo[87723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:22:30 devstack sudo[87723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:22:31 devstack sudo[87723]: pam_unix(sudo:session): session closed for user root Sep 28 09:22:31 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f3737128-b3a3-40c6-b1d1-b353edef8b91 tempest-GroupsV320Test-416534927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.438s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:22:31 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-f3737128-b3a3-40c6-b1d1-b353edef8b91 tempest-GroupsV320Test-416534927 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:22:31 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-f3737128-b3a3-40c6-b1d1-b353edef8b91 tempest-GroupsV320Test-416534927 None] Delete group completed successfully. Sep 28 09:22:40 devstack cinder-volume[86553]: DEBUG dbcounter [-] [86553] Writing DB stats cinder:SELECT=5,cinder:UPDATE=8,cinder:INSERT=1 {{(pid=86553) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 09:22:40 devstack cinder-volume[86553]: DEBUG dbcounter [-] [86553] Writing DB stats cinder:UPDATE=5,cinder:SELECT=12,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86553) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 09:22:52 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-664aff55-63db-4b9e-8e4f-2ce44a1287fd tempest-SnapshotsActionsTest-1398629393 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:22:52 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-664aff55-63db-4b9e-8e4f-2ce44a1287fd tempest-SnapshotsActionsTest-1398629393 None] Flow 'volume_create_manager' (9d8fd1a3-46d7-4e4b-b9e7-51882c245ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:22:52 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-664aff55-63db-4b9e-8e4f-2ce44a1287fd tempest-SnapshotsActionsTest-1398629393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (978880dc-12a5-4ec9-ac06-d026426aa647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:22:52 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-664aff55-63db-4b9e-8e4f-2ce44a1287fd tempest-SnapshotsActionsTest-1398629393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (978880dc-12a5-4ec9-ac06-d026426aa647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:22:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2103455949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89c76f9a-ea2a-4b26-9f56-e8380054a2f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34486ef0069e4b1a86a1240aa0db265b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:22:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:22:53Z,use_quota=True,user_id='747701c3325b45198460f0e8d159e230',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:22:52 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-664aff55-63db-4b9e-8e4f-2ce44a1287fd tempest-SnapshotsActionsTest-1398629393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6a19cda-dc61-4a9c-b4e0-d2378e6afb3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:22:52 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-664aff55-63db-4b9e-8e4f-2ce44a1287fd tempest-SnapshotsActionsTest-1398629393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6a19cda-dc61-4a9c-b4e0-d2378e6afb3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:22:52 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-664aff55-63db-4b9e-8e4f-2ce44a1287fd tempest-SnapshotsActionsTest-1398629393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c2fcd0f-b18c-40dc-be52-fbb8a02f909a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:22:52 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-664aff55-63db-4b9e-8e4f-2ce44a1287fd tempest-SnapshotsActionsTest-1398629393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c2fcd0f-b18c-40dc-be52-fbb8a02f909a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89c76f9a-ea2a-4b26-9f56-e8380054a2f7', 'volume_name': 'volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:22:52 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-664aff55-63db-4b9e-8e4f-2ce44a1287fd tempest-SnapshotsActionsTest-1398629393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eae848c-ea53-4546-bc14-8529dce68f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:22:52 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-664aff55-63db-4b9e-8e4f-2ce44a1287fd tempest-SnapshotsActionsTest-1398629393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eae848c-ea53-4546-bc14-8529dce68f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:22:53 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-664aff55-63db-4b9e-8e4f-2ce44a1287fd tempest-SnapshotsActionsTest-1398629393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1abe9c2-7505-4e37-b428-cc39941fa9dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:22:53 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-664aff55-63db-4b9e-8e4f-2ce44a1287fd tempest-SnapshotsActionsTest-1398629393 None] Volume 89c76f9a-ea2a-4b26-9f56-e8380054a2f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7', 'volume_size': 1} Sep 28 09:22:53 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-664aff55-63db-4b9e-8e4f-2ce44a1287fd tempest-SnapshotsActionsTest-1398629393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:22:53 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-664aff55-63db-4b9e-8e4f-2ce44a1287fd tempest-SnapshotsActionsTest-1398629393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:22:53 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-664aff55-63db-4b9e-8e4f-2ce44a1287fd tempest-SnapshotsActionsTest-1398629393 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:22:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2103455949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89c76f9a-ea2a-4b26-9f56-e8380054a2f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34486ef0069e4b1a86a1240aa0db265b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:22:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:22:53Z,use_quota=True,user_id='747701c3325b45198460f0e8d159e230',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:22:53 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-664aff55-63db-4b9e-8e4f-2ce44a1287fd tempest-SnapshotsActionsTest-1398629393 None] Creating volume 89c76f9a-ea2a-4b26-9f56-e8380054a2f7 {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:22:53 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-664aff55-63db-4b9e-8e4f-2ce44a1287fd tempest-SnapshotsActionsTest-1398629393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:22:53 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-664aff55-63db-4b9e-8e4f-2ce44a1287fd tempest-SnapshotsActionsTest-1398629393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:22:53 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-664aff55-63db-4b9e-8e4f-2ce44a1287fd tempest-SnapshotsActionsTest-1398629393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:22:53 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-664aff55-63db-4b9e-8e4f-2ce44a1287fd tempest-SnapshotsActionsTest-1398629393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:22:53 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-664aff55-63db-4b9e-8e4f-2ce44a1287fd tempest-SnapshotsActionsTest-1398629393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:22:53 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-664aff55-63db-4b9e-8e4f-2ce44a1287fd tempest-SnapshotsActionsTest-1398629393 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:22:53 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-664aff55-63db-4b9e-8e4f-2ce44a1287fd tempest-SnapshotsActionsTest-1398629393 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:22:53 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-664aff55-63db-4b9e-8e4f-2ce44a1287fd tempest-SnapshotsActionsTest-1398629393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:22:53 devstack sudo[87844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7 1073741824 Sep 28 09:22:53 devstack sudo[87844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:22:53 devstack sudo[87844]: pam_unix(sudo:session): session closed for user root Sep 28 09:22:53 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-664aff55-63db-4b9e-8e4f-2ce44a1287fd tempest-SnapshotsActionsTest-1398629393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7 1073741824" returned: 0 in 0.543s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:22:53 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-664aff55-63db-4b9e-8e4f-2ce44a1287fd tempest-SnapshotsActionsTest-1398629393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:22:53 devstack sudo[87850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7 Sep 28 09:22:53 devstack sudo[87850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:22:53 devstack sudo[87850]: pam_unix(sudo:session): session closed for user root Sep 28 09:22:53 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-664aff55-63db-4b9e-8e4f-2ce44a1287fd tempest-SnapshotsActionsTest-1398629393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7" returned: 0 in 0.334s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:22:53 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-664aff55-63db-4b9e-8e4f-2ce44a1287fd tempest-SnapshotsActionsTest-1398629393 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:22:53 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-664aff55-63db-4b9e-8e4f-2ce44a1287fd tempest-SnapshotsActionsTest-1398629393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:22:53 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-664aff55-63db-4b9e-8e4f-2ce44a1287fd tempest-SnapshotsActionsTest-1398629393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1abe9c2-7505-4e37-b428-cc39941fa9dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:22:53 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-664aff55-63db-4b9e-8e4f-2ce44a1287fd tempest-SnapshotsActionsTest-1398629393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f0251e0-c1f9-446a-9817-87f525d97ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:22:53 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-664aff55-63db-4b9e-8e4f-2ce44a1287fd tempest-SnapshotsActionsTest-1398629393 None] Volume volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7 (89c76f9a-ea2a-4b26-9f56-e8380054a2f7): created successfully Sep 28 09:22:53 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-664aff55-63db-4b9e-8e4f-2ce44a1287fd tempest-SnapshotsActionsTest-1398629393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f0251e0-c1f9-446a-9817-87f525d97ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:22:53 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-664aff55-63db-4b9e-8e4f-2ce44a1287fd tempest-SnapshotsActionsTest-1398629393 None] Flow 'volume_create_manager' (9d8fd1a3-46d7-4e4b-b9e7-51882c245ee9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:22:54 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-664aff55-63db-4b9e-8e4f-2ce44a1287fd tempest-SnapshotsActionsTest-1398629393 None] Created volume successfully. Sep 28 09:22:55 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-a24c25be-bd81-4a26-a495-578bdc806404 tempest-SnapshotsActionsTest-1398629393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:22:55 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-a24c25be-bd81-4a26-a495-578bdc806404 tempest-SnapshotsActionsTest-1398629393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:22:55 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-a24c25be-bd81-4a26-a495-578bdc806404 tempest-SnapshotsActionsTest-1398629393 None] Creating offline snapshot 11288f3b-2fa9-4d2a-932b-69c2280e6512 of volume 89c76f9a-ea2a-4b26-9f56-e8380054a2f7 {{(pid=86553) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 09:22:55 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[3daa85cf-8318-4cb3-ad40-7d1b6699d071]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:22:55 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a24c25be-bd81-4a26-a495-578bdc806404 tempest-SnapshotsActionsTest-1398629393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:22:55 devstack sudo[87855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7 Sep 28 09:22:55 devstack sudo[87855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:22:55 devstack sudo[87855]: pam_unix(sudo:session): session closed for user root Sep 28 09:22:55 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a24c25be-bd81-4a26-a495-578bdc806404 tempest-SnapshotsActionsTest-1398629393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7" returned: 0 in 0.517s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:22:55 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a24c25be-bd81-4a26-a495-578bdc806404 tempest-SnapshotsActionsTest-1398629393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.11288f3b-2fa9-4d2a-932b-69c2280e6512 1G {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:22:55 devstack sudo[87862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.11288f3b-2fa9-4d2a-932b-69c2280e6512 1G Sep 28 09:22:55 devstack sudo[87862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:22:56 devstack sudo[87862]: pam_unix(sudo:session): session closed for user root Sep 28 09:22:56 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a24c25be-bd81-4a26-a495-578bdc806404 tempest-SnapshotsActionsTest-1398629393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.11288f3b-2fa9-4d2a-932b-69c2280e6512 1G" returned: 0 in 0.574s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:22:56 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a24c25be-bd81-4a26-a495-578bdc806404 tempest-SnapshotsActionsTest-1398629393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7 -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.11288f3b-2fa9-4d2a-932b-69c2280e6512 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:22:56 devstack sudo[87868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7 -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.11288f3b-2fa9-4d2a-932b-69c2280e6512 Sep 28 09:22:56 devstack sudo[87868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:22:56 devstack sudo[87868]: pam_unix(sudo:session): session closed for user root Sep 28 09:22:56 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a24c25be-bd81-4a26-a495-578bdc806404 tempest-SnapshotsActionsTest-1398629393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7 -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.11288f3b-2fa9-4d2a-932b-69c2280e6512" returned: 0 in 0.427s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:22:56 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-a24c25be-bd81-4a26-a495-578bdc806404 tempest-SnapshotsActionsTest-1398629393 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.11288f3b-2fa9-4d2a-932b-69c2280e6512 is being set with open permissions: ugo+rw Sep 28 09:22:56 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a24c25be-bd81-4a26-a495-578bdc806404 tempest-SnapshotsActionsTest-1398629393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.11288f3b-2fa9-4d2a-932b-69c2280e6512 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:22:56 devstack sudo[87874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.11288f3b-2fa9-4d2a-932b-69c2280e6512 Sep 28 09:22:56 devstack sudo[87874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:22:57 devstack sudo[87874]: pam_unix(sudo:session): session closed for user root Sep 28 09:22:57 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a24c25be-bd81-4a26-a495-578bdc806404 tempest-SnapshotsActionsTest-1398629393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.11288f3b-2fa9-4d2a-932b-69c2280e6512" returned: 0 in 0.392s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:22:57 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a24c25be-bd81-4a26-a495-578bdc806404 tempest-SnapshotsActionsTest-1398629393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.info {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:22:57 devstack sudo[87877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.info Sep 28 09:22:57 devstack sudo[87877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:22:57 devstack sudo[87877]: pam_unix(sudo:session): session closed for user root Sep 28 09:22:57 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a24c25be-bd81-4a26-a495-578bdc806404 tempest-SnapshotsActionsTest-1398629393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.info" returned: 0 in 0.345s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:22:57 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-a24c25be-bd81-4a26-a495-578bdc806404 tempest-SnapshotsActionsTest-1398629393 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.info is being set with open permissions: ugo+rw Sep 28 09:22:57 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a24c25be-bd81-4a26-a495-578bdc806404 tempest-SnapshotsActionsTest-1398629393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.info {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:22:57 devstack sudo[87880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.info Sep 28 09:22:57 devstack sudo[87880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:22:58 devstack sudo[87880]: pam_unix(sudo:session): session closed for user root Sep 28 09:22:58 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a24c25be-bd81-4a26-a495-578bdc806404 tempest-SnapshotsActionsTest-1398629393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.info" returned: 0 in 0.301s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:22:58 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-a24c25be-bd81-4a26-a495-578bdc806404 tempest-SnapshotsActionsTest-1398629393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.724s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:22:58 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-a24c25be-bd81-4a26-a495-578bdc806404 tempest-SnapshotsActionsTest-1398629393 None] Create snapshot completed successfully Sep 28 09:22:59 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-d54ccd2c-0de2-493e-b64b-ae3f164a238c tempest-SnapshotsActionsTest-1398629393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:22:59 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-d54ccd2c-0de2-493e-b64b-ae3f164a238c tempest-SnapshotsActionsTest-1398629393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:22:59 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-d54ccd2c-0de2-493e-b64b-ae3f164a238c tempest-SnapshotsActionsTest-1398629393 None] Creating offline snapshot 5cee658e-4341-4aeb-887f-13b1ac71706d of volume 89c76f9a-ea2a-4b26-9f56-e8380054a2f7 {{(pid=86553) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 09:22:59 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee89f164-0f32-47a8-a486-8d4a60dd4d13]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:22:59 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-d54ccd2c-0de2-493e-b64b-ae3f164a238c tempest-SnapshotsActionsTest-1398629393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.11288f3b-2fa9-4d2a-932b-69c2280e6512 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:22:59 devstack sudo[87886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.11288f3b-2fa9-4d2a-932b-69c2280e6512 Sep 28 09:22:59 devstack sudo[87886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:23:00 devstack sudo[87886]: pam_unix(sudo:session): session closed for user root Sep 28 09:23:00 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-d54ccd2c-0de2-493e-b64b-ae3f164a238c tempest-SnapshotsActionsTest-1398629393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.11288f3b-2fa9-4d2a-932b-69c2280e6512" returned: 0 in 0.788s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:23:00 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-d54ccd2c-0de2-493e-b64b-ae3f164a238c tempest-SnapshotsActionsTest-1398629393 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86553) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 09:23:00 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-d54ccd2c-0de2-493e-b64b-ae3f164a238c tempest-SnapshotsActionsTest-1398629393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.11288f3b-2fa9-4d2a-932b-69c2280e6512,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.5cee658e-4341-4aeb-887f-13b1ac71706d 1G {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:23:00 devstack sudo[87908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.11288f3b-2fa9-4d2a-932b-69c2280e6512,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.5cee658e-4341-4aeb-887f-13b1ac71706d 1G Sep 28 09:23:00 devstack sudo[87908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:23:01 devstack sudo[87908]: pam_unix(sudo:session): session closed for user root Sep 28 09:23:01 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-d54ccd2c-0de2-493e-b64b-ae3f164a238c tempest-SnapshotsActionsTest-1398629393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.11288f3b-2fa9-4d2a-932b-69c2280e6512,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.5cee658e-4341-4aeb-887f-13b1ac71706d 1G" returned: 0 in 1.124s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:23:01 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-d54ccd2c-0de2-493e-b64b-ae3f164a238c tempest-SnapshotsActionsTest-1398629393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.11288f3b-2fa9-4d2a-932b-69c2280e6512 -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.5cee658e-4341-4aeb-887f-13b1ac71706d {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:23:01 devstack sudo[87983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.11288f3b-2fa9-4d2a-932b-69c2280e6512 -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.5cee658e-4341-4aeb-887f-13b1ac71706d Sep 28 09:23:01 devstack sudo[87983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:23:02 devstack sudo[87983]: pam_unix(sudo:session): session closed for user root Sep 28 09:23:02 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-d54ccd2c-0de2-493e-b64b-ae3f164a238c tempest-SnapshotsActionsTest-1398629393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.11288f3b-2fa9-4d2a-932b-69c2280e6512 -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.5cee658e-4341-4aeb-887f-13b1ac71706d" returned: 0 in 0.484s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:23:02 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-d54ccd2c-0de2-493e-b64b-ae3f164a238c tempest-SnapshotsActionsTest-1398629393 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.5cee658e-4341-4aeb-887f-13b1ac71706d is being set with open permissions: ugo+rw Sep 28 09:23:02 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-d54ccd2c-0de2-493e-b64b-ae3f164a238c tempest-SnapshotsActionsTest-1398629393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.5cee658e-4341-4aeb-887f-13b1ac71706d {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:23:02 devstack sudo[87995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.5cee658e-4341-4aeb-887f-13b1ac71706d Sep 28 09:23:02 devstack sudo[87995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:23:02 devstack sudo[87995]: pam_unix(sudo:session): session closed for user root Sep 28 09:23:02 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-d54ccd2c-0de2-493e-b64b-ae3f164a238c tempest-SnapshotsActionsTest-1398629393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.5cee658e-4341-4aeb-887f-13b1ac71706d" returned: 0 in 0.360s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:23:02 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-d54ccd2c-0de2-493e-b64b-ae3f164a238c tempest-SnapshotsActionsTest-1398629393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.913s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:23:02 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-d54ccd2c-0de2-493e-b64b-ae3f164a238c tempest-SnapshotsActionsTest-1398629393 None] Create snapshot completed successfully Sep 28 09:23:03 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-77b595c8-f1fa-4058-9817-b13e30de15d2 tempest-SnapshotsActionsTest-639939201 None] Acquiring lock "cinder-5cee658e-4341-4aeb-887f-13b1ac71706d-delete_snapshot" by "delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:23:03 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-77b595c8-f1fa-4058-9817-b13e30de15d2 tempest-SnapshotsActionsTest-639939201 None] Lock "cinder-5cee658e-4341-4aeb-887f-13b1ac71706d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:23:03 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-77b595c8-f1fa-4058-9817-b13e30de15d2 tempest-SnapshotsActionsTest-639939201 None] Acquiring lock "cinder-quobyte-89c76f9a-ea2a-4b26-9f56-e8380054a2f7" by "delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:23:03 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-77b595c8-f1fa-4058-9817-b13e30de15d2 tempest-SnapshotsActionsTest-639939201 None] Lock "cinder-quobyte-89c76f9a-ea2a-4b26-9f56-e8380054a2f7" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:23:03 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-77b595c8-f1fa-4058-9817-b13e30de15d2 tempest-SnapshotsActionsTest-639939201 None] Acquiring lock "cinder-quobyte-5cee658e-4341-4aeb-887f-13b1ac71706d" by "_delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:23:03 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-77b595c8-f1fa-4058-9817-b13e30de15d2 tempest-SnapshotsActionsTest-639939201 None] Lock "cinder-quobyte-5cee658e-4341-4aeb-887f-13b1ac71706d" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:23:03 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-77b595c8-f1fa-4058-9817-b13e30de15d2 tempest-SnapshotsActionsTest-639939201 None] Deleting offline snapshot 5cee658e-4341-4aeb-887f-13b1ac71706d of volume 89c76f9a-ea2a-4b26-9f56-e8380054a2f7 {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 09:23:03 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-77b595c8-f1fa-4058-9817-b13e30de15d2 tempest-SnapshotsActionsTest-639939201 None] snapshot_file for this snap is: volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.5cee658e-4341-4aeb-887f-13b1ac71706d {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 09:23:03 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[8233795e-7a95-47e9-9ae5-f75b59f3c474]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:23:03 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-77b595c8-f1fa-4058-9817-b13e30de15d2 tempest-SnapshotsActionsTest-639939201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.5cee658e-4341-4aeb-887f-13b1ac71706d {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:23:03 devstack sudo[88006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.5cee658e-4341-4aeb-887f-13b1ac71706d Sep 28 09:23:03 devstack sudo[88006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:23:03 devstack sudo[88006]: pam_unix(sudo:session): session closed for user root Sep 28 09:23:03 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-77b595c8-f1fa-4058-9817-b13e30de15d2 tempest-SnapshotsActionsTest-639939201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.5cee658e-4341-4aeb-887f-13b1ac71706d" returned: 0 in 0.519s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:23:03 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-77b595c8-f1fa-4058-9817-b13e30de15d2 tempest-SnapshotsActionsTest-639939201 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86553) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 09:23:03 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[f421a36f-d711-4b0f-aa72-63fce8d89079]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:23:03 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-77b595c8-f1fa-4058-9817-b13e30de15d2 tempest-SnapshotsActionsTest-639939201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.11288f3b-2fa9-4d2a-932b-69c2280e6512 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:23:03 devstack sudo[88016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.11288f3b-2fa9-4d2a-932b-69c2280e6512 Sep 28 09:23:03 devstack sudo[88016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:23:04 devstack sudo[88016]: pam_unix(sudo:session): session closed for user root Sep 28 09:23:04 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-77b595c8-f1fa-4058-9817-b13e30de15d2 tempest-SnapshotsActionsTest-639939201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.11288f3b-2fa9-4d2a-932b-69c2280e6512" returned: 0 in 0.417s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:23:04 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-77b595c8-f1fa-4058-9817-b13e30de15d2 tempest-SnapshotsActionsTest-639939201 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86553) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 09:23:04 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-77b595c8-f1fa-4058-9817-b13e30de15d2 tempest-SnapshotsActionsTest-639939201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.5cee658e-4341-4aeb-887f-13b1ac71706d {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:23:04 devstack sudo[88021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.5cee658e-4341-4aeb-887f-13b1ac71706d Sep 28 09:23:04 devstack sudo[88021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:23:04 devstack sudo[88021]: pam_unix(sudo:session): session closed for user root Sep 28 09:23:04 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-77b595c8-f1fa-4058-9817-b13e30de15d2 tempest-SnapshotsActionsTest-639939201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.5cee658e-4341-4aeb-887f-13b1ac71706d" returned: 0 in 0.428s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:23:04 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-77b595c8-f1fa-4058-9817-b13e30de15d2 tempest-SnapshotsActionsTest-639939201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.5cee658e-4341-4aeb-887f-13b1ac71706d {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:23:04 devstack sudo[88029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.5cee658e-4341-4aeb-887f-13b1ac71706d Sep 28 09:23:04 devstack sudo[88029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:23:04 devstack sudo[88029]: pam_unix(sudo:session): session closed for user root Sep 28 09:23:04 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-77b595c8-f1fa-4058-9817-b13e30de15d2 tempest-SnapshotsActionsTest-639939201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.5cee658e-4341-4aeb-887f-13b1ac71706d" returned: 0 in 0.259s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:23:05 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-77b595c8-f1fa-4058-9817-b13e30de15d2 tempest-SnapshotsActionsTest-639939201 None] Lock "cinder-quobyte-5cee658e-4341-4aeb-887f-13b1ac71706d" released by "_delete_snapshot" :: held 1.808s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:23:05 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-77b595c8-f1fa-4058-9817-b13e30de15d2 tempest-SnapshotsActionsTest-639939201 None] Lock "cinder-quobyte-89c76f9a-ea2a-4b26-9f56-e8380054a2f7" released by "delete_snapshot" :: held 1.845s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:23:05 devstack cinder-volume[86553]: WARNING cinder.quota [None req-77b595c8-f1fa-4058-9817-b13e30de15d2 tempest-SnapshotsActionsTest-639939201 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 28 09:23:05 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-77b595c8-f1fa-4058-9817-b13e30de15d2 tempest-SnapshotsActionsTest-639939201 None] Created reservations ['e98fc101-10d7-42ba-9e1a-e700cf9bc9fb', '6d77931a-887f-466c-a54e-be3c580f906f', '700cb448-9802-487f-8af4-7ca61b91a9df', '5caa9bcd-8a24-4b76-a651-24932eed1acf'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:23:05 devstack cinder-volume[86553]: WARNING py.warnings [req-e708ba4d-1ac5-4653-b1e8-cb9f4579c2ee req-67e56b11-6ff3-454c-99e9-bab26b7a5c25 tempest-TaggedAttachmentsTest-1637253403 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Sep 28 09:23:05 devstack cinder-volume[86553]: .first() Sep 28 09:23:05 devstack cinder-volume[86553]: Sep 28 09:23:05 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-e708ba4d-1ac5-4653-b1e8-cb9f4579c2ee req-67e56b11-6ff3-454c-99e9-bab26b7a5c25 tempest-TaggedAttachmentsTest-1637253403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:23:05 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-e708ba4d-1ac5-4653-b1e8-cb9f4579c2ee req-67e56b11-6ff3-454c-99e9-bab26b7a5c25 tempest-TaggedAttachmentsTest-1637253403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:23:05 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-e708ba4d-1ac5-4653-b1e8-cb9f4579c2ee req-67e56b11-6ff3-454c-99e9-bab26b7a5c25 tempest-TaggedAttachmentsTest-1637253403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:23:05 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-77b595c8-f1fa-4058-9817-b13e30de15d2 tempest-SnapshotsActionsTest-639939201 None] Delete snapshot completed successfully. Sep 28 09:23:05 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-77b595c8-f1fa-4058-9817-b13e30de15d2 tempest-SnapshotsActionsTest-639939201 None] Lock "cinder-5cee658e-4341-4aeb-887f-13b1ac71706d-delete_snapshot" released by "delete_snapshot" :: held 2.130s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:23:05 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [req-e708ba4d-1ac5-4653-b1e8-cb9f4579c2ee req-67e56b11-6ff3-454c-99e9-bab26b7a5c25 tempest-TaggedAttachmentsTest-1637253403 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d', 'name': 'volume-7ebfe33d-3afd-419d-abbb-5da85e3a3bb4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a4fb072d-b325-4d05-b3b0-ac90a7163cd7', 'enforce_multipath': True} {{(pid=86553) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 09:23:05 devstack cinder-volume[86553]: INFO cinder.volume.manager [req-e708ba4d-1ac5-4653-b1e8-cb9f4579c2ee req-67e56b11-6ff3-454c-99e9-bab26b7a5c25 tempest-TaggedAttachmentsTest-1637253403 None] attachment_update completed successfully. Sep 28 09:23:05 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-c62fb05a-1c22-4b0d-b1c8-d82bab87414c tempest-SnapshotsActionsTest-1398629393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:23:05 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-c62fb05a-1c22-4b0d-b1c8-d82bab87414c tempest-SnapshotsActionsTest-1398629393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:23:05 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-c62fb05a-1c22-4b0d-b1c8-d82bab87414c tempest-SnapshotsActionsTest-1398629393 None] Creating offline snapshot 0f0294fe-f1cf-40db-b5bb-f5b3ab1f228f of volume 89c76f9a-ea2a-4b26-9f56-e8380054a2f7 {{(pid=86553) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 09:23:05 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[90300ac8-fb42-4091-99fc-a2b99e360a30]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:23:05 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c62fb05a-1c22-4b0d-b1c8-d82bab87414c tempest-SnapshotsActionsTest-1398629393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.11288f3b-2fa9-4d2a-932b-69c2280e6512 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:23:05 devstack sudo[88067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.11288f3b-2fa9-4d2a-932b-69c2280e6512 Sep 28 09:23:05 devstack sudo[88067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:23:06 devstack sudo[88067]: pam_unix(sudo:session): session closed for user root Sep 28 09:23:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c62fb05a-1c22-4b0d-b1c8-d82bab87414c tempest-SnapshotsActionsTest-1398629393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.11288f3b-2fa9-4d2a-932b-69c2280e6512" returned: 0 in 0.499s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:23:06 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-c62fb05a-1c22-4b0d-b1c8-d82bab87414c tempest-SnapshotsActionsTest-1398629393 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86553) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 09:23:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c62fb05a-1c22-4b0d-b1c8-d82bab87414c tempest-SnapshotsActionsTest-1398629393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.11288f3b-2fa9-4d2a-932b-69c2280e6512,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.0f0294fe-f1cf-40db-b5bb-f5b3ab1f228f 1G {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:23:06 devstack sudo[88462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.11288f3b-2fa9-4d2a-932b-69c2280e6512,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.0f0294fe-f1cf-40db-b5bb-f5b3ab1f228f 1G Sep 28 09:23:06 devstack sudo[88462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:23:06 devstack sudo[88462]: pam_unix(sudo:session): session closed for user root Sep 28 09:23:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c62fb05a-1c22-4b0d-b1c8-d82bab87414c tempest-SnapshotsActionsTest-1398629393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.11288f3b-2fa9-4d2a-932b-69c2280e6512,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.0f0294fe-f1cf-40db-b5bb-f5b3ab1f228f 1G" returned: 0 in 0.735s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:23:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c62fb05a-1c22-4b0d-b1c8-d82bab87414c tempest-SnapshotsActionsTest-1398629393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.11288f3b-2fa9-4d2a-932b-69c2280e6512 -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.0f0294fe-f1cf-40db-b5bb-f5b3ab1f228f {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:23:07 devstack sudo[88474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.11288f3b-2fa9-4d2a-932b-69c2280e6512 -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.0f0294fe-f1cf-40db-b5bb-f5b3ab1f228f Sep 28 09:23:07 devstack sudo[88474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:23:07 devstack sudo[88474]: pam_unix(sudo:session): session closed for user root Sep 28 09:23:07 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c62fb05a-1c22-4b0d-b1c8-d82bab87414c tempest-SnapshotsActionsTest-1398629393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.11288f3b-2fa9-4d2a-932b-69c2280e6512 -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.0f0294fe-f1cf-40db-b5bb-f5b3ab1f228f" returned: 0 in 0.435s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:23:07 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-c62fb05a-1c22-4b0d-b1c8-d82bab87414c tempest-SnapshotsActionsTest-1398629393 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.0f0294fe-f1cf-40db-b5bb-f5b3ab1f228f is being set with open permissions: ugo+rw Sep 28 09:23:07 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c62fb05a-1c22-4b0d-b1c8-d82bab87414c tempest-SnapshotsActionsTest-1398629393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.0f0294fe-f1cf-40db-b5bb-f5b3ab1f228f {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:23:07 devstack sudo[88497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.0f0294fe-f1cf-40db-b5bb-f5b3ab1f228f Sep 28 09:23:07 devstack sudo[88497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:23:07 devstack sudo[88497]: pam_unix(sudo:session): session closed for user root Sep 28 09:23:07 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c62fb05a-1c22-4b0d-b1c8-d82bab87414c tempest-SnapshotsActionsTest-1398629393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.0f0294fe-f1cf-40db-b5bb-f5b3ab1f228f" returned: 0 in 0.519s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:23:08 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-c62fb05a-1c22-4b0d-b1c8-d82bab87414c tempest-SnapshotsActionsTest-1398629393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.365s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:23:08 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-c62fb05a-1c22-4b0d-b1c8-d82bab87414c tempest-SnapshotsActionsTest-1398629393 None] Create snapshot completed successfully Sep 28 09:23:09 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-cc6908b6-8643-486f-8315-3cbdb99725eb tempest-SnapshotsActionsTest-639939201 None] Acquiring lock "cinder-0f0294fe-f1cf-40db-b5bb-f5b3ab1f228f-delete_snapshot" by "delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:23:09 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-cc6908b6-8643-486f-8315-3cbdb99725eb tempest-SnapshotsActionsTest-639939201 None] Lock "cinder-0f0294fe-f1cf-40db-b5bb-f5b3ab1f228f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:23:09 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-cc6908b6-8643-486f-8315-3cbdb99725eb tempest-SnapshotsActionsTest-639939201 None] Acquiring lock "cinder-quobyte-89c76f9a-ea2a-4b26-9f56-e8380054a2f7" by "delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:23:09 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-cc6908b6-8643-486f-8315-3cbdb99725eb tempest-SnapshotsActionsTest-639939201 None] Lock "cinder-quobyte-89c76f9a-ea2a-4b26-9f56-e8380054a2f7" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:23:09 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-cc6908b6-8643-486f-8315-3cbdb99725eb tempest-SnapshotsActionsTest-639939201 None] Acquiring lock "cinder-quobyte-0f0294fe-f1cf-40db-b5bb-f5b3ab1f228f" by "_delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:23:09 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-cc6908b6-8643-486f-8315-3cbdb99725eb tempest-SnapshotsActionsTest-639939201 None] Lock "cinder-quobyte-0f0294fe-f1cf-40db-b5bb-f5b3ab1f228f" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:23:09 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-cc6908b6-8643-486f-8315-3cbdb99725eb tempest-SnapshotsActionsTest-639939201 None] Deleting offline snapshot 0f0294fe-f1cf-40db-b5bb-f5b3ab1f228f of volume 89c76f9a-ea2a-4b26-9f56-e8380054a2f7 {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 09:23:09 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-cc6908b6-8643-486f-8315-3cbdb99725eb tempest-SnapshotsActionsTest-639939201 None] snapshot_file for this snap is: volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.0f0294fe-f1cf-40db-b5bb-f5b3ab1f228f {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 09:23:09 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[224ba36b-1621-46e2-8a72-ce9ecf61500b]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:23:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-cc6908b6-8643-486f-8315-3cbdb99725eb tempest-SnapshotsActionsTest-639939201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.0f0294fe-f1cf-40db-b5bb-f5b3ab1f228f {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:23:09 devstack sudo[88550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.0f0294fe-f1cf-40db-b5bb-f5b3ab1f228f Sep 28 09:23:09 devstack sudo[88550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:23:09 devstack cinder-volume[86553]: INFO cinder.volume.manager [req-80d26a29-c314-4c67-bcee-e72e50a4d716 req-1ff10729-63c8-40b8-91f6-d0fc3a63be61 tempest-TaggedAttachmentsTest-1637253403 None] Terminate volume connection completed successfully. Sep 28 09:23:09 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [req-80d26a29-c314-4c67-bcee-e72e50a4d716 req-1ff10729-63c8-40b8-91f6-d0fc3a63be61 tempest-TaggedAttachmentsTest-1637253403 None] Deleting attachment a4fb072d-b325-4d05-b3b0-ac90a7163cd7. {{(pid=86553) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 09:23:09 devstack sudo[88550]: pam_unix(sudo:session): session closed for user root Sep 28 09:23:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-cc6908b6-8643-486f-8315-3cbdb99725eb tempest-SnapshotsActionsTest-639939201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.0f0294fe-f1cf-40db-b5bb-f5b3ab1f228f" returned: 0 in 0.515s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:23:09 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-cc6908b6-8643-486f-8315-3cbdb99725eb tempest-SnapshotsActionsTest-639939201 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86553) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 09:23:09 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[f41d2fe6-01dc-470c-b56b-441fbc50f094]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:23:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-cc6908b6-8643-486f-8315-3cbdb99725eb tempest-SnapshotsActionsTest-639939201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.11288f3b-2fa9-4d2a-932b-69c2280e6512 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:23:09 devstack sudo[88590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.11288f3b-2fa9-4d2a-932b-69c2280e6512 Sep 28 09:23:09 devstack sudo[88590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:23:10 devstack sudo[88590]: pam_unix(sudo:session): session closed for user root Sep 28 09:23:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-cc6908b6-8643-486f-8315-3cbdb99725eb tempest-SnapshotsActionsTest-639939201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.11288f3b-2fa9-4d2a-932b-69c2280e6512" returned: 0 in 0.612s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:23:10 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-cc6908b6-8643-486f-8315-3cbdb99725eb tempest-SnapshotsActionsTest-639939201 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86553) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 09:23:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-cc6908b6-8643-486f-8315-3cbdb99725eb tempest-SnapshotsActionsTest-639939201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.0f0294fe-f1cf-40db-b5bb-f5b3ab1f228f {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:23:10 devstack sudo[88598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.0f0294fe-f1cf-40db-b5bb-f5b3ab1f228f Sep 28 09:23:10 devstack sudo[88598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:23:11 devstack sudo[88598]: pam_unix(sudo:session): session closed for user root Sep 28 09:23:11 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-cc6908b6-8643-486f-8315-3cbdb99725eb tempest-SnapshotsActionsTest-639939201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.0f0294fe-f1cf-40db-b5bb-f5b3ab1f228f" returned: 0 in 0.723s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:23:11 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-cc6908b6-8643-486f-8315-3cbdb99725eb tempest-SnapshotsActionsTest-639939201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.0f0294fe-f1cf-40db-b5bb-f5b3ab1f228f {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:23:11 devstack sudo[88620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.0f0294fe-f1cf-40db-b5bb-f5b3ab1f228f Sep 28 09:23:11 devstack sudo[88620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:23:11 devstack sudo[88620]: pam_unix(sudo:session): session closed for user root Sep 28 09:23:11 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-cc6908b6-8643-486f-8315-3cbdb99725eb tempest-SnapshotsActionsTest-639939201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.0f0294fe-f1cf-40db-b5bb-f5b3ab1f228f" returned: 0 in 0.348s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:23:11 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-cc6908b6-8643-486f-8315-3cbdb99725eb tempest-SnapshotsActionsTest-639939201 None] Lock "cinder-quobyte-0f0294fe-f1cf-40db-b5bb-f5b3ab1f228f" released by "_delete_snapshot" :: held 2.368s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:23:11 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-cc6908b6-8643-486f-8315-3cbdb99725eb tempest-SnapshotsActionsTest-639939201 None] Lock "cinder-quobyte-89c76f9a-ea2a-4b26-9f56-e8380054a2f7" released by "delete_snapshot" :: held 2.396s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:23:11 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-cc6908b6-8643-486f-8315-3cbdb99725eb tempest-SnapshotsActionsTest-639939201 None] Created reservations ['471eabd2-9afc-4397-b3ef-91a0b77ab475', 'ea02280f-b9f5-4ad6-b3e3-bb04f3fd1d01', '8b1cfa1d-745d-48f7-a6ba-67c4bf3cdee4', '538f2711-ccfc-49af-bf22-4faa626c09aa'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:23:11 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-cc6908b6-8643-486f-8315-3cbdb99725eb tempest-SnapshotsActionsTest-639939201 None] Delete snapshot completed successfully. Sep 28 09:23:11 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-cc6908b6-8643-486f-8315-3cbdb99725eb tempest-SnapshotsActionsTest-639939201 None] Lock "cinder-0f0294fe-f1cf-40db-b5bb-f5b3ab1f228f-delete_snapshot" released by "delete_snapshot" :: held 2.671s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:23:12 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-0db39b6a-ce4c-4066-89df-503adb283123 tempest-SnapshotsActionsTest-1398629393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:23:12 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-0db39b6a-ce4c-4066-89df-503adb283123 tempest-SnapshotsActionsTest-1398629393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:23:12 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-0db39b6a-ce4c-4066-89df-503adb283123 tempest-SnapshotsActionsTest-1398629393 None] Creating offline snapshot 2429f833-6b55-4343-a057-000ef42f47b4 of volume 89c76f9a-ea2a-4b26-9f56-e8380054a2f7 {{(pid=86553) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 09:23:12 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8dfb4a4-3ff3-4b02-9853-b5c1eef3cb84]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:23:12 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0db39b6a-ce4c-4066-89df-503adb283123 tempest-SnapshotsActionsTest-1398629393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.11288f3b-2fa9-4d2a-932b-69c2280e6512 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:23:13 devstack sudo[88652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.11288f3b-2fa9-4d2a-932b-69c2280e6512 Sep 28 09:23:13 devstack sudo[88652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:23:13 devstack sudo[88652]: pam_unix(sudo:session): session closed for user root Sep 28 09:23:13 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0db39b6a-ce4c-4066-89df-503adb283123 tempest-SnapshotsActionsTest-1398629393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.11288f3b-2fa9-4d2a-932b-69c2280e6512" returned: 0 in 0.487s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:23:13 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-0db39b6a-ce4c-4066-89df-503adb283123 tempest-SnapshotsActionsTest-1398629393 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86553) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 09:23:13 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0db39b6a-ce4c-4066-89df-503adb283123 tempest-SnapshotsActionsTest-1398629393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.11288f3b-2fa9-4d2a-932b-69c2280e6512,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.2429f833-6b55-4343-a057-000ef42f47b4 1G {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:23:13 devstack sudo[88661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.11288f3b-2fa9-4d2a-932b-69c2280e6512,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.2429f833-6b55-4343-a057-000ef42f47b4 1G Sep 28 09:23:13 devstack sudo[88661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:23:13 devstack sudo[88661]: pam_unix(sudo:session): session closed for user root Sep 28 09:23:13 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0db39b6a-ce4c-4066-89df-503adb283123 tempest-SnapshotsActionsTest-1398629393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.11288f3b-2fa9-4d2a-932b-69c2280e6512,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.2429f833-6b55-4343-a057-000ef42f47b4 1G" returned: 0 in 0.619s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:23:13 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0db39b6a-ce4c-4066-89df-503adb283123 tempest-SnapshotsActionsTest-1398629393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.11288f3b-2fa9-4d2a-932b-69c2280e6512 -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.2429f833-6b55-4343-a057-000ef42f47b4 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:23:14 devstack sudo[88677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.11288f3b-2fa9-4d2a-932b-69c2280e6512 -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.2429f833-6b55-4343-a057-000ef42f47b4 Sep 28 09:23:14 devstack sudo[88677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:23:14 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-0e798922-8613-4fbc-bd3c-20821f7d6557 req-799e96eb-5f70-4b4b-b5b7-ee867e7a8b58 tempest-ServerActionsTestOtherA-711372344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:23:14 devstack sudo[88677]: pam_unix(sudo:session): session closed for user root Sep 28 09:23:14 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0db39b6a-ce4c-4066-89df-503adb283123 tempest-SnapshotsActionsTest-1398629393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.11288f3b-2fa9-4d2a-932b-69c2280e6512 -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.2429f833-6b55-4343-a057-000ef42f47b4" returned: 0 in 0.365s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:23:14 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-0db39b6a-ce4c-4066-89df-503adb283123 tempest-SnapshotsActionsTest-1398629393 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.2429f833-6b55-4343-a057-000ef42f47b4 is being set with open permissions: ugo+rw Sep 28 09:23:14 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0db39b6a-ce4c-4066-89df-503adb283123 tempest-SnapshotsActionsTest-1398629393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.2429f833-6b55-4343-a057-000ef42f47b4 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:23:14 devstack sudo[88682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.2429f833-6b55-4343-a057-000ef42f47b4 Sep 28 09:23:14 devstack sudo[88682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:23:14 devstack sudo[88682]: pam_unix(sudo:session): session closed for user root Sep 28 09:23:14 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0db39b6a-ce4c-4066-89df-503adb283123 tempest-SnapshotsActionsTest-1398629393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.2429f833-6b55-4343-a057-000ef42f47b4" returned: 0 in 0.273s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:23:14 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-0db39b6a-ce4c-4066-89df-503adb283123 tempest-SnapshotsActionsTest-1398629393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.867s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:23:14 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-0e798922-8613-4fbc-bd3c-20821f7d6557 req-799e96eb-5f70-4b4b-b5b7-ee867e7a8b58 tempest-ServerActionsTestOtherA-711372344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.628s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:23:14 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-0e798922-8613-4fbc-bd3c-20821f7d6557 req-799e96eb-5f70-4b4b-b5b7-ee867e7a8b58 tempest-ServerActionsTestOtherA-711372344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:23:14 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-0db39b6a-ce4c-4066-89df-503adb283123 tempest-SnapshotsActionsTest-1398629393 None] Create snapshot completed successfully Sep 28 09:23:14 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [req-0e798922-8613-4fbc-bd3c-20821f7d6557 req-799e96eb-5f70-4b4b-b5b7-ee867e7a8b58 tempest-ServerActionsTestOtherA-711372344 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d', 'name': 'volume-06c42fcd-9687-401a-95f2-bcd257ff5ec8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0a74e2b5-339f-4ef7-aa90-125e35bd0f09', 'enforce_multipath': True} {{(pid=86553) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 09:23:14 devstack cinder-volume[86553]: INFO cinder.volume.manager [req-0e798922-8613-4fbc-bd3c-20821f7d6557 req-799e96eb-5f70-4b4b-b5b7-ee867e7a8b58 tempest-ServerActionsTestOtherA-711372344 None] attachment_update completed successfully. Sep 28 09:23:15 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-0314c1ff-2d5d-4286-93ea-6686c640c5a0 tempest-SnapshotsActionsTest-639939201 None] Acquiring lock "cinder-2429f833-6b55-4343-a057-000ef42f47b4-delete_snapshot" by "delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:23:15 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-0314c1ff-2d5d-4286-93ea-6686c640c5a0 tempest-SnapshotsActionsTest-639939201 None] Lock "cinder-2429f833-6b55-4343-a057-000ef42f47b4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:23:15 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-0314c1ff-2d5d-4286-93ea-6686c640c5a0 tempest-SnapshotsActionsTest-639939201 None] Acquiring lock "cinder-quobyte-89c76f9a-ea2a-4b26-9f56-e8380054a2f7" by "delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:23:15 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-0314c1ff-2d5d-4286-93ea-6686c640c5a0 tempest-SnapshotsActionsTest-639939201 None] Lock "cinder-quobyte-89c76f9a-ea2a-4b26-9f56-e8380054a2f7" acquired by "delete_snapshot" :: waited 0.106s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:23:15 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-0314c1ff-2d5d-4286-93ea-6686c640c5a0 tempest-SnapshotsActionsTest-639939201 None] Acquiring lock "cinder-quobyte-2429f833-6b55-4343-a057-000ef42f47b4" by "_delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:23:15 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-0314c1ff-2d5d-4286-93ea-6686c640c5a0 tempest-SnapshotsActionsTest-639939201 None] Lock "cinder-quobyte-2429f833-6b55-4343-a057-000ef42f47b4" acquired by "_delete_snapshot" :: waited 0.082s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:23:15 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-0314c1ff-2d5d-4286-93ea-6686c640c5a0 tempest-SnapshotsActionsTest-639939201 None] Deleting offline snapshot 2429f833-6b55-4343-a057-000ef42f47b4 of volume 89c76f9a-ea2a-4b26-9f56-e8380054a2f7 {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 09:23:15 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-0314c1ff-2d5d-4286-93ea-6686c640c5a0 tempest-SnapshotsActionsTest-639939201 None] snapshot_file for this snap is: volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.2429f833-6b55-4343-a057-000ef42f47b4 {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 09:23:15 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b3aaac0-b48c-455c-b08a-19a5a58edce1]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:23:15 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0314c1ff-2d5d-4286-93ea-6686c640c5a0 tempest-SnapshotsActionsTest-639939201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.2429f833-6b55-4343-a057-000ef42f47b4 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:23:15 devstack sudo[88802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.2429f833-6b55-4343-a057-000ef42f47b4 Sep 28 09:23:15 devstack sudo[88802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:23:16 devstack sudo[88802]: pam_unix(sudo:session): session closed for user root Sep 28 09:23:16 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0314c1ff-2d5d-4286-93ea-6686c640c5a0 tempest-SnapshotsActionsTest-639939201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.2429f833-6b55-4343-a057-000ef42f47b4" returned: 0 in 0.685s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:23:16 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-0314c1ff-2d5d-4286-93ea-6686c640c5a0 tempest-SnapshotsActionsTest-639939201 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86553) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 09:23:16 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f3ed01-77d3-4aef-9ba9-857d76c35cb1]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:23:16 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0314c1ff-2d5d-4286-93ea-6686c640c5a0 tempest-SnapshotsActionsTest-639939201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.11288f3b-2fa9-4d2a-932b-69c2280e6512 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:23:16 devstack sudo[89167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.11288f3b-2fa9-4d2a-932b-69c2280e6512 Sep 28 09:23:16 devstack sudo[89167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:23:17 devstack sudo[89167]: pam_unix(sudo:session): session closed for user root Sep 28 09:23:17 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0314c1ff-2d5d-4286-93ea-6686c640c5a0 tempest-SnapshotsActionsTest-639939201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.11288f3b-2fa9-4d2a-932b-69c2280e6512" returned: 0 in 0.868s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:23:17 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-0314c1ff-2d5d-4286-93ea-6686c640c5a0 tempest-SnapshotsActionsTest-639939201 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86553) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 09:23:17 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0314c1ff-2d5d-4286-93ea-6686c640c5a0 tempest-SnapshotsActionsTest-639939201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.2429f833-6b55-4343-a057-000ef42f47b4 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:23:17 devstack sudo[89196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.2429f833-6b55-4343-a057-000ef42f47b4 Sep 28 09:23:17 devstack sudo[89196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:23:17 devstack sudo[89196]: pam_unix(sudo:session): session closed for user root Sep 28 09:23:17 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0314c1ff-2d5d-4286-93ea-6686c640c5a0 tempest-SnapshotsActionsTest-639939201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.2429f833-6b55-4343-a057-000ef42f47b4" returned: 0 in 0.701s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:23:17 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0314c1ff-2d5d-4286-93ea-6686c640c5a0 tempest-SnapshotsActionsTest-639939201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.2429f833-6b55-4343-a057-000ef42f47b4 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:23:17 devstack sudo[89223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.2429f833-6b55-4343-a057-000ef42f47b4 Sep 28 09:23:17 devstack sudo[89223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:23:18 devstack sudo[89223]: pam_unix(sudo:session): session closed for user root Sep 28 09:23:18 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0314c1ff-2d5d-4286-93ea-6686c640c5a0 tempest-SnapshotsActionsTest-639939201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.2429f833-6b55-4343-a057-000ef42f47b4" returned: 0 in 0.287s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:23:18 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-0314c1ff-2d5d-4286-93ea-6686c640c5a0 tempest-SnapshotsActionsTest-639939201 None] Lock "cinder-quobyte-2429f833-6b55-4343-a057-000ef42f47b4" released by "_delete_snapshot" :: held 2.745s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:23:18 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-0314c1ff-2d5d-4286-93ea-6686c640c5a0 tempest-SnapshotsActionsTest-639939201 None] Lock "cinder-quobyte-89c76f9a-ea2a-4b26-9f56-e8380054a2f7" released by "delete_snapshot" :: held 2.849s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:23:18 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-0314c1ff-2d5d-4286-93ea-6686c640c5a0 tempest-SnapshotsActionsTest-639939201 None] Created reservations ['555ab428-4a6f-45b9-950b-24b730606e91', 'ac960665-3609-4576-aa15-0566077b8c4b', '9aea4b01-ad50-4db6-bcdb-7b8397d325dd', '065ae75c-b070-4687-810c-50680591de03'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:23:18 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-0314c1ff-2d5d-4286-93ea-6686c640c5a0 tempest-SnapshotsActionsTest-639939201 None] Delete snapshot completed successfully. Sep 28 09:23:18 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-0314c1ff-2d5d-4286-93ea-6686c640c5a0 tempest-SnapshotsActionsTest-639939201 None] Lock "cinder-2429f833-6b55-4343-a057-000ef42f47b4-delete_snapshot" released by "delete_snapshot" :: held 3.191s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:23:19 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-42b2dc60-fe12-416f-8051-8af4bc4e34ae tempest-SnapshotsActionsTest-1398629393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:23:19 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-42b2dc60-fe12-416f-8051-8af4bc4e34ae tempest-SnapshotsActionsTest-1398629393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:23:19 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-42b2dc60-fe12-416f-8051-8af4bc4e34ae tempest-SnapshotsActionsTest-1398629393 None] Creating offline snapshot 7482f6e4-4918-43be-86de-d78451988c85 of volume 89c76f9a-ea2a-4b26-9f56-e8380054a2f7 {{(pid=86553) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 09:23:19 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d5a0be-07ce-4d89-bf10-7217da5d01af]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:23:19 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-42b2dc60-fe12-416f-8051-8af4bc4e34ae tempest-SnapshotsActionsTest-1398629393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.11288f3b-2fa9-4d2a-932b-69c2280e6512 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:23:19 devstack sudo[89233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.11288f3b-2fa9-4d2a-932b-69c2280e6512 Sep 28 09:23:19 devstack sudo[89233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:23:19 devstack sudo[89233]: pam_unix(sudo:session): session closed for user root Sep 28 09:23:19 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-42b2dc60-fe12-416f-8051-8af4bc4e34ae tempest-SnapshotsActionsTest-1398629393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.11288f3b-2fa9-4d2a-932b-69c2280e6512" returned: 0 in 0.661s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:23:19 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-42b2dc60-fe12-416f-8051-8af4bc4e34ae tempest-SnapshotsActionsTest-1398629393 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86553) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 09:23:19 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-42b2dc60-fe12-416f-8051-8af4bc4e34ae tempest-SnapshotsActionsTest-1398629393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.11288f3b-2fa9-4d2a-932b-69c2280e6512,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.7482f6e4-4918-43be-86de-d78451988c85 1G {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:23:19 devstack sudo[89240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.11288f3b-2fa9-4d2a-932b-69c2280e6512,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.7482f6e4-4918-43be-86de-d78451988c85 1G Sep 28 09:23:19 devstack sudo[89240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:23:20 devstack sudo[89240]: pam_unix(sudo:session): session closed for user root Sep 28 09:23:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-42b2dc60-fe12-416f-8051-8af4bc4e34ae tempest-SnapshotsActionsTest-1398629393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.11288f3b-2fa9-4d2a-932b-69c2280e6512,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.7482f6e4-4918-43be-86de-d78451988c85 1G" returned: 0 in 0.806s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:23:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-42b2dc60-fe12-416f-8051-8af4bc4e34ae tempest-SnapshotsActionsTest-1398629393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.11288f3b-2fa9-4d2a-932b-69c2280e6512 -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.7482f6e4-4918-43be-86de-d78451988c85 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:23:20 devstack sudo[89250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.11288f3b-2fa9-4d2a-932b-69c2280e6512 -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.7482f6e4-4918-43be-86de-d78451988c85 Sep 28 09:23:20 devstack sudo[89250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:23:21 devstack sudo[89250]: pam_unix(sudo:session): session closed for user root Sep 28 09:23:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-42b2dc60-fe12-416f-8051-8af4bc4e34ae tempest-SnapshotsActionsTest-1398629393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.11288f3b-2fa9-4d2a-932b-69c2280e6512 -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.7482f6e4-4918-43be-86de-d78451988c85" returned: 0 in 0.613s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:23:21 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-42b2dc60-fe12-416f-8051-8af4bc4e34ae tempest-SnapshotsActionsTest-1398629393 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.7482f6e4-4918-43be-86de-d78451988c85 is being set with open permissions: ugo+rw Sep 28 09:23:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-42b2dc60-fe12-416f-8051-8af4bc4e34ae tempest-SnapshotsActionsTest-1398629393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.7482f6e4-4918-43be-86de-d78451988c85 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:23:21 devstack sudo[89262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.7482f6e4-4918-43be-86de-d78451988c85 Sep 28 09:23:21 devstack sudo[89262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:23:21 devstack cinder-volume[86553]: DEBUG oslo_service.periodic_task [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86553) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 09:23:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:23:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:23:21 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:23:21 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:23:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:23:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:23:21 devstack sudo[89290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:23:21 devstack sudo[89290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:23:21 devstack cinder-volume[86553]: INFO cinder.volume.manager [req-5ac4ae04-7342-4919-940e-ab0c60d8c76d req-c1304018-96bc-4d76-94dd-7a9c15ae1849 tempest-ServerActionsTestOtherA-711372344 None] Terminate volume connection completed successfully. Sep 28 09:23:21 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [req-5ac4ae04-7342-4919-940e-ab0c60d8c76d req-c1304018-96bc-4d76-94dd-7a9c15ae1849 tempest-ServerActionsTestOtherA-711372344 None] Deleting attachment 0a74e2b5-339f-4ef7-aa90-125e35bd0f09. {{(pid=86553) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 09:23:22 devstack sudo[89262]: pam_unix(sudo:session): session closed for user root Sep 28 09:23:22 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-42b2dc60-fe12-416f-8051-8af4bc4e34ae tempest-SnapshotsActionsTest-1398629393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.7482f6e4-4918-43be-86de-d78451988c85" returned: 0 in 0.718s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:23:22 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-42b2dc60-fe12-416f-8051-8af4bc4e34ae tempest-SnapshotsActionsTest-1398629393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.177s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:23:22 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff80c3ac-cc96-4ff9-a391-ba78962e120c tempest-VolumesAdminNegativeTest-1805337687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:23:22 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ff80c3ac-cc96-4ff9-a391-ba78962e120c tempest-VolumesAdminNegativeTest-1805337687 None] Flow 'volume_create_manager' (9039b7cf-3110-4457-99b7-0465caafd512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:23:22 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ff80c3ac-cc96-4ff9-a391-ba78962e120c tempest-VolumesAdminNegativeTest-1805337687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (344966a5-f386-46ec-b998-f2e6dda66ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:23:22 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-42b2dc60-fe12-416f-8051-8af4bc4e34ae tempest-SnapshotsActionsTest-1398629393 None] Create snapshot completed successfully Sep 28 09:23:22 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ff80c3ac-cc96-4ff9-a391-ba78962e120c tempest-VolumesAdminNegativeTest-1805337687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (344966a5-f386-46ec-b998-f2e6dda66ffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:23:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1431916686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=927751db-fe56-4998-bea5-8489a6e47ff1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2102c514153e418489decad94a271e94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:23:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:23:22Z,use_quota=True,user_id='b8bbfa5bc4a847188c81c844d53f572b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:23:22 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ff80c3ac-cc96-4ff9-a391-ba78962e120c tempest-VolumesAdminNegativeTest-1805337687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2631ab2e-0bc7-4aad-9451-df756375f7c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:23:22 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ff80c3ac-cc96-4ff9-a391-ba78962e120c tempest-VolumesAdminNegativeTest-1805337687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2631ab2e-0bc7-4aad-9451-df756375f7c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:23:22 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ff80c3ac-cc96-4ff9-a391-ba78962e120c tempest-VolumesAdminNegativeTest-1805337687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cd25320-3142-4fd6-8cef-563f7bf38f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:23:22 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ff80c3ac-cc96-4ff9-a391-ba78962e120c tempest-VolumesAdminNegativeTest-1805337687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cd25320-3142-4fd6-8cef-563f7bf38f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '927751db-fe56-4998-bea5-8489a6e47ff1', 'volume_name': 'volume-927751db-fe56-4998-bea5-8489a6e47ff1', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:23:22 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ff80c3ac-cc96-4ff9-a391-ba78962e120c tempest-VolumesAdminNegativeTest-1805337687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de6d0f2d-0ba6-4582-bdd8-f71d5210fa3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:23:22 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ff80c3ac-cc96-4ff9-a391-ba78962e120c tempest-VolumesAdminNegativeTest-1805337687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de6d0f2d-0ba6-4582-bdd8-f71d5210fa3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:23:22 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ff80c3ac-cc96-4ff9-a391-ba78962e120c tempest-VolumesAdminNegativeTest-1805337687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9eecaf4c-c40b-4bb3-b8f3-a3bceb0ed29b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:23:22 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-ff80c3ac-cc96-4ff9-a391-ba78962e120c tempest-VolumesAdminNegativeTest-1805337687 None] Volume 927751db-fe56-4998-bea5-8489a6e47ff1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-927751db-fe56-4998-bea5-8489a6e47ff1', 'volume_size': 1} Sep 28 09:23:22 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ff80c3ac-cc96-4ff9-a391-ba78962e120c tempest-VolumesAdminNegativeTest-1805337687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:23:22 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ff80c3ac-cc96-4ff9-a391-ba78962e120c tempest-VolumesAdminNegativeTest-1805337687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:23:22 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ff80c3ac-cc96-4ff9-a391-ba78962e120c tempest-VolumesAdminNegativeTest-1805337687 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:23:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1431916686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=927751db-fe56-4998-bea5-8489a6e47ff1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2102c514153e418489decad94a271e94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:23:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:23:22Z,use_quota=True,user_id='b8bbfa5bc4a847188c81c844d53f572b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:23:22 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-ff80c3ac-cc96-4ff9-a391-ba78962e120c tempest-VolumesAdminNegativeTest-1805337687 None] Creating volume 927751db-fe56-4998-bea5-8489a6e47ff1 {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:23:22 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ff80c3ac-cc96-4ff9-a391-ba78962e120c tempest-VolumesAdminNegativeTest-1805337687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:23:22 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ff80c3ac-cc96-4ff9-a391-ba78962e120c tempest-VolumesAdminNegativeTest-1805337687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:23:22 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ff80c3ac-cc96-4ff9-a391-ba78962e120c tempest-VolumesAdminNegativeTest-1805337687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:23:22 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ff80c3ac-cc96-4ff9-a391-ba78962e120c tempest-VolumesAdminNegativeTest-1805337687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:23:22 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ff80c3ac-cc96-4ff9-a391-ba78962e120c tempest-VolumesAdminNegativeTest-1805337687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:23:22 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ff80c3ac-cc96-4ff9-a391-ba78962e120c tempest-VolumesAdminNegativeTest-1805337687 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:23:22 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-ff80c3ac-cc96-4ff9-a391-ba78962e120c tempest-VolumesAdminNegativeTest-1805337687 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:23:22 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ff80c3ac-cc96-4ff9-a391-ba78962e120c tempest-VolumesAdminNegativeTest-1805337687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-927751db-fe56-4998-bea5-8489a6e47ff1 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:23:22 devstack sudo[89306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-927751db-fe56-4998-bea5-8489a6e47ff1 1073741824 Sep 28 09:23:22 devstack sudo[89306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:23:22 devstack sudo[89290]: pam_unix(sudo:session): session closed for user root Sep 28 09:23:22 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.975s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:23:22 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:23:23 devstack sudo[89306]: pam_unix(sudo:session): session closed for user root Sep 28 09:23:23 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ff80c3ac-cc96-4ff9-a391-ba78962e120c tempest-VolumesAdminNegativeTest-1805337687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-927751db-fe56-4998-bea5-8489a6e47ff1 1073741824" returned: 0 in 0.641s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:23:23 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ff80c3ac-cc96-4ff9-a391-ba78962e120c tempest-VolumesAdminNegativeTest-1805337687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-927751db-fe56-4998-bea5-8489a6e47ff1 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:23:23 devstack sudo[89328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-927751db-fe56-4998-bea5-8489a6e47ff1 Sep 28 09:23:23 devstack sudo[89328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:23:23 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-5ac4ae04-7342-4919-940e-ab0c60d8c76d req-655e4570-117f-43e5-9d00-a97580a1c6f6 tempest-ServerActionsTestOtherA-711372344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:23:23 devstack sudo[89328]: pam_unix(sudo:session): session closed for user root Sep 28 09:23:23 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ff80c3ac-cc96-4ff9-a391-ba78962e120c tempest-VolumesAdminNegativeTest-1805337687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-927751db-fe56-4998-bea5-8489a6e47ff1" returned: 0 in 0.391s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:23:23 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ff80c3ac-cc96-4ff9-a391-ba78962e120c tempest-VolumesAdminNegativeTest-1805337687 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:23:23 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ff80c3ac-cc96-4ff9-a391-ba78962e120c tempest-VolumesAdminNegativeTest-1805337687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:23:23 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-5ac4ae04-7342-4919-940e-ab0c60d8c76d req-655e4570-117f-43e5-9d00-a97580a1c6f6 tempest-ServerActionsTestOtherA-711372344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.241s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:23:23 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ff80c3ac-cc96-4ff9-a391-ba78962e120c tempest-VolumesAdminNegativeTest-1805337687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9eecaf4c-c40b-4bb3-b8f3-a3bceb0ed29b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-927751db-fe56-4998-bea5-8489a6e47ff1', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:23:23 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ff80c3ac-cc96-4ff9-a391-ba78962e120c tempest-VolumesAdminNegativeTest-1805337687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb634e78-d172-457f-b345-bff5947548b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:23:23 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-5ac4ae04-7342-4919-940e-ab0c60d8c76d req-655e4570-117f-43e5-9d00-a97580a1c6f6 tempest-ServerActionsTestOtherA-711372344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.050s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:23:23 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-ff80c3ac-cc96-4ff9-a391-ba78962e120c tempest-VolumesAdminNegativeTest-1805337687 None] Volume volume-927751db-fe56-4998-bea5-8489a6e47ff1 (927751db-fe56-4998-bea5-8489a6e47ff1): created successfully Sep 28 09:23:23 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ff80c3ac-cc96-4ff9-a391-ba78962e120c tempest-VolumesAdminNegativeTest-1805337687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb634e78-d172-457f-b345-bff5947548b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:23:23 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ff80c3ac-cc96-4ff9-a391-ba78962e120c tempest-VolumesAdminNegativeTest-1805337687 None] Flow 'volume_create_manager' (9039b7cf-3110-4457-99b7-0465caafd512) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:23:23 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-606ce2af-cbad-4dd7-9586-00d2d0ab7418 tempest-SnapshotsActionsTest-639939201 None] Acquiring lock "cinder-7482f6e4-4918-43be-86de-d78451988c85-delete_snapshot" by "delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:23:23 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-ff80c3ac-cc96-4ff9-a391-ba78962e120c tempest-VolumesAdminNegativeTest-1805337687 None] Created volume successfully. Sep 28 09:23:23 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-606ce2af-cbad-4dd7-9586-00d2d0ab7418 tempest-SnapshotsActionsTest-639939201 None] Lock "cinder-7482f6e4-4918-43be-86de-d78451988c85-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:23:23 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-606ce2af-cbad-4dd7-9586-00d2d0ab7418 tempest-SnapshotsActionsTest-639939201 None] Acquiring lock "cinder-quobyte-89c76f9a-ea2a-4b26-9f56-e8380054a2f7" by "delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:23:23 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [req-5ac4ae04-7342-4919-940e-ab0c60d8c76d req-655e4570-117f-43e5-9d00-a97580a1c6f6 tempest-ServerActionsTestOtherA-711372344 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d', 'name': 'volume-06c42fcd-9687-401a-95f2-bcd257ff5ec8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6ec45b5e-6762-42cc-a747-964e9591111d', 'enforce_multipath': True} {{(pid=86553) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 09:23:23 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-606ce2af-cbad-4dd7-9586-00d2d0ab7418 tempest-SnapshotsActionsTest-639939201 None] Lock "cinder-quobyte-89c76f9a-ea2a-4b26-9f56-e8380054a2f7" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:23:23 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-606ce2af-cbad-4dd7-9586-00d2d0ab7418 tempest-SnapshotsActionsTest-639939201 None] Acquiring lock "cinder-quobyte-7482f6e4-4918-43be-86de-d78451988c85" by "_delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:23:23 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-606ce2af-cbad-4dd7-9586-00d2d0ab7418 tempest-SnapshotsActionsTest-639939201 None] Lock "cinder-quobyte-7482f6e4-4918-43be-86de-d78451988c85" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:23:23 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-606ce2af-cbad-4dd7-9586-00d2d0ab7418 tempest-SnapshotsActionsTest-639939201 None] Deleting offline snapshot 7482f6e4-4918-43be-86de-d78451988c85 of volume 89c76f9a-ea2a-4b26-9f56-e8380054a2f7 {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 09:23:23 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-606ce2af-cbad-4dd7-9586-00d2d0ab7418 tempest-SnapshotsActionsTest-639939201 None] snapshot_file for this snap is: volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.7482f6e4-4918-43be-86de-d78451988c85 {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 09:23:23 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[482322ff-041c-42f8-8897-f08fda6d5c85]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:23:23 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-606ce2af-cbad-4dd7-9586-00d2d0ab7418 tempest-SnapshotsActionsTest-639939201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.7482f6e4-4918-43be-86de-d78451988c85 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:23:23 devstack cinder-volume[86553]: INFO cinder.volume.manager [req-5ac4ae04-7342-4919-940e-ab0c60d8c76d req-655e4570-117f-43e5-9d00-a97580a1c6f6 tempest-ServerActionsTestOtherA-711372344 None] attachment_update completed successfully. Sep 28 09:23:23 devstack sudo[89331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.7482f6e4-4918-43be-86de-d78451988c85 Sep 28 09:23:23 devstack sudo[89331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:23:24 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-3cc0ebef-a2e6-455b-b676-08e11a67f67f tempest-TaggedAttachmentsTest-1637253403 None] Acquiring lock "cinder-7ebfe33d-3afd-419d-abbb-5da85e3a3bb4-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:23:24 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-3cc0ebef-a2e6-455b-b676-08e11a67f67f tempest-TaggedAttachmentsTest-1637253403 None] Lock "cinder-7ebfe33d-3afd-419d-abbb-5da85e3a3bb4-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:23:24 devstack sudo[89331]: pam_unix(sudo:session): session closed for user root Sep 28 09:23:24 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-606ce2af-cbad-4dd7-9586-00d2d0ab7418 tempest-SnapshotsActionsTest-639939201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.7482f6e4-4918-43be-86de-d78451988c85" returned: 0 in 0.954s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:23:24 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-606ce2af-cbad-4dd7-9586-00d2d0ab7418 tempest-SnapshotsActionsTest-639939201 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86553) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 09:23:24 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-3cc0ebef-a2e6-455b-b676-08e11a67f67f tempest-TaggedAttachmentsTest-1637253403 None] Acquiring lock "cinder-quobyte-7ebfe33d-3afd-419d-abbb-5da85e3a3bb4" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:23:24 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[0beec289-dbd8-49a2-9235-3e043dd332d5]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:23:24 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-606ce2af-cbad-4dd7-9586-00d2d0ab7418 tempest-SnapshotsActionsTest-639939201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.11288f3b-2fa9-4d2a-932b-69c2280e6512 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:23:24 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-3cc0ebef-a2e6-455b-b676-08e11a67f67f tempest-TaggedAttachmentsTest-1637253403 None] Lock "cinder-quobyte-7ebfe33d-3afd-419d-abbb-5da85e3a3bb4" acquired by "delete_volume" :: waited 0.048s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:23:24 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[69175499-2809-4e5d-a3e7-b07c4afede8a]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:23:24 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3cc0ebef-a2e6-455b-b676-08e11a67f67f tempest-TaggedAttachmentsTest-1637253403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-7ebfe33d-3afd-419d-abbb-5da85e3a3bb4 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:23:24 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-af7721f1-2f24-4712-8ab8-e5bbf79543b0 tempest-VolumesAdminNegativeTest-1805337687 None] Acquiring lock "cinder-927751db-fe56-4998-bea5-8489a6e47ff1-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:23:24 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-af7721f1-2f24-4712-8ab8-e5bbf79543b0 tempest-VolumesAdminNegativeTest-1805337687 None] Lock "cinder-927751db-fe56-4998-bea5-8489a6e47ff1-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:23:24 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-af7721f1-2f24-4712-8ab8-e5bbf79543b0 tempest-VolumesAdminNegativeTest-1805337687 None] Acquiring lock "cinder-quobyte-927751db-fe56-4998-bea5-8489a6e47ff1" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:23:25 devstack sudo[89343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.11288f3b-2fa9-4d2a-932b-69c2280e6512 Sep 28 09:23:25 devstack sudo[89343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:23:25 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-af7721f1-2f24-4712-8ab8-e5bbf79543b0 tempest-VolumesAdminNegativeTest-1805337687 None] Lock "cinder-quobyte-927751db-fe56-4998-bea5-8489a6e47ff1" acquired by "delete_volume" :: waited 0.037s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:23:25 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce15f311-1fd8-4801-8b51-fee21e41e71c]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:23:25 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-af7721f1-2f24-4712-8ab8-e5bbf79543b0 tempest-VolumesAdminNegativeTest-1805337687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-927751db-fe56-4998-bea5-8489a6e47ff1 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:23:25 devstack sudo[89344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-7ebfe33d-3afd-419d-abbb-5da85e3a3bb4 Sep 28 09:23:25 devstack sudo[89344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:23:25 devstack sudo[89352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-927751db-fe56-4998-bea5-8489a6e47ff1 Sep 28 09:23:25 devstack sudo[89352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:23:25 devstack sudo[89343]: pam_unix(sudo:session): session closed for user root Sep 28 09:23:25 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-606ce2af-cbad-4dd7-9586-00d2d0ab7418 tempest-SnapshotsActionsTest-639939201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.11288f3b-2fa9-4d2a-932b-69c2280e6512" returned: 0 in 0.683s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:23:25 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-606ce2af-cbad-4dd7-9586-00d2d0ab7418 tempest-SnapshotsActionsTest-639939201 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86553) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 09:23:25 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-606ce2af-cbad-4dd7-9586-00d2d0ab7418 tempest-SnapshotsActionsTest-639939201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.7482f6e4-4918-43be-86de-d78451988c85 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:23:25 devstack sudo[89362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.7482f6e4-4918-43be-86de-d78451988c85 Sep 28 09:23:25 devstack sudo[89362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:23:25 devstack sudo[89344]: pam_unix(sudo:session): session closed for user root Sep 28 09:23:25 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3cc0ebef-a2e6-455b-b676-08e11a67f67f tempest-TaggedAttachmentsTest-1637253403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-7ebfe33d-3afd-419d-abbb-5da85e3a3bb4" returned: 0 in 0.823s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:23:25 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3cc0ebef-a2e6-455b-b676-08e11a67f67f tempest-TaggedAttachmentsTest-1637253403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-7ebfe33d-3afd-419d-abbb-5da85e3a3bb4 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:23:25 devstack sudo[89352]: pam_unix(sudo:session): session closed for user root Sep 28 09:23:25 devstack sudo[89373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-7ebfe33d-3afd-419d-abbb-5da85e3a3bb4 Sep 28 09:23:25 devstack sudo[89373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:23:25 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-af7721f1-2f24-4712-8ab8-e5bbf79543b0 tempest-VolumesAdminNegativeTest-1805337687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-927751db-fe56-4998-bea5-8489a6e47ff1" returned: 0 in 0.677s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:23:25 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-af7721f1-2f24-4712-8ab8-e5bbf79543b0 tempest-VolumesAdminNegativeTest-1805337687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-927751db-fe56-4998-bea5-8489a6e47ff1 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:23:25 devstack sudo[89396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-927751db-fe56-4998-bea5-8489a6e47ff1 Sep 28 09:23:25 devstack sudo[89396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:23:26 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-606ce2af-cbad-4dd7-9586-00d2d0ab7418 tempest-SnapshotsActionsTest-639939201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.7482f6e4-4918-43be-86de-d78451988c85" returned: 0 in 0.638s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:23:26 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-606ce2af-cbad-4dd7-9586-00d2d0ab7418 tempest-SnapshotsActionsTest-639939201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.7482f6e4-4918-43be-86de-d78451988c85 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:23:26 devstack sudo[89362]: pam_unix(sudo:session): session closed for user root Sep 28 09:23:26 devstack sudo[89476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.7482f6e4-4918-43be-86de-d78451988c85 Sep 28 09:23:26 devstack sudo[89476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:23:26 devstack sudo[89373]: pam_unix(sudo:session): session closed for user root Sep 28 09:23:26 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3cc0ebef-a2e6-455b-b676-08e11a67f67f tempest-TaggedAttachmentsTest-1637253403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-7ebfe33d-3afd-419d-abbb-5da85e3a3bb4" returned: 0 in 0.574s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:23:26 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-3cc0ebef-a2e6-455b-b676-08e11a67f67f tempest-TaggedAttachmentsTest-1637253403 None] Lock "cinder-quobyte-7ebfe33d-3afd-419d-abbb-5da85e3a3bb4" released by "delete_volume" :: held 1.480s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:23:26 devstack sudo[89396]: pam_unix(sudo:session): session closed for user root Sep 28 09:23:26 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-af7721f1-2f24-4712-8ab8-e5bbf79543b0 tempest-VolumesAdminNegativeTest-1805337687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-927751db-fe56-4998-bea5-8489a6e47ff1" returned: 0 in 0.628s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:23:26 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-af7721f1-2f24-4712-8ab8-e5bbf79543b0 tempest-VolumesAdminNegativeTest-1805337687 None] Lock "cinder-quobyte-927751db-fe56-4998-bea5-8489a6e47ff1" released by "delete_volume" :: held 1.392s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:23:26 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-3cc0ebef-a2e6-455b-b676-08e11a67f67f tempest-TaggedAttachmentsTest-1637253403 None] Created reservations ['419a8386-a6b3-4b3f-9d72-881072d241e6', '13dc2553-97f6-4d5a-b585-249b9e617cd0', 'f06c0b41-bfca-4ced-a9bc-3b0cff65e212', '471f7cb2-2535-43bb-87c0-ae8c57495d8e'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:23:26 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-af7721f1-2f24-4712-8ab8-e5bbf79543b0 tempest-VolumesAdminNegativeTest-1805337687 None] Created reservations ['b74584cd-b8a4-4bf3-b528-f2f605d55595', '2c42bd30-ab28-4e9c-be80-51123421437f', '8517803f-a38d-40da-a04a-c6148213001f', '895037e3-2d2c-4370-b725-7832977d2561'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:23:26 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-3cc0ebef-a2e6-455b-b676-08e11a67f67f tempest-TaggedAttachmentsTest-1637253403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:23:26 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-3cc0ebef-a2e6-455b-b676-08e11a67f67f tempest-TaggedAttachmentsTest-1637253403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:23:26 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-3cc0ebef-a2e6-455b-b676-08e11a67f67f tempest-TaggedAttachmentsTest-1637253403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:23:26 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-3cc0ebef-a2e6-455b-b676-08e11a67f67f tempest-TaggedAttachmentsTest-1637253403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:23:26 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-3cc0ebef-a2e6-455b-b676-08e11a67f67f tempest-TaggedAttachmentsTest-1637253403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:23:26 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3cc0ebef-a2e6-455b-b676-08e11a67f67f tempest-TaggedAttachmentsTest-1637253403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:23:26 devstack sudo[89476]: pam_unix(sudo:session): session closed for user root Sep 28 09:23:26 devstack sudo[89809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:23:26 devstack sudo[89809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:23:26 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-606ce2af-cbad-4dd7-9586-00d2d0ab7418 tempest-SnapshotsActionsTest-639939201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.7482f6e4-4918-43be-86de-d78451988c85" returned: 0 in 0.689s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:23:26 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-606ce2af-cbad-4dd7-9586-00d2d0ab7418 tempest-SnapshotsActionsTest-639939201 None] Lock "cinder-quobyte-7482f6e4-4918-43be-86de-d78451988c85" released by "_delete_snapshot" :: held 3.212s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:23:26 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-606ce2af-cbad-4dd7-9586-00d2d0ab7418 tempest-SnapshotsActionsTest-639939201 None] Lock "cinder-quobyte-89c76f9a-ea2a-4b26-9f56-e8380054a2f7" released by "delete_snapshot" :: held 3.281s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:23:26 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-af7721f1-2f24-4712-8ab8-e5bbf79543b0 tempest-VolumesAdminNegativeTest-1805337687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:23:26 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-af7721f1-2f24-4712-8ab8-e5bbf79543b0 tempest-VolumesAdminNegativeTest-1805337687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:23:26 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-af7721f1-2f24-4712-8ab8-e5bbf79543b0 tempest-VolumesAdminNegativeTest-1805337687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:23:26 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-af7721f1-2f24-4712-8ab8-e5bbf79543b0 tempest-VolumesAdminNegativeTest-1805337687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:23:26 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-af7721f1-2f24-4712-8ab8-e5bbf79543b0 tempest-VolumesAdminNegativeTest-1805337687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:23:26 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-af7721f1-2f24-4712-8ab8-e5bbf79543b0 tempest-VolumesAdminNegativeTest-1805337687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:23:27 devstack sudo[89819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:23:27 devstack sudo[89819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:23:27 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-606ce2af-cbad-4dd7-9586-00d2d0ab7418 tempest-SnapshotsActionsTest-639939201 None] Created reservations ['9a525fde-9152-4a04-a524-96099ce7be3e', '28dbb1f0-2287-4a69-9a1b-d7830e07801f', '0af2b090-20b2-4215-a5ce-e7b0ff274145', 'a42bbf54-9547-4f91-9c89-4fce5506710f'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:23:27 devstack sudo[89809]: pam_unix(sudo:session): session closed for user root Sep 28 09:23:27 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3cc0ebef-a2e6-455b-b676-08e11a67f67f tempest-TaggedAttachmentsTest-1637253403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.499s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:23:27 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-3cc0ebef-a2e6-455b-b676-08e11a67f67f tempest-TaggedAttachmentsTest-1637253403 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:23:27 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-3cc0ebef-a2e6-455b-b676-08e11a67f67f tempest-TaggedAttachmentsTest-1637253403 None] Deleted volume successfully. Sep 28 09:23:27 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-3cc0ebef-a2e6-455b-b676-08e11a67f67f tempest-TaggedAttachmentsTest-1637253403 None] Lock "cinder-7ebfe33d-3afd-419d-abbb-5da85e3a3bb4-delete_volume" released by "delete_volume" :: held 2.636s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:23:27 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-606ce2af-cbad-4dd7-9586-00d2d0ab7418 tempest-SnapshotsActionsTest-639939201 None] Delete snapshot completed successfully. Sep 28 09:23:27 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-606ce2af-cbad-4dd7-9586-00d2d0ab7418 tempest-SnapshotsActionsTest-639939201 None] Lock "cinder-7482f6e4-4918-43be-86de-d78451988c85-delete_snapshot" released by "delete_snapshot" :: held 3.796s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:23:27 devstack sudo[89819]: pam_unix(sudo:session): session closed for user root Sep 28 09:23:27 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-af7721f1-2f24-4712-8ab8-e5bbf79543b0 tempest-VolumesAdminNegativeTest-1805337687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.774s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:23:27 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-af7721f1-2f24-4712-8ab8-e5bbf79543b0 tempest-VolumesAdminNegativeTest-1805337687 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:23:27 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-af7721f1-2f24-4712-8ab8-e5bbf79543b0 tempest-VolumesAdminNegativeTest-1805337687 None] Deleted volume successfully. Sep 28 09:23:27 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-af7721f1-2f24-4712-8ab8-e5bbf79543b0 tempest-VolumesAdminNegativeTest-1805337687 None] Lock "cinder-927751db-fe56-4998-bea5-8489a6e47ff1-delete_volume" released by "delete_volume" :: held 2.889s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:23:28 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-f986ce8b-c5ad-4284-8ee2-ec675bea932c tempest-SnapshotsActionsTest-1398629393 None] Acquiring lock "cinder-11288f3b-2fa9-4d2a-932b-69c2280e6512-delete_snapshot" by "delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:23:28 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-f986ce8b-c5ad-4284-8ee2-ec675bea932c tempest-SnapshotsActionsTest-1398629393 None] Lock "cinder-11288f3b-2fa9-4d2a-932b-69c2280e6512-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:23:28 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-f986ce8b-c5ad-4284-8ee2-ec675bea932c tempest-SnapshotsActionsTest-1398629393 None] Acquiring lock "cinder-quobyte-89c76f9a-ea2a-4b26-9f56-e8380054a2f7" by "delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:23:28 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-f986ce8b-c5ad-4284-8ee2-ec675bea932c tempest-SnapshotsActionsTest-1398629393 None] Lock "cinder-quobyte-89c76f9a-ea2a-4b26-9f56-e8380054a2f7" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:23:28 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-f986ce8b-c5ad-4284-8ee2-ec675bea932c tempest-SnapshotsActionsTest-1398629393 None] Acquiring lock "cinder-quobyte-11288f3b-2fa9-4d2a-932b-69c2280e6512" by "_delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:23:28 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-f986ce8b-c5ad-4284-8ee2-ec675bea932c tempest-SnapshotsActionsTest-1398629393 None] Lock "cinder-quobyte-11288f3b-2fa9-4d2a-932b-69c2280e6512" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:23:28 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-f986ce8b-c5ad-4284-8ee2-ec675bea932c tempest-SnapshotsActionsTest-1398629393 None] Deleting offline snapshot 11288f3b-2fa9-4d2a-932b-69c2280e6512 of volume 89c76f9a-ea2a-4b26-9f56-e8380054a2f7 {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 09:23:28 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-f986ce8b-c5ad-4284-8ee2-ec675bea932c tempest-SnapshotsActionsTest-1398629393 None] snapshot_file for this snap is: volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.11288f3b-2fa9-4d2a-932b-69c2280e6512 {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 09:23:28 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[6206b1c6-0690-4bbd-bf72-54e6e06312ce]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:23:28 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f986ce8b-c5ad-4284-8ee2-ec675bea932c tempest-SnapshotsActionsTest-1398629393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.11288f3b-2fa9-4d2a-932b-69c2280e6512 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:23:28 devstack sudo[89867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.11288f3b-2fa9-4d2a-932b-69c2280e6512 Sep 28 09:23:28 devstack sudo[89867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:23:29 devstack sudo[89867]: pam_unix(sudo:session): session closed for user root Sep 28 09:23:29 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f986ce8b-c5ad-4284-8ee2-ec675bea932c tempest-SnapshotsActionsTest-1398629393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.11288f3b-2fa9-4d2a-932b-69c2280e6512" returned: 0 in 0.565s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:23:29 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-f986ce8b-c5ad-4284-8ee2-ec675bea932c tempest-SnapshotsActionsTest-1398629393 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86553) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 09:23:29 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7bfbbff-2e11-4a03-9656-fb645ca8de89]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:23:29 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f986ce8b-c5ad-4284-8ee2-ec675bea932c tempest-SnapshotsActionsTest-1398629393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:23:29 devstack sudo[89887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7 Sep 28 09:23:29 devstack sudo[89887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:23:29 devstack sudo[89887]: pam_unix(sudo:session): session closed for user root Sep 28 09:23:29 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f986ce8b-c5ad-4284-8ee2-ec675bea932c tempest-SnapshotsActionsTest-1398629393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7" returned: 0 in 0.508s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:23:29 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f986ce8b-c5ad-4284-8ee2-ec675bea932c tempest-SnapshotsActionsTest-1398629393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.11288f3b-2fa9-4d2a-932b-69c2280e6512 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:23:29 devstack sudo[89901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.11288f3b-2fa9-4d2a-932b-69c2280e6512 Sep 28 09:23:29 devstack sudo[89901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:23:30 devstack sudo[89901]: pam_unix(sudo:session): session closed for user root Sep 28 09:23:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f986ce8b-c5ad-4284-8ee2-ec675bea932c tempest-SnapshotsActionsTest-1398629393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.11288f3b-2fa9-4d2a-932b-69c2280e6512" returned: 0 in 0.598s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:23:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f986ce8b-c5ad-4284-8ee2-ec675bea932c tempest-SnapshotsActionsTest-1398629393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.11288f3b-2fa9-4d2a-932b-69c2280e6512 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:23:30 devstack sudo[89913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.11288f3b-2fa9-4d2a-932b-69c2280e6512 Sep 28 09:23:30 devstack sudo[89913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:23:30 devstack sudo[89913]: pam_unix(sudo:session): session closed for user root Sep 28 09:23:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f986ce8b-c5ad-4284-8ee2-ec675bea932c tempest-SnapshotsActionsTest-1398629393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7.11288f3b-2fa9-4d2a-932b-69c2280e6512" returned: 0 in 0.444s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:23:30 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-f986ce8b-c5ad-4284-8ee2-ec675bea932c tempest-SnapshotsActionsTest-1398629393 None] Lock "cinder-quobyte-11288f3b-2fa9-4d2a-932b-69c2280e6512" released by "_delete_snapshot" :: held 2.383s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:23:30 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-f986ce8b-c5ad-4284-8ee2-ec675bea932c tempest-SnapshotsActionsTest-1398629393 None] Lock "cinder-quobyte-89c76f9a-ea2a-4b26-9f56-e8380054a2f7" released by "delete_snapshot" :: held 2.446s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:23:31 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-f986ce8b-c5ad-4284-8ee2-ec675bea932c tempest-SnapshotsActionsTest-1398629393 None] Created reservations ['decc460d-446a-4493-916c-e35375306c36', '87849425-f980-46fe-b6f0-4ea41317c127', 'a7db5d9c-b82e-438b-9ed9-37ecb36d44a8', '9b8f4ac9-191f-4f68-af74-d005e9274dbf'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:23:31 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-f986ce8b-c5ad-4284-8ee2-ec675bea932c tempest-SnapshotsActionsTest-1398629393 None] Delete snapshot completed successfully. Sep 28 09:23:31 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-f986ce8b-c5ad-4284-8ee2-ec675bea932c tempest-SnapshotsActionsTest-1398629393 None] Lock "cinder-11288f3b-2fa9-4d2a-932b-69c2280e6512-delete_snapshot" released by "delete_snapshot" :: held 2.710s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:23:31 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-1863e6ea-158e-4819-a02e-13511732e3e7 tempest-SnapshotsActionsTest-1398629393 None] Acquiring lock "cinder-89c76f9a-ea2a-4b26-9f56-e8380054a2f7-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:23:31 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-1863e6ea-158e-4819-a02e-13511732e3e7 tempest-SnapshotsActionsTest-1398629393 None] Lock "cinder-89c76f9a-ea2a-4b26-9f56-e8380054a2f7-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:23:32 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-1863e6ea-158e-4819-a02e-13511732e3e7 tempest-SnapshotsActionsTest-1398629393 None] Acquiring lock "cinder-quobyte-89c76f9a-ea2a-4b26-9f56-e8380054a2f7" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:23:32 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-1863e6ea-158e-4819-a02e-13511732e3e7 tempest-SnapshotsActionsTest-1398629393 None] Lock "cinder-quobyte-89c76f9a-ea2a-4b26-9f56-e8380054a2f7" acquired by "delete_volume" :: waited 0.025s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:23:32 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[91e53674-36f2-4ae6-b9f4-73b05c43a2c5]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:23:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1863e6ea-158e-4819-a02e-13511732e3e7 tempest-SnapshotsActionsTest-1398629393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:23:32 devstack sudo[89918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7 Sep 28 09:23:32 devstack sudo[89918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:23:32 devstack sudo[89918]: pam_unix(sudo:session): session closed for user root Sep 28 09:23:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1863e6ea-158e-4819-a02e-13511732e3e7 tempest-SnapshotsActionsTest-1398629393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7" returned: 0 in 0.411s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:23:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1863e6ea-158e-4819-a02e-13511732e3e7 tempest-SnapshotsActionsTest-1398629393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:23:32 devstack sudo[89923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7 Sep 28 09:23:32 devstack sudo[89923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:23:32 devstack sudo[89923]: pam_unix(sudo:session): session closed for user root Sep 28 09:23:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1863e6ea-158e-4819-a02e-13511732e3e7 tempest-SnapshotsActionsTest-1398629393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-89c76f9a-ea2a-4b26-9f56-e8380054a2f7" returned: 0 in 0.268s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:23:32 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-1863e6ea-158e-4819-a02e-13511732e3e7 tempest-SnapshotsActionsTest-1398629393 None] Lock "cinder-quobyte-89c76f9a-ea2a-4b26-9f56-e8380054a2f7" released by "delete_volume" :: held 0.773s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:23:32 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-1863e6ea-158e-4819-a02e-13511732e3e7 tempest-SnapshotsActionsTest-1398629393 None] Created reservations ['3d890309-b3fd-4236-8aa6-2d56bbfeb5f1', 'b096fe6c-3294-431c-a9ed-991b1ad9b61a', 'b84f2c26-ba6f-44c1-82ad-05be4b6f1f49', 'c6a7f87f-2615-4fd7-a7de-4d11588be129'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:23:33 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-1863e6ea-158e-4819-a02e-13511732e3e7 tempest-SnapshotsActionsTest-1398629393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:23:33 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-1863e6ea-158e-4819-a02e-13511732e3e7 tempest-SnapshotsActionsTest-1398629393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:23:33 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-1863e6ea-158e-4819-a02e-13511732e3e7 tempest-SnapshotsActionsTest-1398629393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:23:33 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-1863e6ea-158e-4819-a02e-13511732e3e7 tempest-SnapshotsActionsTest-1398629393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:23:33 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-1863e6ea-158e-4819-a02e-13511732e3e7 tempest-SnapshotsActionsTest-1398629393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:23:33 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1863e6ea-158e-4819-a02e-13511732e3e7 tempest-SnapshotsActionsTest-1398629393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:23:33 devstack sudo[89926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:23:33 devstack sudo[89926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:23:33 devstack sudo[89926]: pam_unix(sudo:session): session closed for user root Sep 28 09:23:33 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1863e6ea-158e-4819-a02e-13511732e3e7 tempest-SnapshotsActionsTest-1398629393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.396s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:23:33 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-1863e6ea-158e-4819-a02e-13511732e3e7 tempest-SnapshotsActionsTest-1398629393 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:23:33 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-1863e6ea-158e-4819-a02e-13511732e3e7 tempest-SnapshotsActionsTest-1398629393 None] Deleted volume successfully. Sep 28 09:23:33 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-1863e6ea-158e-4819-a02e-13511732e3e7 tempest-SnapshotsActionsTest-1398629393 None] Lock "cinder-89c76f9a-ea2a-4b26-9f56-e8380054a2f7-delete_volume" released by "delete_volume" :: held 1.683s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:23:43 devstack cinder-volume[86553]: DEBUG dbcounter [-] [86553] Writing DB stats cinder:SELECT=77,cinder:INSERT=17,cinder:UPDATE=72,cinder:DELETE=3 {{(pid=86553) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 09:23:43 devstack cinder-volume[86553]: DEBUG dbcounter [-] [86553] Writing DB stats cinder:UPDATE=64,cinder:SELECT=79,cinder:DELETE=7,cinder:INSERT=18 {{(pid=86553) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 09:23:56 devstack cinder-volume[86553]: INFO cinder.volume.manager [req-6d11144a-1147-46da-a8ee-2848ca359bd6 req-ebc54013-c42c-4e37-bb60-35bc83c8ce3a tempest-ServerActionsTestOtherA-711372344 None] Terminate volume connection completed successfully. Sep 28 09:23:56 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [req-6d11144a-1147-46da-a8ee-2848ca359bd6 req-ebc54013-c42c-4e37-bb60-35bc83c8ce3a tempest-ServerActionsTestOtherA-711372344 None] Deleting attachment 6ec45b5e-6762-42cc-a747-964e9591111d. {{(pid=86553) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 09:24:03 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c13aa63-c5c2-40e0-bb69-e97cbf5a4265 tempest-VolumeTypesAccessTest-88322730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:24:03 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-6c13aa63-c5c2-40e0-bb69-e97cbf5a4265 tempest-VolumeTypesAccessTest-88322730 None] Flow 'volume_create_manager' (74be993b-8aca-411f-8675-148d35fbef06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:24:03 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-6c13aa63-c5c2-40e0-bb69-e97cbf5a4265 tempest-VolumeTypesAccessTest-88322730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb032e57-e622-4ee6-affb-a919d0c8804a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:24:03 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-6c13aa63-c5c2-40e0-bb69-e97cbf5a4265 tempest-VolumeTypesAccessTest-88322730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb032e57-e622-4ee6-affb-a919d0c8804a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:24:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-770990067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92da7712-2231-4ae2-9959-7aaf6a00cb7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b564d58576414b11a482c6449f2437f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:24:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:24:04Z,use_quota=True,user_id='9433bceaff1c424399e14d37c2b3809e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ef81a71-9cd5-43be-b998-32c3fd03828e),volume_type_id=8ef81a71-9cd5-43be-b998-32c3fd03828e)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:24:03 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-6c13aa63-c5c2-40e0-bb69-e97cbf5a4265 tempest-VolumeTypesAccessTest-88322730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa06036b-7805-4e29-976f-e6ec3cb9db12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:24:03 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-6c13aa63-c5c2-40e0-bb69-e97cbf5a4265 tempest-VolumeTypesAccessTest-88322730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa06036b-7805-4e29-976f-e6ec3cb9db12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:24:03 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-6c13aa63-c5c2-40e0-bb69-e97cbf5a4265 tempest-VolumeTypesAccessTest-88322730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1eb450f-204d-4617-849b-af7f958c08f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:24:03 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-6c13aa63-c5c2-40e0-bb69-e97cbf5a4265 tempest-VolumeTypesAccessTest-88322730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1eb450f-204d-4617-849b-af7f958c08f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92da7712-2231-4ae2-9959-7aaf6a00cb7d', 'volume_name': 'volume-92da7712-2231-4ae2-9959-7aaf6a00cb7d', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:24:03 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-6c13aa63-c5c2-40e0-bb69-e97cbf5a4265 tempest-VolumeTypesAccessTest-88322730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38991eb0-53b3-468c-a593-48ec3b04f33c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:24:03 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-6c13aa63-c5c2-40e0-bb69-e97cbf5a4265 tempest-VolumeTypesAccessTest-88322730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38991eb0-53b3-468c-a593-48ec3b04f33c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:24:03 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-6c13aa63-c5c2-40e0-bb69-e97cbf5a4265 tempest-VolumeTypesAccessTest-88322730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d3bd177-b9cf-4d7a-8116-8080c0d52b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:24:03 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-6c13aa63-c5c2-40e0-bb69-e97cbf5a4265 tempest-VolumeTypesAccessTest-88322730 None] Volume 92da7712-2231-4ae2-9959-7aaf6a00cb7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92da7712-2231-4ae2-9959-7aaf6a00cb7d', 'volume_size': 1} Sep 28 09:24:03 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-6c13aa63-c5c2-40e0-bb69-e97cbf5a4265 tempest-VolumeTypesAccessTest-88322730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:24:03 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-6c13aa63-c5c2-40e0-bb69-e97cbf5a4265 tempest-VolumeTypesAccessTest-88322730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:24:03 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-6c13aa63-c5c2-40e0-bb69-e97cbf5a4265 tempest-VolumeTypesAccessTest-88322730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:24:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-770990067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92da7712-2231-4ae2-9959-7aaf6a00cb7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b564d58576414b11a482c6449f2437f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:24:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:24:04Z,use_quota=True,user_id='9433bceaff1c424399e14d37c2b3809e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ef81a71-9cd5-43be-b998-32c3fd03828e),volume_type_id=8ef81a71-9cd5-43be-b998-32c3fd03828e)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:24:03 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-6c13aa63-c5c2-40e0-bb69-e97cbf5a4265 tempest-VolumeTypesAccessTest-88322730 None] Creating volume 92da7712-2231-4ae2-9959-7aaf6a00cb7d {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:24:03 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-6c13aa63-c5c2-40e0-bb69-e97cbf5a4265 tempest-VolumeTypesAccessTest-88322730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:24:03 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-6c13aa63-c5c2-40e0-bb69-e97cbf5a4265 tempest-VolumeTypesAccessTest-88322730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:24:03 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-6c13aa63-c5c2-40e0-bb69-e97cbf5a4265 tempest-VolumeTypesAccessTest-88322730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:24:03 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-6c13aa63-c5c2-40e0-bb69-e97cbf5a4265 tempest-VolumeTypesAccessTest-88322730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:24:03 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-6c13aa63-c5c2-40e0-bb69-e97cbf5a4265 tempest-VolumeTypesAccessTest-88322730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:24:03 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-6c13aa63-c5c2-40e0-bb69-e97cbf5a4265 tempest-VolumeTypesAccessTest-88322730 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:24:03 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-6c13aa63-c5c2-40e0-bb69-e97cbf5a4265 tempest-VolumeTypesAccessTest-88322730 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:24:03 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-6c13aa63-c5c2-40e0-bb69-e97cbf5a4265 tempest-VolumeTypesAccessTest-88322730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-92da7712-2231-4ae2-9959-7aaf6a00cb7d 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:24:03 devstack sudo[90061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-92da7712-2231-4ae2-9959-7aaf6a00cb7d 1073741824 Sep 28 09:24:03 devstack sudo[90061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:24:04 devstack sudo[90061]: pam_unix(sudo:session): session closed for user root Sep 28 09:24:04 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-6c13aa63-c5c2-40e0-bb69-e97cbf5a4265 tempest-VolumeTypesAccessTest-88322730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-92da7712-2231-4ae2-9959-7aaf6a00cb7d 1073741824" returned: 0 in 0.922s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:24:04 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-6c13aa63-c5c2-40e0-bb69-e97cbf5a4265 tempest-VolumeTypesAccessTest-88322730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-92da7712-2231-4ae2-9959-7aaf6a00cb7d {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:24:05 devstack sudo[90104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-92da7712-2231-4ae2-9959-7aaf6a00cb7d Sep 28 09:24:05 devstack sudo[90104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:24:05 devstack sudo[90104]: pam_unix(sudo:session): session closed for user root Sep 28 09:24:05 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-6c13aa63-c5c2-40e0-bb69-e97cbf5a4265 tempest-VolumeTypesAccessTest-88322730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-92da7712-2231-4ae2-9959-7aaf6a00cb7d" returned: 0 in 0.572s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:24:05 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-6c13aa63-c5c2-40e0-bb69-e97cbf5a4265 tempest-VolumeTypesAccessTest-88322730 None] <== create_volume: return (1598ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:24:05 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-6c13aa63-c5c2-40e0-bb69-e97cbf5a4265 tempest-VolumeTypesAccessTest-88322730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.604s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:24:05 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-6c13aa63-c5c2-40e0-bb69-e97cbf5a4265 tempest-VolumeTypesAccessTest-88322730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d3bd177-b9cf-4d7a-8116-8080c0d52b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92da7712-2231-4ae2-9959-7aaf6a00cb7d', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:24:05 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-6c13aa63-c5c2-40e0-bb69-e97cbf5a4265 tempest-VolumeTypesAccessTest-88322730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56b8d567-b8d8-4035-b1ed-d398f2040f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:24:05 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-6c13aa63-c5c2-40e0-bb69-e97cbf5a4265 tempest-VolumeTypesAccessTest-88322730 None] Volume volume-92da7712-2231-4ae2-9959-7aaf6a00cb7d (92da7712-2231-4ae2-9959-7aaf6a00cb7d): created successfully Sep 28 09:24:05 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-6c13aa63-c5c2-40e0-bb69-e97cbf5a4265 tempest-VolumeTypesAccessTest-88322730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56b8d567-b8d8-4035-b1ed-d398f2040f96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:24:05 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-6c13aa63-c5c2-40e0-bb69-e97cbf5a4265 tempest-VolumeTypesAccessTest-88322730 None] Flow 'volume_create_manager' (74be993b-8aca-411f-8675-148d35fbef06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:24:05 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-6c13aa63-c5c2-40e0-bb69-e97cbf5a4265 tempest-VolumeTypesAccessTest-88322730 None] Created volume successfully. Sep 28 09:24:05 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-fda73e0d-23ef-453e-9327-fedf2dacbce8 tempest-ServerActionsTestOtherA-711372344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:24:05 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-fda73e0d-23ef-453e-9327-fedf2dacbce8 tempest-ServerActionsTestOtherA-711372344 None] Flow 'volume_create_manager' (c72f1922-42e8-4e9e-a29e-ad78d8862310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:24:05 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-fda73e0d-23ef-453e-9327-fedf2dacbce8 tempest-ServerActionsTestOtherA-711372344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d219c1cf-62cb-4e52-b667-d57f51a1b4cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:24:05 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-fda73e0d-23ef-453e-9327-fedf2dacbce8 tempest-ServerActionsTestOtherA-711372344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d219c1cf-62cb-4e52-b667-d57f51a1b4cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:24:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-462584152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a319d27c-b15b-422e-98aa-1e5e15b9181e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbcfee92ae24456da32e409ba3c3bd90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:24:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:24:06Z,use_quota=True,user_id='b362b982dcdc42cf8b1041a20b0e9f8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:24:05 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-fda73e0d-23ef-453e-9327-fedf2dacbce8 tempest-ServerActionsTestOtherA-711372344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10947623-543b-4377-a248-be637166f64d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:24:05 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-fda73e0d-23ef-453e-9327-fedf2dacbce8 tempest-ServerActionsTestOtherA-711372344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10947623-543b-4377-a248-be637166f64d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:24:05 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-fda73e0d-23ef-453e-9327-fedf2dacbce8 tempest-ServerActionsTestOtherA-711372344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76b68c72-2b0d-4270-8e75-19d1dba940f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:24:05 devstack cinder-volume[86553]: DEBUG cinder.image.glance [None req-fda73e0d-23ef-453e-9327-fedf2dacbce8 tempest-ServerActionsTestOtherA-711372344 None] Creating Keystone auth plugin from conf {{(pid=86553) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 09:24:06 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-69900f0d-cb9d-45c8-a908-66c7717e36bf tempest-VolumeTypesAccessTest-88322730 None] Acquiring lock "cinder-92da7712-2231-4ae2-9959-7aaf6a00cb7d-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:24:06 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-69900f0d-cb9d-45c8-a908-66c7717e36bf tempest-VolumeTypesAccessTest-88322730 None] Lock "cinder-92da7712-2231-4ae2-9959-7aaf6a00cb7d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:24:06 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-69900f0d-cb9d-45c8-a908-66c7717e36bf tempest-VolumeTypesAccessTest-88322730 None] Acquiring lock "cinder-quobyte-92da7712-2231-4ae2-9959-7aaf6a00cb7d" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:24:06 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-69900f0d-cb9d-45c8-a908-66c7717e36bf tempest-VolumeTypesAccessTest-88322730 None] Lock "cinder-quobyte-92da7712-2231-4ae2-9959-7aaf6a00cb7d" acquired by "delete_volume" :: waited 0.034s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:24:06 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6cf7ca3-0fc7-432c-adc8-e71f21bfdd06]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:24:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-69900f0d-cb9d-45c8-a908-66c7717e36bf tempest-VolumeTypesAccessTest-88322730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-92da7712-2231-4ae2-9959-7aaf6a00cb7d {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:24:06 devstack sudo[90142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-92da7712-2231-4ae2-9959-7aaf6a00cb7d Sep 28 09:24:06 devstack sudo[90142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:24:06 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-fda73e0d-23ef-453e-9327-fedf2dacbce8 tempest-ServerActionsTestOtherA-711372344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76b68c72-2b0d-4270-8e75-19d1dba940f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a319d27c-b15b-422e-98aa-1e5e15b9181e', 'volume_name': 'volume-a319d27c-b15b-422e-98aa-1e5e15b9181e', 'volume_size': 1, 'image_id': '1a11c21d-88b0-4620-aa82-1ded26f580c9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1a11c21d-88b0-4620-aa82-1ded26f580c9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b800784c68dc485682fd42484c46336e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1a11c21d-88b0-4620-aa82-1ded26f580c9', 'created_at': datetime.datetime(2026, 9, 28, 7, 16, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 7, 16, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a11c21d-88b0-4620-aa82-1ded26f580c9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:24:06 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-fda73e0d-23ef-453e-9327-fedf2dacbce8 tempest-ServerActionsTestOtherA-711372344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1f63a1f-339d-46d6-838b-8b512c383aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:24:06 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-fda73e0d-23ef-453e-9327-fedf2dacbce8 tempest-ServerActionsTestOtherA-711372344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1f63a1f-339d-46d6-838b-8b512c383aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:24:06 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-fda73e0d-23ef-453e-9327-fedf2dacbce8 tempest-ServerActionsTestOtherA-711372344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7e70d48-496a-43dc-924f-127d96a18c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:24:06 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-fda73e0d-23ef-453e-9327-fedf2dacbce8 tempest-ServerActionsTestOtherA-711372344 None] Volume a319d27c-b15b-422e-98aa-1e5e15b9181e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a319d27c-b15b-422e-98aa-1e5e15b9181e', 'volume_size': 1, 'image_id': '1a11c21d-88b0-4620-aa82-1ded26f580c9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1a11c21d-88b0-4620-aa82-1ded26f580c9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b800784c68dc485682fd42484c46336e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1a11c21d-88b0-4620-aa82-1ded26f580c9', 'created_at': datetime.datetime(2026, 9, 28, 7, 16, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 7, 16, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a11c21d-88b0-4620-aa82-1ded26f580c9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 09:24:06 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-fda73e0d-23ef-453e-9327-fedf2dacbce8 tempest-ServerActionsTestOtherA-711372344 None] Trying to clone a319d27c-b15b-422e-98aa-1e5e15b9181e from image 1a11c21d-88b0-4620-aa82-1ded26f580c9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1a11c21d-88b0-4620-aa82-1ded26f580c9', 'metadata': {}}]). {{(pid=86553) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 09:24:07 devstack sudo[90142]: pam_unix(sudo:session): session closed for user root Sep 28 09:24:07 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-69900f0d-cb9d-45c8-a908-66c7717e36bf tempest-VolumeTypesAccessTest-88322730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-92da7712-2231-4ae2-9959-7aaf6a00cb7d" returned: 0 in 0.863s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:24:07 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-69900f0d-cb9d-45c8-a908-66c7717e36bf tempest-VolumeTypesAccessTest-88322730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-92da7712-2231-4ae2-9959-7aaf6a00cb7d {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:24:07 devstack sudo[90178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-92da7712-2231-4ae2-9959-7aaf6a00cb7d Sep 28 09:24:07 devstack sudo[90178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:24:07 devstack cinder-volume[86553]: DEBUG cinder.image.image_utils [None req-fda73e0d-23ef-453e-9327-fedf2dacbce8 tempest-ServerActionsTestOtherA-711372344 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1a11c21d-88b0-4620-aa82-1ded26f580c9_8owlzrqrdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86553) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 09:24:07 devstack cinder-volume[86553]: INFO cinder.image.image_utils [None req-fda73e0d-23ef-453e-9327-fedf2dacbce8 tempest-ServerActionsTestOtherA-711372344 None] Image download 20.69 MB at 20.69 MB/s Sep 28 09:24:07 devstack sudo[90178]: pam_unix(sudo:session): session closed for user root Sep 28 09:24:07 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-69900f0d-cb9d-45c8-a908-66c7717e36bf tempest-VolumeTypesAccessTest-88322730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-92da7712-2231-4ae2-9959-7aaf6a00cb7d" returned: 0 in 0.443s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:24:07 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-69900f0d-cb9d-45c8-a908-66c7717e36bf tempest-VolumeTypesAccessTest-88322730 None] Lock "cinder-quobyte-92da7712-2231-4ae2-9959-7aaf6a00cb7d" released by "delete_volume" :: held 1.387s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:24:07 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[dad2c9a8-4ec5-4ce5-8514-ddce0cc5d001]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:24:07 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-fda73e0d-23ef-453e-9327-fedf2dacbce8 tempest-ServerActionsTestOtherA-711372344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1a11c21d-88b0-4620-aa82-1ded26f580c9_8owlzrqrdevstack@QuobyteHD {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:24:07 devstack cinder-volume[86553]: WARNING cinder.quota [None req-69900f0d-cb9d-45c8-a908-66c7717e36bf tempest-VolumeTypesAccessTest-88322730 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-123359082 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-123359082, it is now deprecated. Please use the default quota class for default quota. Sep 28 09:24:07 devstack cinder-volume[86553]: WARNING cinder.quota [None req-69900f0d-cb9d-45c8-a908-66c7717e36bf tempest-VolumeTypesAccessTest-88322730 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-123359082 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-123359082, it is now deprecated. Please use the default quota class for default quota. Sep 28 09:24:07 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-69900f0d-cb9d-45c8-a908-66c7717e36bf tempest-VolumeTypesAccessTest-88322730 None] Created reservations ['3e15e754-ec96-498f-957f-0180f240892b', '734abd7c-18f9-4fc4-b31c-7bd691737cf4', 'ded738aa-a3b9-414c-9496-4569979f5ae8', 'd8d09fc9-2141-41b2-9f95-b23759ad3616'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:24:07 devstack sudo[90185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1a11c21d-88b0-4620-aa82-1ded26f580c9_8owlzrqrdevstack@QuobyteHD Sep 28 09:24:07 devstack sudo[90185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:24:07 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-69900f0d-cb9d-45c8-a908-66c7717e36bf tempest-VolumeTypesAccessTest-88322730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:24:07 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-69900f0d-cb9d-45c8-a908-66c7717e36bf tempest-VolumeTypesAccessTest-88322730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:24:07 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-69900f0d-cb9d-45c8-a908-66c7717e36bf tempest-VolumeTypesAccessTest-88322730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:24:07 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-69900f0d-cb9d-45c8-a908-66c7717e36bf tempest-VolumeTypesAccessTest-88322730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:24:07 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-69900f0d-cb9d-45c8-a908-66c7717e36bf tempest-VolumeTypesAccessTest-88322730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:24:07 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-69900f0d-cb9d-45c8-a908-66c7717e36bf tempest-VolumeTypesAccessTest-88322730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:24:07 devstack sudo[90187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:24:07 devstack sudo[90187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:24:08 devstack sudo[90185]: pam_unix(sudo:session): session closed for user root Sep 28 09:24:08 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-fda73e0d-23ef-453e-9327-fedf2dacbce8 tempest-ServerActionsTestOtherA-711372344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1a11c21d-88b0-4620-aa82-1ded26f580c9_8owlzrqrdevstack@QuobyteHD" returned: 0 in 0.595s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:24:08 devstack cinder-volume[86553]: DEBUG cinder.image.image_utils [None req-fda73e0d-23ef-453e-9327-fedf2dacbce8 tempest-ServerActionsTestOtherA-711372344 None] Temporary image 1a11c21d-88b0-4620-aa82-1ded26f580c9 is fetched for user b362b982dcdc42cf8b1041a20b0e9f8b. {{(pid=86553) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 09:24:08 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf861af-7a90-4e07-959c-2dc5bdf31e98]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:24:08 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-fda73e0d-23ef-453e-9327-fedf2dacbce8 tempest-ServerActionsTestOtherA-711372344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1a11c21d-88b0-4620-aa82-1ded26f580c9_8owlzrqrdevstack@QuobyteHD {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:24:08 devstack sudo[90187]: pam_unix(sudo:session): session closed for user root Sep 28 09:24:08 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-69900f0d-cb9d-45c8-a908-66c7717e36bf tempest-VolumeTypesAccessTest-88322730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.621s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:24:08 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-69900f0d-cb9d-45c8-a908-66c7717e36bf tempest-VolumeTypesAccessTest-88322730 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:24:08 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-69900f0d-cb9d-45c8-a908-66c7717e36bf tempest-VolumeTypesAccessTest-88322730 None] Deleted volume successfully. Sep 28 09:24:08 devstack sudo[90199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1a11c21d-88b0-4620-aa82-1ded26f580c9_8owlzrqrdevstack@QuobyteHD Sep 28 09:24:08 devstack sudo[90199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:24:08 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-69900f0d-cb9d-45c8-a908-66c7717e36bf tempest-VolumeTypesAccessTest-88322730 None] Lock "cinder-92da7712-2231-4ae2-9959-7aaf6a00cb7d-delete_volume" released by "delete_volume" :: held 2.603s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:24:08 devstack sudo[90199]: pam_unix(sudo:session): session closed for user root Sep 28 09:24:08 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-fda73e0d-23ef-453e-9327-fedf2dacbce8 tempest-ServerActionsTestOtherA-711372344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1a11c21d-88b0-4620-aa82-1ded26f580c9_8owlzrqrdevstack@QuobyteHD" returned: 0 in 0.569s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:24:08 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-fda73e0d-23ef-453e-9327-fedf2dacbce8 tempest-ServerActionsTestOtherA-711372344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:24:08 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-fda73e0d-23ef-453e-9327-fedf2dacbce8 tempest-ServerActionsTestOtherA-711372344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:24:08 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-fda73e0d-23ef-453e-9327-fedf2dacbce8 tempest-ServerActionsTestOtherA-711372344 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:24:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-462584152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a319d27c-b15b-422e-98aa-1e5e15b9181e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbcfee92ae24456da32e409ba3c3bd90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:24:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:24:06Z,use_quota=True,user_id='b362b982dcdc42cf8b1041a20b0e9f8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:24:08 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-fda73e0d-23ef-453e-9327-fedf2dacbce8 tempest-ServerActionsTestOtherA-711372344 None] Creating volume a319d27c-b15b-422e-98aa-1e5e15b9181e {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:24:08 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-fda73e0d-23ef-453e-9327-fedf2dacbce8 tempest-ServerActionsTestOtherA-711372344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:24:08 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-fda73e0d-23ef-453e-9327-fedf2dacbce8 tempest-ServerActionsTestOtherA-711372344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:24:08 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-fda73e0d-23ef-453e-9327-fedf2dacbce8 tempest-ServerActionsTestOtherA-711372344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:24:08 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-fda73e0d-23ef-453e-9327-fedf2dacbce8 tempest-ServerActionsTestOtherA-711372344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:24:08 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-fda73e0d-23ef-453e-9327-fedf2dacbce8 tempest-ServerActionsTestOtherA-711372344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:24:08 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-fda73e0d-23ef-453e-9327-fedf2dacbce8 tempest-ServerActionsTestOtherA-711372344 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:24:08 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-fda73e0d-23ef-453e-9327-fedf2dacbce8 tempest-ServerActionsTestOtherA-711372344 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:24:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-fda73e0d-23ef-453e-9327-fedf2dacbce8 tempest-ServerActionsTestOtherA-711372344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a319d27c-b15b-422e-98aa-1e5e15b9181e 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:24:09 devstack sudo[90246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a319d27c-b15b-422e-98aa-1e5e15b9181e 1073741824 Sep 28 09:24:09 devstack sudo[90246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:24:10 devstack sudo[90246]: pam_unix(sudo:session): session closed for user root Sep 28 09:24:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-fda73e0d-23ef-453e-9327-fedf2dacbce8 tempest-ServerActionsTestOtherA-711372344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a319d27c-b15b-422e-98aa-1e5e15b9181e 1073741824" returned: 0 in 1.250s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:24:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-fda73e0d-23ef-453e-9327-fedf2dacbce8 tempest-ServerActionsTestOtherA-711372344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a319d27c-b15b-422e-98aa-1e5e15b9181e {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:24:10 devstack sudo[90258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a319d27c-b15b-422e-98aa-1e5e15b9181e Sep 28 09:24:10 devstack sudo[90258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:24:10 devstack sudo[90258]: pam_unix(sudo:session): session closed for user root Sep 28 09:24:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-fda73e0d-23ef-453e-9327-fedf2dacbce8 tempest-ServerActionsTestOtherA-711372344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a319d27c-b15b-422e-98aa-1e5e15b9181e" returned: 0 in 0.488s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:24:10 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-fda73e0d-23ef-453e-9327-fedf2dacbce8 tempest-ServerActionsTestOtherA-711372344 None] <== create_volume: return (1868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:24:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-fda73e0d-23ef-453e-9327-fedf2dacbce8 tempest-ServerActionsTestOtherA-711372344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.872s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:24:10 devstack cinder-volume[86553]: DEBUG cinder.volume.volume_utils [None req-fda73e0d-23ef-453e-9327-fedf2dacbce8 tempest-ServerActionsTestOtherA-711372344 None] Attempting download of 1a11c21d-88b0-4620-aa82-1ded26f580c9 ((None, [{'url': 'file:///opt/stack/data/glance/images/1a11c21d-88b0-4620-aa82-1ded26f580c9', 'metadata': {}}])) to volume a319d27c-b15b-422e-98aa-1e5e15b9181e. {{(pid=86553) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 09:24:10 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a8df0cb-e1ea-40a1-82f5-1e8db6bc2107]: (4, 'raw') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:24:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-fda73e0d-23ef-453e-9327-fedf2dacbce8 tempest-ServerActionsTestOtherA-711372344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1a11c21d-88b0-4620-aa82-1ded26f580c9_ltrc6dpt {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:24:11 devstack sudo[90261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1a11c21d-88b0-4620-aa82-1ded26f580c9_ltrc6dpt Sep 28 09:24:11 devstack sudo[90261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:24:11 devstack sudo[90261]: pam_unix(sudo:session): session closed for user root Sep 28 09:24:11 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-fda73e0d-23ef-453e-9327-fedf2dacbce8 tempest-ServerActionsTestOtherA-711372344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1a11c21d-88b0-4620-aa82-1ded26f580c9_ltrc6dpt" returned: 0 in 0.538s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:24:11 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-fda73e0d-23ef-453e-9327-fedf2dacbce8 tempest-ServerActionsTestOtherA-711372344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1a11c21d-88b0-4620-aa82-1ded26f580c9_ltrc6dpt {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:24:11 devstack sudo[90268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1a11c21d-88b0-4620-aa82-1ded26f580c9_ltrc6dpt Sep 28 09:24:11 devstack sudo[90268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:24:11 devstack sudo[90268]: pam_unix(sudo:session): session closed for user root Sep 28 09:24:11 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-fda73e0d-23ef-453e-9327-fedf2dacbce8 tempest-ServerActionsTestOtherA-711372344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1a11c21d-88b0-4620-aa82-1ded26f580c9_ltrc6dpt" returned: 1 in 0.444s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:24:11 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-fda73e0d-23ef-453e-9327-fedf2dacbce8 tempest-ServerActionsTestOtherA-711372344 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1a11c21d-88b0-4620-aa82-1ded26f580c9_ltrc6dpt' failed. Not Retrying. {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 09:24:11 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d720ce-cf31-44ae-aebb-aa6b93f3b37b]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:24:11 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-fda73e0d-23ef-453e-9327-fedf2dacbce8 tempest-ServerActionsTestOtherA-711372344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1a11c21d-88b0-4620-aa82-1ded26f580c9_8owlzrqrdevstack@QuobyteHD {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:24:12 devstack sudo[90273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1a11c21d-88b0-4620-aa82-1ded26f580c9_8owlzrqrdevstack@QuobyteHD Sep 28 09:24:12 devstack sudo[90273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:24:12 devstack sudo[90273]: pam_unix(sudo:session): session closed for user root Sep 28 09:24:12 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-fda73e0d-23ef-453e-9327-fedf2dacbce8 tempest-ServerActionsTestOtherA-711372344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1a11c21d-88b0-4620-aa82-1ded26f580c9_8owlzrqrdevstack@QuobyteHD" returned: 0 in 0.686s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:24:12 devstack cinder-volume[86553]: DEBUG cinder.image.image_utils [None req-fda73e0d-23ef-453e-9327-fedf2dacbce8 tempest-ServerActionsTestOtherA-711372344 None] 1a11c21d-88b0-4620-aa82-1ded26f580c9 was qcow2, converting to qcow2 {{(pid=86553) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 09:24:12 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-fda73e0d-23ef-453e-9327-fedf2dacbce8 tempest-ServerActionsTestOtherA-711372344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1a11c21d-88b0-4620-aa82-1ded26f580c9_8owlzrqrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a319d27c-b15b-422e-98aa-1e5e15b9181e {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:24:12 devstack sudo[90279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1a11c21d-88b0-4620-aa82-1ded26f580c9_8owlzrqrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a319d27c-b15b-422e-98aa-1e5e15b9181e Sep 28 09:24:12 devstack sudo[90279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:24:16 devstack sudo[90279]: pam_unix(sudo:session): session closed for user root Sep 28 09:24:16 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-fda73e0d-23ef-453e-9327-fedf2dacbce8 tempest-ServerActionsTestOtherA-711372344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1a11c21d-88b0-4620-aa82-1ded26f580c9_8owlzrqrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a319d27c-b15b-422e-98aa-1e5e15b9181e" returned: 0 in 3.384s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:24:16 devstack cinder-volume[86553]: DEBUG cinder.image.image_utils [None req-fda73e0d-23ef-453e-9327-fedf2dacbce8 tempest-ServerActionsTestOtherA-711372344 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1a11c21d-88b0-4620-aa82-1ded26f580c9_8owlzrqrdevstack@QuobyteHD, size 112.00 MB, duration 3.39 sec, destination /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a319d27c-b15b-422e-98aa-1e5e15b9181e {{(pid=86553) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 09:24:16 devstack cinder-volume[86553]: INFO cinder.image.image_utils [None req-fda73e0d-23ef-453e-9327-fedf2dacbce8 tempest-ServerActionsTestOtherA-711372344 None] Converted 112.00 MB image at 33.02 MB/s Sep 28 09:24:16 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-fda73e0d-23ef-453e-9327-fedf2dacbce8 tempest-ServerActionsTestOtherA-711372344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a319d27c-b15b-422e-98aa-1e5e15b9181e 1G {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:24:16 devstack sudo[90305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a319d27c-b15b-422e-98aa-1e5e15b9181e 1G Sep 28 09:24:16 devstack sudo[90305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:24:16 devstack sudo[90305]: pam_unix(sudo:session): session closed for user root Sep 28 09:24:16 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-fda73e0d-23ef-453e-9327-fedf2dacbce8 tempest-ServerActionsTestOtherA-711372344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a319d27c-b15b-422e-98aa-1e5e15b9181e 1G" returned: 0 in 0.605s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:24:16 devstack cinder-volume[86553]: DEBUG cinder.volume.volume_utils [None req-fda73e0d-23ef-453e-9327-fedf2dacbce8 tempest-ServerActionsTestOtherA-711372344 None] Downloaded image 1a11c21d-88b0-4620-aa82-1ded26f580c9 ((None, [{'url': 'file:///opt/stack/data/glance/images/1a11c21d-88b0-4620-aa82-1ded26f580c9', 'metadata': {}}])) to volume a319d27c-b15b-422e-98aa-1e5e15b9181e successfully. {{(pid=86553) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 09:24:16 devstack cinder-volume[86553]: DEBUG cinder.image.image_utils [None req-fda73e0d-23ef-453e-9327-fedf2dacbce8 tempest-ServerActionsTestOtherA-711372344 None] Temporary image 1a11c21d-88b0-4620-aa82-1ded26f580c9 for user b362b982dcdc42cf8b1041a20b0e9f8b is deleted. {{(pid=86553) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 09:24:16 devstack cinder-volume[86553]: DEBUG cinder.volume.volume_utils [None req-fda73e0d-23ef-453e-9327-fedf2dacbce8 tempest-ServerActionsTestOtherA-711372344 None] Marking volume a319d27c-b15b-422e-98aa-1e5e15b9181e as bootable. {{(pid=86553) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 09:24:16 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-fda73e0d-23ef-453e-9327-fedf2dacbce8 tempest-ServerActionsTestOtherA-711372344 None] Copying metadata from image 1a11c21d-88b0-4620-aa82-1ded26f580c9 to a319d27c-b15b-422e-98aa-1e5e15b9181e. {{(pid=86553) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 09:24:16 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-fda73e0d-23ef-453e-9327-fedf2dacbce8 tempest-ServerActionsTestOtherA-711372344 None] Creating volume glance metadata for volume a319d27c-b15b-422e-98aa-1e5e15b9181e backed by image 1a11c21d-88b0-4620-aa82-1ded26f580c9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '1a11c21d-88b0-4620-aa82-1ded26f580c9', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86553) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 09:24:16 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-fda73e0d-23ef-453e-9327-fedf2dacbce8 tempest-ServerActionsTestOtherA-711372344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7e70d48-496a-43dc-924f-127d96a18c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a319d27c-b15b-422e-98aa-1e5e15b9181e', 'volume_size': 1, 'image_id': '1a11c21d-88b0-4620-aa82-1ded26f580c9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1a11c21d-88b0-4620-aa82-1ded26f580c9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b800784c68dc485682fd42484c46336e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1a11c21d-88b0-4620-aa82-1ded26f580c9', 'created_at': datetime.datetime(2026, 9, 28, 7, 16, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 7, 16, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a11c21d-88b0-4620-aa82-1ded26f580c9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:24:16 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-fda73e0d-23ef-453e-9327-fedf2dacbce8 tempest-ServerActionsTestOtherA-711372344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d3c7ebd-f612-464b-b657-fe6d386751eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:24:16 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-fda73e0d-23ef-453e-9327-fedf2dacbce8 tempest-ServerActionsTestOtherA-711372344 None] Volume volume-a319d27c-b15b-422e-98aa-1e5e15b9181e (a319d27c-b15b-422e-98aa-1e5e15b9181e): created successfully Sep 28 09:24:16 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-fda73e0d-23ef-453e-9327-fedf2dacbce8 tempest-ServerActionsTestOtherA-711372344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d3c7ebd-f612-464b-b657-fe6d386751eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:24:16 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-fda73e0d-23ef-453e-9327-fedf2dacbce8 tempest-ServerActionsTestOtherA-711372344 None] Flow 'volume_create_manager' (c72f1922-42e8-4e9e-a29e-ad78d8862310) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:24:16 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-fda73e0d-23ef-453e-9327-fedf2dacbce8 tempest-ServerActionsTestOtherA-711372344 None] Created volume successfully. Sep 28 09:24:21 devstack cinder-volume[86553]: DEBUG oslo_service.periodic_task [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86553) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 09:24:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:24:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:24:21 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:24:21 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:24:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:24:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:24:21 devstack sudo[90363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:24:21 devstack sudo[90363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:24:22 devstack sudo[90363]: pam_unix(sudo:session): session closed for user root Sep 28 09:24:22 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.573s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:24:22 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:24:22 devstack cinder-volume[86553]: DEBUG oslo_service.periodic_task [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Running periodic task VolumeManager._thread_info {{(pid=86553) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 09:24:22 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] thread count: 28 {{(pid=86553) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 09:24:22 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] thread info: [<_MainThread(MainThread, started 134684877779072)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86553) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 09:24:24 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-7b244a9b-e892-4d08-8b75-5b75105c0dfc req-c7b3a21a-e1b8-4435-9a6f-9623077903c4 tempest-ServerActionsTestOtherA-711372344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:24:24 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-7b244a9b-e892-4d08-8b75-5b75105c0dfc req-c7b3a21a-e1b8-4435-9a6f-9623077903c4 tempest-ServerActionsTestOtherA-711372344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:24:24 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-7b244a9b-e892-4d08-8b75-5b75105c0dfc req-c7b3a21a-e1b8-4435-9a6f-9623077903c4 tempest-ServerActionsTestOtherA-711372344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.061s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:24:24 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [req-7b244a9b-e892-4d08-8b75-5b75105c0dfc req-c7b3a21a-e1b8-4435-9a6f-9623077903c4 tempest-ServerActionsTestOtherA-711372344 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d', 'name': 'volume-a319d27c-b15b-422e-98aa-1e5e15b9181e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6b0a72b1-b3a7-4809-815c-98de4950edd1', 'enforce_multipath': True} {{(pid=86553) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 09:24:24 devstack cinder-volume[86553]: INFO cinder.volume.manager [req-7b244a9b-e892-4d08-8b75-5b75105c0dfc req-c7b3a21a-e1b8-4435-9a6f-9623077903c4 tempest-ServerActionsTestOtherA-711372344 None] attachment_update completed successfully. Sep 28 09:24:31 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5644ce7-52dc-4412-81a5-21a8a60e3df9 tempest-ServersNegativeTestJSON-508632701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:24:31 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-c5644ce7-52dc-4412-81a5-21a8a60e3df9 tempest-ServersNegativeTestJSON-508632701 None] Flow 'volume_create_manager' (ff850824-6251-4032-98ce-82ef554d18b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:24:31 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-c5644ce7-52dc-4412-81a5-21a8a60e3df9 tempest-ServersNegativeTestJSON-508632701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86a79a83-9c8e-451d-b656-0441fedcb304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:24:31 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-c5644ce7-52dc-4412-81a5-21a8a60e3df9 tempest-ServersNegativeTestJSON-508632701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86a79a83-9c8e-451d-b656-0441fedcb304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:24:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-463127896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37e02666-dc70-4563-b386-7a9cfcc07d1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91634633e4764e6a9260a98aee341512',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:24:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:24:32Z,use_quota=True,user_id='f38c27f9ad484aeebbf460134ee7d2d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:24:31 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-c5644ce7-52dc-4412-81a5-21a8a60e3df9 tempest-ServersNegativeTestJSON-508632701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ec3f353-5f5d-41b3-a99d-be72de7ebad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:24:32 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-c5644ce7-52dc-4412-81a5-21a8a60e3df9 tempest-ServersNegativeTestJSON-508632701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ec3f353-5f5d-41b3-a99d-be72de7ebad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:24:32 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-c5644ce7-52dc-4412-81a5-21a8a60e3df9 tempest-ServersNegativeTestJSON-508632701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04bb5149-8dca-4417-a116-aea3ddb13236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:24:32 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-c5644ce7-52dc-4412-81a5-21a8a60e3df9 tempest-ServersNegativeTestJSON-508632701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04bb5149-8dca-4417-a116-aea3ddb13236) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37e02666-dc70-4563-b386-7a9cfcc07d1e', 'volume_name': 'volume-37e02666-dc70-4563-b386-7a9cfcc07d1e', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:24:32 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-c5644ce7-52dc-4412-81a5-21a8a60e3df9 tempest-ServersNegativeTestJSON-508632701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (082c592b-d34a-4408-b578-7e8c9549b9c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:24:32 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-c5644ce7-52dc-4412-81a5-21a8a60e3df9 tempest-ServersNegativeTestJSON-508632701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (082c592b-d34a-4408-b578-7e8c9549b9c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:24:32 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-c5644ce7-52dc-4412-81a5-21a8a60e3df9 tempest-ServersNegativeTestJSON-508632701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e91be92f-33ce-4ca9-8143-730cd9875ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:24:32 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-c5644ce7-52dc-4412-81a5-21a8a60e3df9 tempest-ServersNegativeTestJSON-508632701 None] Volume 37e02666-dc70-4563-b386-7a9cfcc07d1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37e02666-dc70-4563-b386-7a9cfcc07d1e', 'volume_size': 1} Sep 28 09:24:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-c5644ce7-52dc-4412-81a5-21a8a60e3df9 tempest-ServersNegativeTestJSON-508632701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:24:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-c5644ce7-52dc-4412-81a5-21a8a60e3df9 tempest-ServersNegativeTestJSON-508632701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:24:32 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-c5644ce7-52dc-4412-81a5-21a8a60e3df9 tempest-ServersNegativeTestJSON-508632701 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:24:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-463127896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37e02666-dc70-4563-b386-7a9cfcc07d1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91634633e4764e6a9260a98aee341512',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:24:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:24:32Z,use_quota=True,user_id='f38c27f9ad484aeebbf460134ee7d2d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:24:32 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-c5644ce7-52dc-4412-81a5-21a8a60e3df9 tempest-ServersNegativeTestJSON-508632701 None] Creating volume 37e02666-dc70-4563-b386-7a9cfcc07d1e {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:24:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-c5644ce7-52dc-4412-81a5-21a8a60e3df9 tempest-ServersNegativeTestJSON-508632701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:24:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-c5644ce7-52dc-4412-81a5-21a8a60e3df9 tempest-ServersNegativeTestJSON-508632701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:24:32 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-c5644ce7-52dc-4412-81a5-21a8a60e3df9 tempest-ServersNegativeTestJSON-508632701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:24:32 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-c5644ce7-52dc-4412-81a5-21a8a60e3df9 tempest-ServersNegativeTestJSON-508632701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:24:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-c5644ce7-52dc-4412-81a5-21a8a60e3df9 tempest-ServersNegativeTestJSON-508632701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:24:32 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-c5644ce7-52dc-4412-81a5-21a8a60e3df9 tempest-ServersNegativeTestJSON-508632701 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:24:32 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-c5644ce7-52dc-4412-81a5-21a8a60e3df9 tempest-ServersNegativeTestJSON-508632701 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:24:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c5644ce7-52dc-4412-81a5-21a8a60e3df9 tempest-ServersNegativeTestJSON-508632701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-37e02666-dc70-4563-b386-7a9cfcc07d1e 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:24:32 devstack sudo[90931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-37e02666-dc70-4563-b386-7a9cfcc07d1e 1073741824 Sep 28 09:24:32 devstack sudo[90931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:24:32 devstack sudo[90931]: pam_unix(sudo:session): session closed for user root Sep 28 09:24:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c5644ce7-52dc-4412-81a5-21a8a60e3df9 tempest-ServersNegativeTestJSON-508632701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-37e02666-dc70-4563-b386-7a9cfcc07d1e 1073741824" returned: 0 in 0.614s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:24:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c5644ce7-52dc-4412-81a5-21a8a60e3df9 tempest-ServersNegativeTestJSON-508632701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-37e02666-dc70-4563-b386-7a9cfcc07d1e {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:24:32 devstack sudo[90937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-37e02666-dc70-4563-b386-7a9cfcc07d1e Sep 28 09:24:32 devstack sudo[90937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:24:33 devstack sudo[90937]: pam_unix(sudo:session): session closed for user root Sep 28 09:24:33 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c5644ce7-52dc-4412-81a5-21a8a60e3df9 tempest-ServersNegativeTestJSON-508632701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-37e02666-dc70-4563-b386-7a9cfcc07d1e" returned: 0 in 0.325s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:24:33 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-c5644ce7-52dc-4412-81a5-21a8a60e3df9 tempest-ServersNegativeTestJSON-508632701 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:24:33 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-c5644ce7-52dc-4412-81a5-21a8a60e3df9 tempest-ServersNegativeTestJSON-508632701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:24:33 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-c5644ce7-52dc-4412-81a5-21a8a60e3df9 tempest-ServersNegativeTestJSON-508632701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e91be92f-33ce-4ca9-8143-730cd9875ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37e02666-dc70-4563-b386-7a9cfcc07d1e', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:24:33 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-c5644ce7-52dc-4412-81a5-21a8a60e3df9 tempest-ServersNegativeTestJSON-508632701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e8d77b2-76f1-49fc-be6e-df81da72771d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:24:33 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-c5644ce7-52dc-4412-81a5-21a8a60e3df9 tempest-ServersNegativeTestJSON-508632701 None] Volume volume-37e02666-dc70-4563-b386-7a9cfcc07d1e (37e02666-dc70-4563-b386-7a9cfcc07d1e): created successfully Sep 28 09:24:33 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-c5644ce7-52dc-4412-81a5-21a8a60e3df9 tempest-ServersNegativeTestJSON-508632701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e8d77b2-76f1-49fc-be6e-df81da72771d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:24:33 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-c5644ce7-52dc-4412-81a5-21a8a60e3df9 tempest-ServersNegativeTestJSON-508632701 None] Flow 'volume_create_manager' (ff850824-6251-4032-98ce-82ef554d18b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:24:33 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-c5644ce7-52dc-4412-81a5-21a8a60e3df9 tempest-ServersNegativeTestJSON-508632701 None] Created volume successfully. Sep 28 09:24:37 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-c495c5e1-2bf7-40ec-8a24-be0e77a98e78 tempest-ServersNegativeTestJSON-508632701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:24:37 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-c495c5e1-2bf7-40ec-8a24-be0e77a98e78 tempest-ServersNegativeTestJSON-508632701 None] Flow 'volume_create_manager' (960fd160-8b58-49e7-8ad5-5ba0b7ceae5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:24:37 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-c495c5e1-2bf7-40ec-8a24-be0e77a98e78 tempest-ServersNegativeTestJSON-508632701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e6d62f6-89c2-463f-ad38-943cd31e55c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:24:37 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-c495c5e1-2bf7-40ec-8a24-be0e77a98e78 tempest-ServersNegativeTestJSON-508632701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e6d62f6-89c2-463f-ad38-943cd31e55c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:24:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-985660992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7955d80f-52c4-496d-ae4a-8f85b421e101,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91634633e4764e6a9260a98aee341512',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:24:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:24:37Z,use_quota=True,user_id='f38c27f9ad484aeebbf460134ee7d2d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:24:37 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-c495c5e1-2bf7-40ec-8a24-be0e77a98e78 tempest-ServersNegativeTestJSON-508632701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b911ce6-b08f-4d94-a9cd-ff16d226f1af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:24:37 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-c495c5e1-2bf7-40ec-8a24-be0e77a98e78 tempest-ServersNegativeTestJSON-508632701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b911ce6-b08f-4d94-a9cd-ff16d226f1af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:24:37 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-c495c5e1-2bf7-40ec-8a24-be0e77a98e78 tempest-ServersNegativeTestJSON-508632701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a55ec03f-1806-4a0b-a52d-57514697dc2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:24:37 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-c495c5e1-2bf7-40ec-8a24-be0e77a98e78 tempest-ServersNegativeTestJSON-508632701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a55ec03f-1806-4a0b-a52d-57514697dc2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7955d80f-52c4-496d-ae4a-8f85b421e101', 'volume_name': 'volume-7955d80f-52c4-496d-ae4a-8f85b421e101', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:24:37 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-c495c5e1-2bf7-40ec-8a24-be0e77a98e78 tempest-ServersNegativeTestJSON-508632701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b406f3d-ecd4-4dd9-8304-c66bbfc104ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:24:37 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-c495c5e1-2bf7-40ec-8a24-be0e77a98e78 tempest-ServersNegativeTestJSON-508632701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b406f3d-ecd4-4dd9-8304-c66bbfc104ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:24:37 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-c495c5e1-2bf7-40ec-8a24-be0e77a98e78 tempest-ServersNegativeTestJSON-508632701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3100aff6-45e2-4c42-a547-0056405d3cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:24:37 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-c495c5e1-2bf7-40ec-8a24-be0e77a98e78 tempest-ServersNegativeTestJSON-508632701 None] Volume 7955d80f-52c4-496d-ae4a-8f85b421e101: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7955d80f-52c4-496d-ae4a-8f85b421e101', 'volume_size': 1} Sep 28 09:24:37 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-c495c5e1-2bf7-40ec-8a24-be0e77a98e78 tempest-ServersNegativeTestJSON-508632701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:24:37 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-c495c5e1-2bf7-40ec-8a24-be0e77a98e78 tempest-ServersNegativeTestJSON-508632701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:24:37 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-c495c5e1-2bf7-40ec-8a24-be0e77a98e78 tempest-ServersNegativeTestJSON-508632701 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:24:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-985660992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7955d80f-52c4-496d-ae4a-8f85b421e101,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91634633e4764e6a9260a98aee341512',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:24:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:24:37Z,use_quota=True,user_id='f38c27f9ad484aeebbf460134ee7d2d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:24:37 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-c495c5e1-2bf7-40ec-8a24-be0e77a98e78 tempest-ServersNegativeTestJSON-508632701 None] Creating volume 7955d80f-52c4-496d-ae4a-8f85b421e101 {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:24:37 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-c495c5e1-2bf7-40ec-8a24-be0e77a98e78 tempest-ServersNegativeTestJSON-508632701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:24:37 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-c495c5e1-2bf7-40ec-8a24-be0e77a98e78 tempest-ServersNegativeTestJSON-508632701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:24:37 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-c495c5e1-2bf7-40ec-8a24-be0e77a98e78 tempest-ServersNegativeTestJSON-508632701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:24:37 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-c495c5e1-2bf7-40ec-8a24-be0e77a98e78 tempest-ServersNegativeTestJSON-508632701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:24:37 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-c495c5e1-2bf7-40ec-8a24-be0e77a98e78 tempest-ServersNegativeTestJSON-508632701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:24:37 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-c495c5e1-2bf7-40ec-8a24-be0e77a98e78 tempest-ServersNegativeTestJSON-508632701 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:24:37 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-c495c5e1-2bf7-40ec-8a24-be0e77a98e78 tempest-ServersNegativeTestJSON-508632701 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:24:37 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c495c5e1-2bf7-40ec-8a24-be0e77a98e78 tempest-ServersNegativeTestJSON-508632701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-7955d80f-52c4-496d-ae4a-8f85b421e101 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:24:37 devstack sudo[90996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-7955d80f-52c4-496d-ae4a-8f85b421e101 1073741824 Sep 28 09:24:37 devstack sudo[90996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:24:39 devstack sudo[90996]: pam_unix(sudo:session): session closed for user root Sep 28 09:24:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c495c5e1-2bf7-40ec-8a24-be0e77a98e78 tempest-ServersNegativeTestJSON-508632701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-7955d80f-52c4-496d-ae4a-8f85b421e101 1073741824" returned: 0 in 1.357s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:24:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c495c5e1-2bf7-40ec-8a24-be0e77a98e78 tempest-ServersNegativeTestJSON-508632701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-7955d80f-52c4-496d-ae4a-8f85b421e101 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:24:39 devstack sudo[91025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-7955d80f-52c4-496d-ae4a-8f85b421e101 Sep 28 09:24:39 devstack sudo[91025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:24:39 devstack sudo[91025]: pam_unix(sudo:session): session closed for user root Sep 28 09:24:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c495c5e1-2bf7-40ec-8a24-be0e77a98e78 tempest-ServersNegativeTestJSON-508632701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-7955d80f-52c4-496d-ae4a-8f85b421e101" returned: 0 in 0.458s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:24:39 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-c495c5e1-2bf7-40ec-8a24-be0e77a98e78 tempest-ServersNegativeTestJSON-508632701 None] <== create_volume: return (1965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:24:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-c495c5e1-2bf7-40ec-8a24-be0e77a98e78 tempest-ServersNegativeTestJSON-508632701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.971s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:24:39 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-c495c5e1-2bf7-40ec-8a24-be0e77a98e78 tempest-ServersNegativeTestJSON-508632701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3100aff6-45e2-4c42-a547-0056405d3cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7955d80f-52c4-496d-ae4a-8f85b421e101', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:24:39 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-c495c5e1-2bf7-40ec-8a24-be0e77a98e78 tempest-ServersNegativeTestJSON-508632701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb906a1b-52ee-4fd7-8f86-9e96b9536530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:24:39 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-c495c5e1-2bf7-40ec-8a24-be0e77a98e78 tempest-ServersNegativeTestJSON-508632701 None] Volume volume-7955d80f-52c4-496d-ae4a-8f85b421e101 (7955d80f-52c4-496d-ae4a-8f85b421e101): created successfully Sep 28 09:24:39 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-c495c5e1-2bf7-40ec-8a24-be0e77a98e78 tempest-ServersNegativeTestJSON-508632701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb906a1b-52ee-4fd7-8f86-9e96b9536530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:24:39 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-c495c5e1-2bf7-40ec-8a24-be0e77a98e78 tempest-ServersNegativeTestJSON-508632701 None] Flow 'volume_create_manager' (960fd160-8b58-49e7-8ad5-5ba0b7ceae5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:24:39 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-c495c5e1-2bf7-40ec-8a24-be0e77a98e78 tempest-ServersNegativeTestJSON-508632701 None] Created volume successfully. Sep 28 09:24:42 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-08dd4b93-1ab3-4aa7-86e4-6888b869c174 tempest-ServersNegativeTestJSON-508632701 None] Acquiring lock "cinder-7955d80f-52c4-496d-ae4a-8f85b421e101-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:24:42 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-08dd4b93-1ab3-4aa7-86e4-6888b869c174 tempest-ServersNegativeTestJSON-508632701 None] Lock "cinder-7955d80f-52c4-496d-ae4a-8f85b421e101-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:24:42 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-08dd4b93-1ab3-4aa7-86e4-6888b869c174 tempest-ServersNegativeTestJSON-508632701 None] Acquiring lock "cinder-quobyte-7955d80f-52c4-496d-ae4a-8f85b421e101" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:24:42 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-08dd4b93-1ab3-4aa7-86e4-6888b869c174 tempest-ServersNegativeTestJSON-508632701 None] Lock "cinder-quobyte-7955d80f-52c4-496d-ae4a-8f85b421e101" acquired by "delete_volume" :: waited 0.030s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:24:43 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[11113f26-a188-47d4-8d5b-871ea34789da]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:24:43 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-08dd4b93-1ab3-4aa7-86e4-6888b869c174 tempest-ServersNegativeTestJSON-508632701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-7955d80f-52c4-496d-ae4a-8f85b421e101 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:24:43 devstack sudo[91047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-7955d80f-52c4-496d-ae4a-8f85b421e101 Sep 28 09:24:43 devstack sudo[91047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:24:44 devstack sudo[91047]: pam_unix(sudo:session): session closed for user root Sep 28 09:24:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-08dd4b93-1ab3-4aa7-86e4-6888b869c174 tempest-ServersNegativeTestJSON-508632701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-7955d80f-52c4-496d-ae4a-8f85b421e101" returned: 0 in 1.124s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:24:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-08dd4b93-1ab3-4aa7-86e4-6888b869c174 tempest-ServersNegativeTestJSON-508632701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-7955d80f-52c4-496d-ae4a-8f85b421e101 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:24:44 devstack sudo[91053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-7955d80f-52c4-496d-ae4a-8f85b421e101 Sep 28 09:24:44 devstack sudo[91053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:24:44 devstack sudo[91053]: pam_unix(sudo:session): session closed for user root Sep 28 09:24:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-08dd4b93-1ab3-4aa7-86e4-6888b869c174 tempest-ServersNegativeTestJSON-508632701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-7955d80f-52c4-496d-ae4a-8f85b421e101" returned: 0 in 0.425s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:24:44 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-08dd4b93-1ab3-4aa7-86e4-6888b869c174 tempest-ServersNegativeTestJSON-508632701 None] Lock "cinder-quobyte-7955d80f-52c4-496d-ae4a-8f85b421e101" released by "delete_volume" :: held 1.722s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:24:44 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-08dd4b93-1ab3-4aa7-86e4-6888b869c174 tempest-ServersNegativeTestJSON-508632701 None] Created reservations ['b42969ea-9b10-4398-b664-057020af8670', 'b27fefcb-b5f9-4378-bbcb-989f2fbac436', '6b954b8d-0f54-4f18-ac7a-b3af773ad671', '72b922d7-5bed-4817-9345-552c00c2b2ba'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:24:45 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-08dd4b93-1ab3-4aa7-86e4-6888b869c174 tempest-ServersNegativeTestJSON-508632701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:24:45 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-08dd4b93-1ab3-4aa7-86e4-6888b869c174 tempest-ServersNegativeTestJSON-508632701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:24:45 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-08dd4b93-1ab3-4aa7-86e4-6888b869c174 tempest-ServersNegativeTestJSON-508632701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:24:45 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-08dd4b93-1ab3-4aa7-86e4-6888b869c174 tempest-ServersNegativeTestJSON-508632701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:24:45 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-08dd4b93-1ab3-4aa7-86e4-6888b869c174 tempest-ServersNegativeTestJSON-508632701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:24:45 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-08dd4b93-1ab3-4aa7-86e4-6888b869c174 tempest-ServersNegativeTestJSON-508632701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:24:45 devstack sudo[91056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:24:45 devstack sudo[91056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:24:45 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-c7a0271e-534e-49d3-aeb2-d441daa83e53 tempest-ServersNegativeTestJSON-508632701 None] Acquiring lock "cinder-37e02666-dc70-4563-b386-7a9cfcc07d1e-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:24:45 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-46723592-5d68-432a-8a62-ceaeab7a921e tempest-DeleteServersTestJSON-483484738 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:24:45 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-46723592-5d68-432a-8a62-ceaeab7a921e tempest-DeleteServersTestJSON-483484738 None] Flow 'volume_create_manager' (d8fa3665-de3b-429e-8a84-c6c29da98a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:24:45 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-46723592-5d68-432a-8a62-ceaeab7a921e tempest-DeleteServersTestJSON-483484738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (270b0a65-ae89-4c51-b298-86dbeff5c452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:24:45 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-46723592-5d68-432a-8a62-ceaeab7a921e tempest-DeleteServersTestJSON-483484738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (270b0a65-ae89-4c51-b298-86dbeff5c452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:24:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-85793451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dcc7527-5a3c-41bb-a26f-f7cfa4cde6a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c3ecbaaddb048b985a6fd8a3d415ac6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:24:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:24:45Z,use_quota=True,user_id='c9abfaac1265478a944ea5643d3e247c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:24:45 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-46723592-5d68-432a-8a62-ceaeab7a921e tempest-DeleteServersTestJSON-483484738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c13ce2ce-19fa-4756-84b4-f1f2151fe1a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:24:45 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-46723592-5d68-432a-8a62-ceaeab7a921e tempest-DeleteServersTestJSON-483484738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c13ce2ce-19fa-4756-84b4-f1f2151fe1a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:24:45 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-46723592-5d68-432a-8a62-ceaeab7a921e tempest-DeleteServersTestJSON-483484738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c92f29a3-8fa6-4050-9418-0b4e6bec9cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:24:45 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-46723592-5d68-432a-8a62-ceaeab7a921e tempest-DeleteServersTestJSON-483484738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c92f29a3-8fa6-4050-9418-0b4e6bec9cd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9dcc7527-5a3c-41bb-a26f-f7cfa4cde6a7', 'volume_name': 'volume-9dcc7527-5a3c-41bb-a26f-f7cfa4cde6a7', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:24:45 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-46723592-5d68-432a-8a62-ceaeab7a921e tempest-DeleteServersTestJSON-483484738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d2009b9-37eb-4880-9403-7da8a7fce4a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:24:45 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-46723592-5d68-432a-8a62-ceaeab7a921e tempest-DeleteServersTestJSON-483484738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d2009b9-37eb-4880-9403-7da8a7fce4a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:24:45 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-46723592-5d68-432a-8a62-ceaeab7a921e tempest-DeleteServersTestJSON-483484738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7940fc9c-db33-4193-8ae0-419ceaff4f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:24:45 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-46723592-5d68-432a-8a62-ceaeab7a921e tempest-DeleteServersTestJSON-483484738 None] Volume 9dcc7527-5a3c-41bb-a26f-f7cfa4cde6a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9dcc7527-5a3c-41bb-a26f-f7cfa4cde6a7', 'volume_size': 1} Sep 28 09:24:45 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-46723592-5d68-432a-8a62-ceaeab7a921e tempest-DeleteServersTestJSON-483484738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:24:45 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-46723592-5d68-432a-8a62-ceaeab7a921e tempest-DeleteServersTestJSON-483484738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:24:45 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-46723592-5d68-432a-8a62-ceaeab7a921e tempest-DeleteServersTestJSON-483484738 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:24:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-85793451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dcc7527-5a3c-41bb-a26f-f7cfa4cde6a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c3ecbaaddb048b985a6fd8a3d415ac6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:24:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:24:45Z,use_quota=True,user_id='c9abfaac1265478a944ea5643d3e247c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:24:45 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-46723592-5d68-432a-8a62-ceaeab7a921e tempest-DeleteServersTestJSON-483484738 None] Creating volume 9dcc7527-5a3c-41bb-a26f-f7cfa4cde6a7 {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:24:45 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-46723592-5d68-432a-8a62-ceaeab7a921e tempest-DeleteServersTestJSON-483484738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:24:45 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-46723592-5d68-432a-8a62-ceaeab7a921e tempest-DeleteServersTestJSON-483484738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:24:45 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-46723592-5d68-432a-8a62-ceaeab7a921e tempest-DeleteServersTestJSON-483484738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:24:45 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-46723592-5d68-432a-8a62-ceaeab7a921e tempest-DeleteServersTestJSON-483484738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:24:45 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-46723592-5d68-432a-8a62-ceaeab7a921e tempest-DeleteServersTestJSON-483484738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:24:45 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-46723592-5d68-432a-8a62-ceaeab7a921e tempest-DeleteServersTestJSON-483484738 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:24:45 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-46723592-5d68-432a-8a62-ceaeab7a921e tempest-DeleteServersTestJSON-483484738 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:24:45 devstack sudo[91056]: pam_unix(sudo:session): session closed for user root Sep 28 09:24:45 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-46723592-5d68-432a-8a62-ceaeab7a921e tempest-DeleteServersTestJSON-483484738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9dcc7527-5a3c-41bb-a26f-f7cfa4cde6a7 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:24:45 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-c7a0271e-534e-49d3-aeb2-d441daa83e53 tempest-ServersNegativeTestJSON-508632701 None] Lock "cinder-37e02666-dc70-4563-b386-7a9cfcc07d1e-delete_volume" acquired by "delete_volume" :: waited 0.456s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:24:45 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-08dd4b93-1ab3-4aa7-86e4-6888b869c174 tempest-ServersNegativeTestJSON-508632701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.844s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:24:45 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-08dd4b93-1ab3-4aa7-86e4-6888b869c174 tempest-ServersNegativeTestJSON-508632701 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:24:45 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-08dd4b93-1ab3-4aa7-86e4-6888b869c174 tempest-ServersNegativeTestJSON-508632701 None] Deleted volume successfully. Sep 28 09:24:45 devstack sudo[91059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9dcc7527-5a3c-41bb-a26f-f7cfa4cde6a7 1073741824 Sep 28 09:24:45 devstack sudo[91059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:24:46 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-08dd4b93-1ab3-4aa7-86e4-6888b869c174 tempest-ServersNegativeTestJSON-508632701 None] Lock "cinder-7955d80f-52c4-496d-ae4a-8f85b421e101-delete_volume" released by "delete_volume" :: held 3.149s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:24:46 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-c7a0271e-534e-49d3-aeb2-d441daa83e53 tempest-ServersNegativeTestJSON-508632701 None] Acquiring lock "cinder-quobyte-37e02666-dc70-4563-b386-7a9cfcc07d1e" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:24:46 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-c7a0271e-534e-49d3-aeb2-d441daa83e53 tempest-ServersNegativeTestJSON-508632701 None] Lock "cinder-quobyte-37e02666-dc70-4563-b386-7a9cfcc07d1e" acquired by "delete_volume" :: waited 0.059s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:24:46 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a15e3f-2f50-4f5e-9746-d259f1416a40]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:24:46 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c7a0271e-534e-49d3-aeb2-d441daa83e53 tempest-ServersNegativeTestJSON-508632701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-37e02666-dc70-4563-b386-7a9cfcc07d1e {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:24:46 devstack sudo[91061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-37e02666-dc70-4563-b386-7a9cfcc07d1e Sep 28 09:24:46 devstack sudo[91061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:24:47 devstack sudo[91059]: pam_unix(sudo:session): session closed for user root Sep 28 09:24:47 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-46723592-5d68-432a-8a62-ceaeab7a921e tempest-DeleteServersTestJSON-483484738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9dcc7527-5a3c-41bb-a26f-f7cfa4cde6a7 1073741824" returned: 0 in 1.185s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:24:47 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-46723592-5d68-432a-8a62-ceaeab7a921e tempest-DeleteServersTestJSON-483484738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9dcc7527-5a3c-41bb-a26f-f7cfa4cde6a7 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:24:47 devstack sudo[91061]: pam_unix(sudo:session): session closed for user root Sep 28 09:24:47 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c7a0271e-534e-49d3-aeb2-d441daa83e53 tempest-ServersNegativeTestJSON-508632701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-37e02666-dc70-4563-b386-7a9cfcc07d1e" returned: 0 in 0.973s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:24:47 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c7a0271e-534e-49d3-aeb2-d441daa83e53 tempest-ServersNegativeTestJSON-508632701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-37e02666-dc70-4563-b386-7a9cfcc07d1e {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:24:47 devstack sudo[91073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9dcc7527-5a3c-41bb-a26f-f7cfa4cde6a7 Sep 28 09:24:47 devstack sudo[91074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-37e02666-dc70-4563-b386-7a9cfcc07d1e Sep 28 09:24:47 devstack sudo[91073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:24:47 devstack sudo[91074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:24:47 devstack sudo[91074]: pam_unix(sudo:session): session closed for user root Sep 28 09:24:47 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c7a0271e-534e-49d3-aeb2-d441daa83e53 tempest-ServersNegativeTestJSON-508632701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-37e02666-dc70-4563-b386-7a9cfcc07d1e" returned: 0 in 0.698s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:24:47 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-c7a0271e-534e-49d3-aeb2-d441daa83e53 tempest-ServersNegativeTestJSON-508632701 None] Lock "cinder-quobyte-37e02666-dc70-4563-b386-7a9cfcc07d1e" released by "delete_volume" :: held 1.839s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:24:47 devstack sudo[91073]: pam_unix(sudo:session): session closed for user root Sep 28 09:24:47 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-46723592-5d68-432a-8a62-ceaeab7a921e tempest-DeleteServersTestJSON-483484738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9dcc7527-5a3c-41bb-a26f-f7cfa4cde6a7" returned: 0 in 0.798s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:24:47 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-46723592-5d68-432a-8a62-ceaeab7a921e tempest-DeleteServersTestJSON-483484738 None] <== create_volume: return (2121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:24:47 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-46723592-5d68-432a-8a62-ceaeab7a921e tempest-DeleteServersTestJSON-483484738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.127s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:24:48 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-46723592-5d68-432a-8a62-ceaeab7a921e tempest-DeleteServersTestJSON-483484738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7940fc9c-db33-4193-8ae0-419ceaff4f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9dcc7527-5a3c-41bb-a26f-f7cfa4cde6a7', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:24:48 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-46723592-5d68-432a-8a62-ceaeab7a921e tempest-DeleteServersTestJSON-483484738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (827d8a92-a8b8-46d7-8943-736203e4c454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:24:48 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-46723592-5d68-432a-8a62-ceaeab7a921e tempest-DeleteServersTestJSON-483484738 None] Volume volume-9dcc7527-5a3c-41bb-a26f-f7cfa4cde6a7 (9dcc7527-5a3c-41bb-a26f-f7cfa4cde6a7): created successfully Sep 28 09:24:48 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-46723592-5d68-432a-8a62-ceaeab7a921e tempest-DeleteServersTestJSON-483484738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (827d8a92-a8b8-46d7-8943-736203e4c454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:24:48 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-46723592-5d68-432a-8a62-ceaeab7a921e tempest-DeleteServersTestJSON-483484738 None] Flow 'volume_create_manager' (d8fa3665-de3b-429e-8a84-c6c29da98a25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:24:48 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-46723592-5d68-432a-8a62-ceaeab7a921e tempest-DeleteServersTestJSON-483484738 None] Created volume successfully. Sep 28 09:24:48 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-c7a0271e-534e-49d3-aeb2-d441daa83e53 tempest-ServersNegativeTestJSON-508632701 None] Created reservations ['430f049e-dc17-4213-a3ad-48b95184b6e3', '28771904-0516-4e99-84a2-d1b0f24d0bcc', '670e048d-d222-47d9-9132-dbfe2b171871', '03e95971-3f80-43fe-aab5-5ac1ad48e6cb'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:24:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-c7a0271e-534e-49d3-aeb2-d441daa83e53 tempest-ServersNegativeTestJSON-508632701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:24:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-c7a0271e-534e-49d3-aeb2-d441daa83e53 tempest-ServersNegativeTestJSON-508632701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:24:48 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-c7a0271e-534e-49d3-aeb2-d441daa83e53 tempest-ServersNegativeTestJSON-508632701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:24:48 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-c7a0271e-534e-49d3-aeb2-d441daa83e53 tempest-ServersNegativeTestJSON-508632701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:24:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-c7a0271e-534e-49d3-aeb2-d441daa83e53 tempest-ServersNegativeTestJSON-508632701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:24:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c7a0271e-534e-49d3-aeb2-d441daa83e53 tempest-ServersNegativeTestJSON-508632701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:24:48 devstack sudo[91079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:24:48 devstack sudo[91079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:24:48 devstack sudo[91079]: pam_unix(sudo:session): session closed for user root Sep 28 09:24:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c7a0271e-534e-49d3-aeb2-d441daa83e53 tempest-ServersNegativeTestJSON-508632701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.491s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:24:48 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-c7a0271e-534e-49d3-aeb2-d441daa83e53 tempest-ServersNegativeTestJSON-508632701 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:24:48 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-c7a0271e-534e-49d3-aeb2-d441daa83e53 tempest-ServersNegativeTestJSON-508632701 None] Deleted volume successfully. Sep 28 09:24:48 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-c7a0271e-534e-49d3-aeb2-d441daa83e53 tempest-ServersNegativeTestJSON-508632701 None] Lock "cinder-37e02666-dc70-4563-b386-7a9cfcc07d1e-delete_volume" released by "delete_volume" :: held 2.958s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:24:52 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-6916477e-ec9a-43a7-9e9e-5c50d2d11d0f req-b9b5c11c-adb0-4de4-a581-510e6b9f5e4a tempest-DeleteServersTestJSON-483484738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:24:52 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-6916477e-ec9a-43a7-9e9e-5c50d2d11d0f req-b9b5c11c-adb0-4de4-a581-510e6b9f5e4a tempest-DeleteServersTestJSON-483484738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:24:52 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-6916477e-ec9a-43a7-9e9e-5c50d2d11d0f req-b9b5c11c-adb0-4de4-a581-510e6b9f5e4a tempest-DeleteServersTestJSON-483484738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:24:52 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [req-6916477e-ec9a-43a7-9e9e-5c50d2d11d0f req-b9b5c11c-adb0-4de4-a581-510e6b9f5e4a tempest-DeleteServersTestJSON-483484738 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d', 'name': 'volume-9dcc7527-5a3c-41bb-a26f-f7cfa4cde6a7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '08d86c32-ca05-4684-9a3a-dfb6fdd35e36', 'enforce_multipath': True} {{(pid=86553) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 09:24:52 devstack cinder-volume[86553]: INFO cinder.volume.manager [req-6916477e-ec9a-43a7-9e9e-5c50d2d11d0f req-b9b5c11c-adb0-4de4-a581-510e6b9f5e4a tempest-DeleteServersTestJSON-483484738 None] attachment_update completed successfully. Sep 28 09:24:55 devstack cinder-volume[86553]: DEBUG dbcounter [-] [86553] Writing DB stats cinder:SELECT=52,cinder:UPDATE=41,cinder:INSERT=15,cinder:DELETE=2 {{(pid=86553) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 09:24:55 devstack cinder-volume[86553]: DEBUG dbcounter [-] [86553] Writing DB stats cinder:SELECT=43,cinder:UPDATE=46,cinder:DELETE=6,cinder:INSERT=15 {{(pid=86553) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 09:24:55 devstack cinder-volume[86553]: INFO cinder.volume.manager [req-9130ec2a-696c-46bb-9816-527ad7232da3 req-c2ca0c7d-5075-4886-8a2c-37078474e952 tempest-ServerActionsTestOtherA-711372344 None] Terminate volume connection completed successfully. Sep 28 09:24:55 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [req-9130ec2a-696c-46bb-9816-527ad7232da3 req-c2ca0c7d-5075-4886-8a2c-37078474e952 tempest-ServerActionsTestOtherA-711372344 None] Deleting attachment 6b0a72b1-b3a7-4809-815c-98de4950edd1. {{(pid=86553) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 09:24:59 devstack cinder-volume[86553]: INFO cinder.volume.manager [req-25b4f0c5-9af5-45b4-a54a-fcff800cd929 req-2e8467f2-4278-4d6b-8c68-daa8b39ffa77 tempest-DeleteServersTestJSON-483484738 None] Terminate volume connection completed successfully. Sep 28 09:24:59 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [req-25b4f0c5-9af5-45b4-a54a-fcff800cd929 req-2e8467f2-4278-4d6b-8c68-daa8b39ffa77 tempest-DeleteServersTestJSON-483484738 None] Deleting attachment 08d86c32-ca05-4684-9a3a-dfb6fdd35e36. {{(pid=86553) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 09:25:03 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-c788aae1-7cb8-46c2-a7ef-084e102bc0ac tempest-DeleteServersTestJSON-483484738 None] Acquiring lock "cinder-9dcc7527-5a3c-41bb-a26f-f7cfa4cde6a7-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:25:03 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-c788aae1-7cb8-46c2-a7ef-084e102bc0ac tempest-DeleteServersTestJSON-483484738 None] Lock "cinder-9dcc7527-5a3c-41bb-a26f-f7cfa4cde6a7-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:25:03 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-c788aae1-7cb8-46c2-a7ef-084e102bc0ac tempest-DeleteServersTestJSON-483484738 None] Acquiring lock "cinder-quobyte-9dcc7527-5a3c-41bb-a26f-f7cfa4cde6a7" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:25:03 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-c788aae1-7cb8-46c2-a7ef-084e102bc0ac tempest-DeleteServersTestJSON-483484738 None] Lock "cinder-quobyte-9dcc7527-5a3c-41bb-a26f-f7cfa4cde6a7" acquired by "delete_volume" :: waited 0.017s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:25:03 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[698aaa33-f48f-437b-bc82-69d62215b699]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:25:03 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c788aae1-7cb8-46c2-a7ef-084e102bc0ac tempest-DeleteServersTestJSON-483484738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9dcc7527-5a3c-41bb-a26f-f7cfa4cde6a7 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:25:03 devstack sudo[91230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9dcc7527-5a3c-41bb-a26f-f7cfa4cde6a7 Sep 28 09:25:03 devstack sudo[91230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:25:04 devstack sudo[91230]: pam_unix(sudo:session): session closed for user root Sep 28 09:25:04 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c788aae1-7cb8-46c2-a7ef-084e102bc0ac tempest-DeleteServersTestJSON-483484738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9dcc7527-5a3c-41bb-a26f-f7cfa4cde6a7" returned: 0 in 0.481s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:25:04 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c788aae1-7cb8-46c2-a7ef-084e102bc0ac tempest-DeleteServersTestJSON-483484738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9dcc7527-5a3c-41bb-a26f-f7cfa4cde6a7 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:25:04 devstack sudo[91236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9dcc7527-5a3c-41bb-a26f-f7cfa4cde6a7 Sep 28 09:25:04 devstack sudo[91236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:25:04 devstack sudo[91236]: pam_unix(sudo:session): session closed for user root Sep 28 09:25:04 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c788aae1-7cb8-46c2-a7ef-084e102bc0ac tempest-DeleteServersTestJSON-483484738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9dcc7527-5a3c-41bb-a26f-f7cfa4cde6a7" returned: 0 in 0.654s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:25:04 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-9130ec2a-696c-46bb-9816-527ad7232da3 req-76c409cd-ef27-4525-bef9-67940f0b90f9 tempest-ServerActionsTestOtherA-711372344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:25:04 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-9130ec2a-696c-46bb-9816-527ad7232da3 req-76c409cd-ef27-4525-bef9-67940f0b90f9 tempest-ServerActionsTestOtherA-711372344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:25:04 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-c788aae1-7cb8-46c2-a7ef-084e102bc0ac tempest-DeleteServersTestJSON-483484738 None] Lock "cinder-quobyte-9dcc7527-5a3c-41bb-a26f-f7cfa4cde6a7" released by "delete_volume" :: held 1.242s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:25:04 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-9130ec2a-696c-46bb-9816-527ad7232da3 req-76c409cd-ef27-4525-bef9-67940f0b90f9 tempest-ServerActionsTestOtherA-711372344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.039s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:25:04 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [req-9130ec2a-696c-46bb-9816-527ad7232da3 req-76c409cd-ef27-4525-bef9-67940f0b90f9 tempest-ServerActionsTestOtherA-711372344 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d', 'name': 'volume-a319d27c-b15b-422e-98aa-1e5e15b9181e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '314a5d77-1058-4a8f-8cd8-3d2593631f0e', 'enforce_multipath': True} {{(pid=86553) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 09:25:04 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-fac83a43-1c18-48ce-ae09-8063cb150555 tempest-VolumesActionsTest-1710709349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:25:04 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-fac83a43-1c18-48ce-ae09-8063cb150555 tempest-VolumesActionsTest-1710709349 None] Flow 'volume_create_manager' (48924500-01d9-457e-89ec-a25db3e903ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:25:05 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-fac83a43-1c18-48ce-ae09-8063cb150555 tempest-VolumesActionsTest-1710709349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a5f08d8-20a6-4072-9025-88639d1d4e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:25:05 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-fac83a43-1c18-48ce-ae09-8063cb150555 tempest-VolumesActionsTest-1710709349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a5f08d8-20a6-4072-9025-88639d1d4e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:25:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1046188928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13cba42c-0ecc-407c-9b9f-01ed5fa7c4ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dba2ba475c5345c1a056e271d3a26d15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:25:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:25:05Z,use_quota=True,user_id='622f35c0a0ad41fbbb227cc57925fdc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:25:05 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-fac83a43-1c18-48ce-ae09-8063cb150555 tempest-VolumesActionsTest-1710709349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19455b7a-049a-420e-9e6a-d9cf1712bdae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:25:05 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-fac83a43-1c18-48ce-ae09-8063cb150555 tempest-VolumesActionsTest-1710709349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19455b7a-049a-420e-9e6a-d9cf1712bdae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:25:05 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-fac83a43-1c18-48ce-ae09-8063cb150555 tempest-VolumesActionsTest-1710709349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a067b8f0-99eb-4b36-80f9-6e281061c860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:25:05 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-fac83a43-1c18-48ce-ae09-8063cb150555 tempest-VolumesActionsTest-1710709349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a067b8f0-99eb-4b36-80f9-6e281061c860) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13cba42c-0ecc-407c-9b9f-01ed5fa7c4ec', 'volume_name': 'volume-13cba42c-0ecc-407c-9b9f-01ed5fa7c4ec', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:25:05 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-fac83a43-1c18-48ce-ae09-8063cb150555 tempest-VolumesActionsTest-1710709349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1861eb0-84ee-4e92-9880-fcb548208b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:25:05 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-fac83a43-1c18-48ce-ae09-8063cb150555 tempest-VolumesActionsTest-1710709349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1861eb0-84ee-4e92-9880-fcb548208b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:25:05 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-fac83a43-1c18-48ce-ae09-8063cb150555 tempest-VolumesActionsTest-1710709349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b0bf92c-7c60-4b26-8d14-e00e5209a089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:25:05 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-fac83a43-1c18-48ce-ae09-8063cb150555 tempest-VolumesActionsTest-1710709349 None] Volume 13cba42c-0ecc-407c-9b9f-01ed5fa7c4ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13cba42c-0ecc-407c-9b9f-01ed5fa7c4ec', 'volume_size': 1} Sep 28 09:25:05 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-fac83a43-1c18-48ce-ae09-8063cb150555 tempest-VolumesActionsTest-1710709349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:25:05 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-fac83a43-1c18-48ce-ae09-8063cb150555 tempest-VolumesActionsTest-1710709349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:25:05 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-fac83a43-1c18-48ce-ae09-8063cb150555 tempest-VolumesActionsTest-1710709349 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:25:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1046188928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13cba42c-0ecc-407c-9b9f-01ed5fa7c4ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dba2ba475c5345c1a056e271d3a26d15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:25:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:25:05Z,use_quota=True,user_id='622f35c0a0ad41fbbb227cc57925fdc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:25:05 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-fac83a43-1c18-48ce-ae09-8063cb150555 tempest-VolumesActionsTest-1710709349 None] Creating volume 13cba42c-0ecc-407c-9b9f-01ed5fa7c4ec {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:25:05 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-fac83a43-1c18-48ce-ae09-8063cb150555 tempest-VolumesActionsTest-1710709349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:25:05 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-fac83a43-1c18-48ce-ae09-8063cb150555 tempest-VolumesActionsTest-1710709349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:25:05 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-fac83a43-1c18-48ce-ae09-8063cb150555 tempest-VolumesActionsTest-1710709349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:25:05 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-fac83a43-1c18-48ce-ae09-8063cb150555 tempest-VolumesActionsTest-1710709349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:25:05 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-fac83a43-1c18-48ce-ae09-8063cb150555 tempest-VolumesActionsTest-1710709349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:25:05 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-fac83a43-1c18-48ce-ae09-8063cb150555 tempest-VolumesActionsTest-1710709349 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:25:05 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-fac83a43-1c18-48ce-ae09-8063cb150555 tempest-VolumesActionsTest-1710709349 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:25:05 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-fac83a43-1c18-48ce-ae09-8063cb150555 tempest-VolumesActionsTest-1710709349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-13cba42c-0ecc-407c-9b9f-01ed5fa7c4ec 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:25:05 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-c788aae1-7cb8-46c2-a7ef-084e102bc0ac tempest-DeleteServersTestJSON-483484738 None] Created reservations ['bbfdf5d4-d2a7-4593-9027-01fe3c876109', '8525e5c3-4237-462a-bce4-404eec561acd', '64f02bfd-48a5-45f3-934b-1e9bafd203a7', '81ba0d00-5365-43ff-a4bb-1b2015f4f958'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:25:05 devstack sudo[91248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-13cba42c-0ecc-407c-9b9f-01ed5fa7c4ec 1073741824 Sep 28 09:25:05 devstack sudo[91248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:25:05 devstack cinder-volume[86553]: INFO cinder.volume.manager [req-9130ec2a-696c-46bb-9816-527ad7232da3 req-76c409cd-ef27-4525-bef9-67940f0b90f9 tempest-ServerActionsTestOtherA-711372344 None] attachment_update completed successfully. Sep 28 09:25:05 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-c788aae1-7cb8-46c2-a7ef-084e102bc0ac tempest-DeleteServersTestJSON-483484738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:25:05 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-c788aae1-7cb8-46c2-a7ef-084e102bc0ac tempest-DeleteServersTestJSON-483484738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:25:05 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-c788aae1-7cb8-46c2-a7ef-084e102bc0ac tempest-DeleteServersTestJSON-483484738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:25:05 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-c788aae1-7cb8-46c2-a7ef-084e102bc0ac tempest-DeleteServersTestJSON-483484738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:25:05 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-c788aae1-7cb8-46c2-a7ef-084e102bc0ac tempest-DeleteServersTestJSON-483484738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:25:05 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c788aae1-7cb8-46c2-a7ef-084e102bc0ac tempest-DeleteServersTestJSON-483484738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:25:05 devstack sudo[91250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:25:05 devstack sudo[91250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:25:05 devstack sudo[91250]: pam_unix(sudo:session): session closed for user root Sep 28 09:25:05 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c788aae1-7cb8-46c2-a7ef-084e102bc0ac tempest-DeleteServersTestJSON-483484738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.380s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:25:05 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-c788aae1-7cb8-46c2-a7ef-084e102bc0ac tempest-DeleteServersTestJSON-483484738 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:25:05 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-c788aae1-7cb8-46c2-a7ef-084e102bc0ac tempest-DeleteServersTestJSON-483484738 None] Deleted volume successfully. Sep 28 09:25:05 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-c788aae1-7cb8-46c2-a7ef-084e102bc0ac tempest-DeleteServersTestJSON-483484738 None] Lock "cinder-9dcc7527-5a3c-41bb-a26f-f7cfa4cde6a7-delete_volume" released by "delete_volume" :: held 2.148s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:25:05 devstack sudo[91248]: pam_unix(sudo:session): session closed for user root Sep 28 09:25:05 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-fac83a43-1c18-48ce-ae09-8063cb150555 tempest-VolumesActionsTest-1710709349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-13cba42c-0ecc-407c-9b9f-01ed5fa7c4ec 1073741824" returned: 0 in 0.846s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:25:05 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-fac83a43-1c18-48ce-ae09-8063cb150555 tempest-VolumesActionsTest-1710709349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-13cba42c-0ecc-407c-9b9f-01ed5fa7c4ec {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:25:06 devstack sudo[91488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-13cba42c-0ecc-407c-9b9f-01ed5fa7c4ec Sep 28 09:25:06 devstack sudo[91488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:25:06 devstack sudo[91488]: pam_unix(sudo:session): session closed for user root Sep 28 09:25:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-fac83a43-1c18-48ce-ae09-8063cb150555 tempest-VolumesActionsTest-1710709349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-13cba42c-0ecc-407c-9b9f-01ed5fa7c4ec" returned: 0 in 0.551s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:25:06 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-fac83a43-1c18-48ce-ae09-8063cb150555 tempest-VolumesActionsTest-1710709349 None] <== create_volume: return (1469ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:25:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-fac83a43-1c18-48ce-ae09-8063cb150555 tempest-VolumesActionsTest-1710709349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.472s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:25:06 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-fac83a43-1c18-48ce-ae09-8063cb150555 tempest-VolumesActionsTest-1710709349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b0bf92c-7c60-4b26-8d14-e00e5209a089) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13cba42c-0ecc-407c-9b9f-01ed5fa7c4ec', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:25:06 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-fac83a43-1c18-48ce-ae09-8063cb150555 tempest-VolumesActionsTest-1710709349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e3c5141-7b80-4566-9694-5df48734e346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:25:06 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-fac83a43-1c18-48ce-ae09-8063cb150555 tempest-VolumesActionsTest-1710709349 None] Volume volume-13cba42c-0ecc-407c-9b9f-01ed5fa7c4ec (13cba42c-0ecc-407c-9b9f-01ed5fa7c4ec): created successfully Sep 28 09:25:06 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-fac83a43-1c18-48ce-ae09-8063cb150555 tempest-VolumesActionsTest-1710709349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e3c5141-7b80-4566-9694-5df48734e346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:25:06 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-fac83a43-1c18-48ce-ae09-8063cb150555 tempest-VolumesActionsTest-1710709349 None] Flow 'volume_create_manager' (48924500-01d9-457e-89ec-a25db3e903ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:25:06 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-fac83a43-1c18-48ce-ae09-8063cb150555 tempest-VolumesActionsTest-1710709349 None] Created volume successfully. Sep 28 09:25:16 devstack cinder-volume[86553]: DEBUG dbcounter [-] [86553] Writing DB stats cinder:SELECT=17,cinder:UPDATE=14,cinder:INSERT=4,cinder:DELETE=2 {{(pid=86553) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 09:25:20 devstack cinder-volume[86553]: DEBUG dbcounter [-] [86553] Writing DB stats cinder:SELECT=13,cinder:UPDATE=12,cinder:INSERT=1 {{(pid=86553) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 09:25:21 devstack cinder-volume[86553]: DEBUG oslo_service.periodic_task [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86553) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 09:25:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:25:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:25:21 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:25:21 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:25:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:25:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:25:21 devstack sudo[92306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:25:21 devstack sudo[92306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:25:22 devstack sudo[92306]: pam_unix(sudo:session): session closed for user root Sep 28 09:25:22 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.499s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:25:22 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:25:22 devstack cinder-volume[86553]: DEBUG oslo_service.periodic_task [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Running periodic task VolumeManager._thread_info {{(pid=86553) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 09:25:22 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] thread count: 28 {{(pid=86553) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 09:25:22 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] thread info: [<_MainThread(MainThread, started 134684877779072)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86553) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 09:25:27 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-e0c998f2-19db-49e8-ba38-2475202abcbc tempest-VolumesActionsTest-1710709349 None] Acquiring lock "cinder-13cba42c-0ecc-407c-9b9f-01ed5fa7c4ec" by "attach_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:25:27 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-e0c998f2-19db-49e8-ba38-2475202abcbc tempest-VolumesActionsTest-1710709349 None] Lock "cinder-13cba42c-0ecc-407c-9b9f-01ed5fa7c4ec" acquired by "attach_volume" :: waited 0.034s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:25:27 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-e0c998f2-19db-49e8-ba38-2475202abcbc tempest-VolumesActionsTest-1710709349 None] Attaching volume 13cba42c-0ecc-407c-9b9f-01ed5fa7c4ec to instance d72237b7-84ab-4b38-8432-b0c6fbcd354f at mountpoint /dev/vdb on host None. Sep 28 09:25:27 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-e0c998f2-19db-49e8-ba38-2475202abcbc tempest-VolumesActionsTest-1710709349 None] Attach volume completed successfully. Sep 28 09:25:27 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-e0c998f2-19db-49e8-ba38-2475202abcbc tempest-VolumesActionsTest-1710709349 None] Lock "cinder-13cba42c-0ecc-407c-9b9f-01ed5fa7c4ec" released by "attach_volume" :: held 0.263s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:25:27 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-df078a3c-7343-4b25-ab44-1dea8d449002 tempest-VolumesActionsTest-1710709349 None] Acquiring lock "cinder-13cba42c-0ecc-407c-9b9f-01ed5fa7c4ec-detach_volume" by "detach_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:25:27 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-df078a3c-7343-4b25-ab44-1dea8d449002 tempest-VolumesActionsTest-1710709349 None] Lock "cinder-13cba42c-0ecc-407c-9b9f-01ed5fa7c4ec-detach_volume" acquired by "detach_volume" :: waited 0.044s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:25:27 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-df078a3c-7343-4b25-ab44-1dea8d449002 tempest-VolumesActionsTest-1710709349 None] Detaching volume 13cba42c-0ecc-407c-9b9f-01ed5fa7c4ec from instance d72237b7-84ab-4b38-8432-b0c6fbcd354f. Sep 28 09:25:28 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-df078a3c-7343-4b25-ab44-1dea8d449002 tempest-VolumesActionsTest-1710709349 None] Detach volume completed successfully. Sep 28 09:25:28 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-df078a3c-7343-4b25-ab44-1dea8d449002 tempest-VolumesActionsTest-1710709349 None] Lock "cinder-13cba42c-0ecc-407c-9b9f-01ed5fa7c4ec-detach_volume" released by "detach_volume" :: held 0.169s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:25:38 devstack cinder-volume[86553]: DEBUG dbcounter [-] [86553] Writing DB stats cinder:INSERT=1,cinder:SELECT=6,cinder:UPDATE=3 {{(pid=86553) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 09:25:38 devstack cinder-volume[86553]: DEBUG dbcounter [-] [86553] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=86553) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 09:25:45 devstack cinder-volume[86553]: INFO cinder.volume.manager [req-4ece8de2-9860-421f-9fd7-69bcab87186e req-1ae599b1-8a32-46ce-8143-ad8ac7fec1db tempest-ServerActionsTestOtherA-711372344 None] Terminate volume connection completed successfully. Sep 28 09:25:45 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [req-4ece8de2-9860-421f-9fd7-69bcab87186e req-1ae599b1-8a32-46ce-8143-ad8ac7fec1db tempest-ServerActionsTestOtherA-711372344 None] Deleting attachment 314a5d77-1058-4a8f-8cd8-3d2593631f0e. {{(pid=86553) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 09:25:46 devstack cinder-volume[86553]: DEBUG cinder.coordination [req-4ece8de2-9860-421f-9fd7-69bcab87186e req-db940182-7952-4ed8-8197-534bdc6b0485 tempest-ServerActionsTestOtherA-711372344 None] Acquiring lock "cinder-a319d27c-b15b-422e-98aa-1e5e15b9181e-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:25:46 devstack cinder-volume[86553]: DEBUG cinder.coordination [req-4ece8de2-9860-421f-9fd7-69bcab87186e req-db940182-7952-4ed8-8197-534bdc6b0485 tempest-ServerActionsTestOtherA-711372344 None] Lock "cinder-a319d27c-b15b-422e-98aa-1e5e15b9181e-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:25:46 devstack cinder-volume[86553]: DEBUG cinder.coordination [req-4ece8de2-9860-421f-9fd7-69bcab87186e req-db940182-7952-4ed8-8197-534bdc6b0485 tempest-ServerActionsTestOtherA-711372344 None] Acquiring lock "cinder-quobyte-a319d27c-b15b-422e-98aa-1e5e15b9181e" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:25:46 devstack cinder-volume[86553]: DEBUG cinder.coordination [req-4ece8de2-9860-421f-9fd7-69bcab87186e req-db940182-7952-4ed8-8197-534bdc6b0485 tempest-ServerActionsTestOtherA-711372344 None] Lock "cinder-quobyte-a319d27c-b15b-422e-98aa-1e5e15b9181e" acquired by "delete_volume" :: waited 0.024s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:25:46 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c61fdb2-60d1-470a-a193-c0134148a951]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:25:46 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [req-4ece8de2-9860-421f-9fd7-69bcab87186e req-db940182-7952-4ed8-8197-534bdc6b0485 tempest-ServerActionsTestOtherA-711372344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a319d27c-b15b-422e-98aa-1e5e15b9181e {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:25:46 devstack sudo[92648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a319d27c-b15b-422e-98aa-1e5e15b9181e Sep 28 09:25:46 devstack sudo[92648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:25:46 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-4b374021-be78-4bc0-bc61-559bf5ef3090 tempest-VolumesActionsTest-1710709349 None] Acquiring lock "cinder-13cba42c-0ecc-407c-9b9f-01ed5fa7c4ec" by "attach_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:25:47 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-4b374021-be78-4bc0-bc61-559bf5ef3090 tempest-VolumesActionsTest-1710709349 None] Lock "cinder-13cba42c-0ecc-407c-9b9f-01ed5fa7c4ec" acquired by "attach_volume" :: waited 0.030s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:25:47 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-4b374021-be78-4bc0-bc61-559bf5ef3090 tempest-VolumesActionsTest-1710709349 None] Attaching volume 13cba42c-0ecc-407c-9b9f-01ed5fa7c4ec to instance a4535dd5-49b7-423b-8b6a-dd55fdefa05a at mountpoint /dev/vdb on host None. Sep 28 09:25:47 devstack sudo[92648]: pam_unix(sudo:session): session closed for user root Sep 28 09:25:47 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-4b374021-be78-4bc0-bc61-559bf5ef3090 tempest-VolumesActionsTest-1710709349 None] Attach volume completed successfully. Sep 28 09:25:47 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [req-4ece8de2-9860-421f-9fd7-69bcab87186e req-db940182-7952-4ed8-8197-534bdc6b0485 tempest-ServerActionsTestOtherA-711372344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a319d27c-b15b-422e-98aa-1e5e15b9181e" returned: 0 in 0.743s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:25:47 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [req-4ece8de2-9860-421f-9fd7-69bcab87186e req-db940182-7952-4ed8-8197-534bdc6b0485 tempest-ServerActionsTestOtherA-711372344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a319d27c-b15b-422e-98aa-1e5e15b9181e {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:25:47 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-4b374021-be78-4bc0-bc61-559bf5ef3090 tempest-VolumesActionsTest-1710709349 None] Lock "cinder-13cba42c-0ecc-407c-9b9f-01ed5fa7c4ec" released by "attach_volume" :: held 0.172s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:25:47 devstack sudo[92655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a319d27c-b15b-422e-98aa-1e5e15b9181e Sep 28 09:25:47 devstack sudo[92655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:25:48 devstack sudo[92655]: pam_unix(sudo:session): session closed for user root Sep 28 09:25:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [req-4ece8de2-9860-421f-9fd7-69bcab87186e req-db940182-7952-4ed8-8197-534bdc6b0485 tempest-ServerActionsTestOtherA-711372344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a319d27c-b15b-422e-98aa-1e5e15b9181e" returned: 0 in 0.886s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:25:48 devstack cinder-volume[86553]: DEBUG cinder.coordination [req-4ece8de2-9860-421f-9fd7-69bcab87186e req-db940182-7952-4ed8-8197-534bdc6b0485 tempest-ServerActionsTestOtherA-711372344 None] Lock "cinder-quobyte-a319d27c-b15b-422e-98aa-1e5e15b9181e" released by "delete_volume" :: held 1.712s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:25:48 devstack cinder-volume[86553]: DEBUG cinder.quota [req-4ece8de2-9860-421f-9fd7-69bcab87186e req-db940182-7952-4ed8-8197-534bdc6b0485 tempest-ServerActionsTestOtherA-711372344 None] Created reservations ['7a988760-6af8-42f2-bbb4-8b77be374908', '7caf46ec-870c-4fde-992b-9371ce333720', 'b63654a2-3213-4f3e-bed8-4e501eb68723', 'e529b0f7-4925-44a0-9674-be9c520cf017'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:25:48 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-2b4f64ba-a73a-4fbe-be3d-86ecb3a0b5b0 tempest-ServerActionsTestOtherA-711372344 None] Acquiring lock "cinder-06c42fcd-9687-401a-95f2-bcd257ff5ec8-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:25:48 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-2b4f64ba-a73a-4fbe-be3d-86ecb3a0b5b0 tempest-ServerActionsTestOtherA-711372344 None] Lock "cinder-06c42fcd-9687-401a-95f2-bcd257ff5ec8-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:25:48 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-2b4f64ba-a73a-4fbe-be3d-86ecb3a0b5b0 tempest-ServerActionsTestOtherA-711372344 None] Acquiring lock "cinder-quobyte-06c42fcd-9687-401a-95f2-bcd257ff5ec8" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:25:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-4ece8de2-9860-421f-9fd7-69bcab87186e req-db940182-7952-4ed8-8197-534bdc6b0485 tempest-ServerActionsTestOtherA-711372344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:25:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-4ece8de2-9860-421f-9fd7-69bcab87186e req-db940182-7952-4ed8-8197-534bdc6b0485 tempest-ServerActionsTestOtherA-711372344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:25:48 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [req-4ece8de2-9860-421f-9fd7-69bcab87186e req-db940182-7952-4ed8-8197-534bdc6b0485 tempest-ServerActionsTestOtherA-711372344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:25:48 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [req-4ece8de2-9860-421f-9fd7-69bcab87186e req-db940182-7952-4ed8-8197-534bdc6b0485 tempest-ServerActionsTestOtherA-711372344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:25:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-4ece8de2-9860-421f-9fd7-69bcab87186e req-db940182-7952-4ed8-8197-534bdc6b0485 tempest-ServerActionsTestOtherA-711372344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:25:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [req-4ece8de2-9860-421f-9fd7-69bcab87186e req-db940182-7952-4ed8-8197-534bdc6b0485 tempest-ServerActionsTestOtherA-711372344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:25:48 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-2b4f64ba-a73a-4fbe-be3d-86ecb3a0b5b0 tempest-ServerActionsTestOtherA-711372344 None] Lock "cinder-quobyte-06c42fcd-9687-401a-95f2-bcd257ff5ec8" acquired by "delete_volume" :: waited 0.095s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:25:48 devstack sudo[92662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:25:48 devstack sudo[92662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:25:48 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-f703ba63-800b-421c-a002-03f34ab7be19 tempest-VolumesActionsTest-1710709349 None] Acquiring lock "cinder-13cba42c-0ecc-407c-9b9f-01ed5fa7c4ec-detach_volume" by "detach_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:25:48 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d436c36-f2f8-4a27-be84-fd89d1286492]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:25:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2b4f64ba-a73a-4fbe-be3d-86ecb3a0b5b0 tempest-ServerActionsTestOtherA-711372344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-06c42fcd-9687-401a-95f2-bcd257ff5ec8 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:25:48 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-f703ba63-800b-421c-a002-03f34ab7be19 tempest-VolumesActionsTest-1710709349 None] Lock "cinder-13cba42c-0ecc-407c-9b9f-01ed5fa7c4ec-detach_volume" acquired by "detach_volume" :: waited 0.111s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:25:48 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-f703ba63-800b-421c-a002-03f34ab7be19 tempest-VolumesActionsTest-1710709349 None] Detaching volume 13cba42c-0ecc-407c-9b9f-01ed5fa7c4ec from instance a4535dd5-49b7-423b-8b6a-dd55fdefa05a. Sep 28 09:25:49 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-f703ba63-800b-421c-a002-03f34ab7be19 tempest-VolumesActionsTest-1710709349 None] Detach volume completed successfully. Sep 28 09:25:49 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-f703ba63-800b-421c-a002-03f34ab7be19 tempest-VolumesActionsTest-1710709349 None] Lock "cinder-13cba42c-0ecc-407c-9b9f-01ed5fa7c4ec-detach_volume" released by "detach_volume" :: held 0.245s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:25:49 devstack sudo[92664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-06c42fcd-9687-401a-95f2-bcd257ff5ec8 Sep 28 09:25:49 devstack sudo[92664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:25:49 devstack sudo[92662]: pam_unix(sudo:session): session closed for user root Sep 28 09:25:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [req-4ece8de2-9860-421f-9fd7-69bcab87186e req-db940182-7952-4ed8-8197-534bdc6b0485 tempest-ServerActionsTestOtherA-711372344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.819s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:25:49 devstack cinder-volume[86553]: DEBUG cinder.manager [req-4ece8de2-9860-421f-9fd7-69bcab87186e req-db940182-7952-4ed8-8197-534bdc6b0485 tempest-ServerActionsTestOtherA-711372344 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:25:49 devstack cinder-volume[86553]: INFO cinder.volume.manager [req-4ece8de2-9860-421f-9fd7-69bcab87186e req-db940182-7952-4ed8-8197-534bdc6b0485 tempest-ServerActionsTestOtherA-711372344 None] Deleted volume successfully. Sep 28 09:25:49 devstack cinder-volume[86553]: DEBUG cinder.coordination [req-4ece8de2-9860-421f-9fd7-69bcab87186e req-db940182-7952-4ed8-8197-534bdc6b0485 tempest-ServerActionsTestOtherA-711372344 None] Lock "cinder-a319d27c-b15b-422e-98aa-1e5e15b9181e-delete_volume" released by "delete_volume" :: held 3.341s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:25:49 devstack sudo[92664]: pam_unix(sudo:session): session closed for user root Sep 28 09:25:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2b4f64ba-a73a-4fbe-be3d-86ecb3a0b5b0 tempest-ServerActionsTestOtherA-711372344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-06c42fcd-9687-401a-95f2-bcd257ff5ec8" returned: 0 in 1.104s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:25:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2b4f64ba-a73a-4fbe-be3d-86ecb3a0b5b0 tempest-ServerActionsTestOtherA-711372344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-06c42fcd-9687-401a-95f2-bcd257ff5ec8 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:25:50 devstack sudo[92679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-06c42fcd-9687-401a-95f2-bcd257ff5ec8 Sep 28 09:25:50 devstack sudo[92679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:25:50 devstack sudo[92679]: pam_unix(sudo:session): session closed for user root Sep 28 09:25:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2b4f64ba-a73a-4fbe-be3d-86ecb3a0b5b0 tempest-ServerActionsTestOtherA-711372344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-06c42fcd-9687-401a-95f2-bcd257ff5ec8" returned: 0 in 0.567s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:25:50 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-2b4f64ba-a73a-4fbe-be3d-86ecb3a0b5b0 tempest-ServerActionsTestOtherA-711372344 None] Lock "cinder-quobyte-06c42fcd-9687-401a-95f2-bcd257ff5ec8" released by "delete_volume" :: held 1.835s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:25:50 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-2b4f64ba-a73a-4fbe-be3d-86ecb3a0b5b0 tempest-ServerActionsTestOtherA-711372344 None] Created reservations ['f54e606e-c015-4ce5-8cb3-0bd85769cfcb', '0a40f283-83c3-441f-9c8c-71c529f88586', '019e6ec9-7816-4fac-8d44-e6930e04b56d', '84606bd6-c5b4-4c67-95e9-03d2db324fd6'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:25:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-2b4f64ba-a73a-4fbe-be3d-86ecb3a0b5b0 tempest-ServerActionsTestOtherA-711372344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:25:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-2b4f64ba-a73a-4fbe-be3d-86ecb3a0b5b0 tempest-ServerActionsTestOtherA-711372344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:25:50 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-2b4f64ba-a73a-4fbe-be3d-86ecb3a0b5b0 tempest-ServerActionsTestOtherA-711372344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:25:50 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-2b4f64ba-a73a-4fbe-be3d-86ecb3a0b5b0 tempest-ServerActionsTestOtherA-711372344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:25:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-2b4f64ba-a73a-4fbe-be3d-86ecb3a0b5b0 tempest-ServerActionsTestOtherA-711372344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:25:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2b4f64ba-a73a-4fbe-be3d-86ecb3a0b5b0 tempest-ServerActionsTestOtherA-711372344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:25:50 devstack sudo[92690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:25:50 devstack sudo[92690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:25:51 devstack sudo[92690]: pam_unix(sudo:session): session closed for user root Sep 28 09:25:51 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2b4f64ba-a73a-4fbe-be3d-86ecb3a0b5b0 tempest-ServerActionsTestOtherA-711372344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.377s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:25:51 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-2b4f64ba-a73a-4fbe-be3d-86ecb3a0b5b0 tempest-ServerActionsTestOtherA-711372344 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:25:51 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-2b4f64ba-a73a-4fbe-be3d-86ecb3a0b5b0 tempest-ServerActionsTestOtherA-711372344 None] Deleted volume successfully. Sep 28 09:25:51 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-2b4f64ba-a73a-4fbe-be3d-86ecb3a0b5b0 tempest-ServerActionsTestOtherA-711372344 None] Lock "cinder-06c42fcd-9687-401a-95f2-bcd257ff5ec8-delete_volume" released by "delete_volume" :: held 2.810s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:25:58 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-3ead959a-cf90-4193-a9e1-61499d30ab67 tempest-VolumesActionsTest-1710709349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:25:58 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-3ead959a-cf90-4193-a9e1-61499d30ab67 tempest-VolumesActionsTest-1710709349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:25:58 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[3529a4aa-f211-4d48-a7f4-677caedebe1c]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:25:58 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3ead959a-cf90-4193-a9e1-61499d30ab67 tempest-VolumesActionsTest-1710709349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-13cba42c-0ecc-407c-9b9f-01ed5fa7c4ec {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:25:58 devstack sudo[92826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-13cba42c-0ecc-407c-9b9f-01ed5fa7c4ec Sep 28 09:25:58 devstack sudo[92826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:25:58 devstack sudo[92826]: pam_unix(sudo:session): session closed for user root Sep 28 09:25:59 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3ead959a-cf90-4193-a9e1-61499d30ab67 tempest-VolumesActionsTest-1710709349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-13cba42c-0ecc-407c-9b9f-01ed5fa7c4ec" returned: 0 in 0.887s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:25:59 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a05ac9-1d4f-434f-927e-f22fee11886f]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:25:59 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3ead959a-cf90-4193-a9e1-61499d30ab67 tempest-VolumesActionsTest-1710709349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-13cba42c-0ecc-407c-9b9f-01ed5fa7c4ec {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:25:59 devstack sudo[92834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-13cba42c-0ecc-407c-9b9f-01ed5fa7c4ec Sep 28 09:25:59 devstack sudo[92834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:25:59 devstack sudo[92834]: pam_unix(sudo:session): session closed for user root Sep 28 09:25:59 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3ead959a-cf90-4193-a9e1-61499d30ab67 tempest-VolumesActionsTest-1710709349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-13cba42c-0ecc-407c-9b9f-01ed5fa7c4ec" returned: 0 in 0.579s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:25:59 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3ead959a-cf90-4193-a9e1-61499d30ab67 tempest-VolumesActionsTest-1710709349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-13cba42c-0ecc-407c-9b9f-01ed5fa7c4ec /opt/stack/data/cinder/conversion/13cba42c-0ecc-407c-9b9f-01ed5fa7c4ec.temp_image.fd8f26d4-ae89-493e-bfb1-d687dac12945g4rfwu4b.img {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:25:59 devstack sudo[92867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-13cba42c-0ecc-407c-9b9f-01ed5fa7c4ec /opt/stack/data/cinder/conversion/13cba42c-0ecc-407c-9b9f-01ed5fa7c4ec.temp_image.fd8f26d4-ae89-493e-bfb1-d687dac12945g4rfwu4b.img Sep 28 09:25:59 devstack sudo[92867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:26:01 devstack cinder-volume[86553]: DEBUG dbcounter [-] [86553] Writing DB stats cinder:SELECT=19,cinder:INSERT=6,cinder:UPDATE=17,cinder:DELETE=1 {{(pid=86553) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 09:26:08 devstack cinder-volume[86553]: DEBUG dbcounter [-] [86553] Writing DB stats cinder:UPDATE=21,cinder:INSERT=4,cinder:SELECT=17,cinder:DELETE=1 {{(pid=86553) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 09:26:09 devstack sudo[92867]: pam_unix(sudo:session): session closed for user root Sep 28 09:26:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3ead959a-cf90-4193-a9e1-61499d30ab67 tempest-VolumesActionsTest-1710709349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-13cba42c-0ecc-407c-9b9f-01ed5fa7c4ec /opt/stack/data/cinder/conversion/13cba42c-0ecc-407c-9b9f-01ed5fa7c4ec.temp_image.fd8f26d4-ae89-493e-bfb1-d687dac12945g4rfwu4b.img" returned: 0 in 10.183s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:26:09 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[de677078-560a-4f57-a202-e99628ba322a]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:26:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3ead959a-cf90-4193-a9e1-61499d30ab67 tempest-VolumesActionsTest-1710709349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-13cba42c-0ecc-407c-9b9f-01ed5fa7c4ec {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:26:09 devstack sudo[92899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-13cba42c-0ecc-407c-9b9f-01ed5fa7c4ec Sep 28 09:26:09 devstack sudo[92899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:26:10 devstack sudo[92899]: pam_unix(sudo:session): session closed for user root Sep 28 09:26:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3ead959a-cf90-4193-a9e1-61499d30ab67 tempest-VolumesActionsTest-1710709349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-13cba42c-0ecc-407c-9b9f-01ed5fa7c4ec" returned: 0 in 0.622s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:26:10 devstack cinder-volume[86553]: DEBUG cinder.image.image_utils [None req-3ead959a-cf90-4193-a9e1-61499d30ab67 tempest-VolumesActionsTest-1710709349 None] Image conversion details: src /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-13cba42c-0ecc-407c-9b9f-01ed5fa7c4ec, size 1024.00 MB, duration 10.18 sec, destination /opt/stack/data/cinder/conversion/13cba42c-0ecc-407c-9b9f-01ed5fa7c4ec.temp_image.fd8f26d4-ae89-493e-bfb1-d687dac12945g4rfwu4b.img {{(pid=86553) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 09:26:10 devstack cinder-volume[86553]: INFO cinder.image.image_utils [None req-3ead959a-cf90-4193-a9e1-61499d30ab67 tempest-VolumesActionsTest-1710709349 None] Converted 1024.00 MB image at 100.55 MB/s Sep 28 09:26:10 devstack cinder-volume[86553]: DEBUG cinder.image.image_utils [None req-3ead959a-cf90-4193-a9e1-61499d30ab67 tempest-VolumesActionsTest-1710709349 None] fd8f26d4-ae89-493e-bfb1-d687dac12945 was raw, no need to convert to raw {{(pid=86553) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 28 09:26:12 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-336116ee-8701-4074-82ad-49cf2e8e308b tempest-AttachVolumeTestJSON-612710564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:26:12 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-336116ee-8701-4074-82ad-49cf2e8e308b tempest-AttachVolumeTestJSON-612710564 None] Flow 'volume_create_manager' (90f7cb60-840e-4f96-816e-9cc0111c64b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:26:12 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-336116ee-8701-4074-82ad-49cf2e8e308b tempest-AttachVolumeTestJSON-612710564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88ed75e1-dbaa-49e6-9c26-ff9b73bd10f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:26:12 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-336116ee-8701-4074-82ad-49cf2e8e308b tempest-AttachVolumeTestJSON-612710564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88ed75e1-dbaa-49e6-9c26-ff9b73bd10f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:26:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-515750965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08c84622-bed2-4bb3-bca9-9510553de117,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bb70789f7694e3c98616e64328affc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:26:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:26:13Z,use_quota=True,user_id='247feee458a1454896a7c550b17f684d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:26:12 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-336116ee-8701-4074-82ad-49cf2e8e308b tempest-AttachVolumeTestJSON-612710564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6e93ab5-60b1-4c00-a18c-fcfd9286b9e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:26:12 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-336116ee-8701-4074-82ad-49cf2e8e308b tempest-AttachVolumeTestJSON-612710564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6e93ab5-60b1-4c00-a18c-fcfd9286b9e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:26:12 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-336116ee-8701-4074-82ad-49cf2e8e308b tempest-AttachVolumeTestJSON-612710564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0759af21-6e01-4220-a3df-1c84165b9a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:26:12 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-336116ee-8701-4074-82ad-49cf2e8e308b tempest-AttachVolumeTestJSON-612710564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0759af21-6e01-4220-a3df-1c84165b9a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08c84622-bed2-4bb3-bca9-9510553de117', 'volume_name': 'volume-08c84622-bed2-4bb3-bca9-9510553de117', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:26:12 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-336116ee-8701-4074-82ad-49cf2e8e308b tempest-AttachVolumeTestJSON-612710564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9350500b-f58a-41c2-b489-d45affc50cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:26:12 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-336116ee-8701-4074-82ad-49cf2e8e308b tempest-AttachVolumeTestJSON-612710564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9350500b-f58a-41c2-b489-d45affc50cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:26:12 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-336116ee-8701-4074-82ad-49cf2e8e308b tempest-AttachVolumeTestJSON-612710564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f16c7d0-91a2-4369-aaf6-2b6449e61655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:26:12 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-336116ee-8701-4074-82ad-49cf2e8e308b tempest-AttachVolumeTestJSON-612710564 None] Volume 08c84622-bed2-4bb3-bca9-9510553de117: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08c84622-bed2-4bb3-bca9-9510553de117', 'volume_size': 1} Sep 28 09:26:12 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-336116ee-8701-4074-82ad-49cf2e8e308b tempest-AttachVolumeTestJSON-612710564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:26:21 devstack cinder-volume[86553]: DEBUG oslo_service.periodic_task [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86553) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 09:26:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:26:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:26:21 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:26:21 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:26:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:26:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:26:21 devstack sudo[92988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:26:21 devstack sudo[92988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:26:21 devstack sudo[92988]: pam_unix(sudo:session): session closed for user root Sep 28 09:26:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.371s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:26:21 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:26:21 devstack cinder-volume[86553]: DEBUG oslo_service.periodic_task [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Running periodic task VolumeManager._thread_info {{(pid=86553) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 09:26:21 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] thread count: 28 {{(pid=86553) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 09:26:21 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] thread info: [<_MainThread(MainThread, started 134684877779072)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86553) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 09:26:22 devstack cinder-volume[86553]: DEBUG dbcounter [-] [86553] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=86553) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 09:26:22 devstack cinder-volume[86553]: DEBUG dbcounter [-] [86553] Writing DB stats cinder:SELECT=3 {{(pid=86553) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 09:26:25 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf06fd3b-ef67-4b90-8fa5-24edc8714f1a tempest-AttachVolumeNegativeTest-1957606009 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:26:25 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-cf06fd3b-ef67-4b90-8fa5-24edc8714f1a tempest-AttachVolumeNegativeTest-1957606009 None] Flow 'volume_create_manager' (a087113e-49c1-4b99-b629-5541d160d119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:26:25 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-cf06fd3b-ef67-4b90-8fa5-24edc8714f1a tempest-AttachVolumeNegativeTest-1957606009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6bdb1e5-16fe-4586-8af1-38c975bebee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:26:25 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-cf06fd3b-ef67-4b90-8fa5-24edc8714f1a tempest-AttachVolumeNegativeTest-1957606009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6bdb1e5-16fe-4586-8af1-38c975bebee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:26:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1240705852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60f61781-9f97-4d66-99bc-0b097e7f349f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae977ce2e750463c958ccb0bd085f517',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:26:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:26:25Z,use_quota=True,user_id='1ce42b207b3f42c3b1ea2429c628a473',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:26:25 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-cf06fd3b-ef67-4b90-8fa5-24edc8714f1a tempest-AttachVolumeNegativeTest-1957606009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fe443dd-d280-42ad-9639-a734810a0be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:26:25 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-cf06fd3b-ef67-4b90-8fa5-24edc8714f1a tempest-AttachVolumeNegativeTest-1957606009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fe443dd-d280-42ad-9639-a734810a0be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:26:25 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-cf06fd3b-ef67-4b90-8fa5-24edc8714f1a tempest-AttachVolumeNegativeTest-1957606009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eafff3b0-a813-47bb-bd80-0ed0f51aa352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:26:25 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-cf06fd3b-ef67-4b90-8fa5-24edc8714f1a tempest-AttachVolumeNegativeTest-1957606009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eafff3b0-a813-47bb-bd80-0ed0f51aa352) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60f61781-9f97-4d66-99bc-0b097e7f349f', 'volume_name': 'volume-60f61781-9f97-4d66-99bc-0b097e7f349f', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:26:25 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-cf06fd3b-ef67-4b90-8fa5-24edc8714f1a tempest-AttachVolumeNegativeTest-1957606009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc2054a4-60e4-40e6-9518-6ed8f65ad550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:26:25 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-cf06fd3b-ef67-4b90-8fa5-24edc8714f1a tempest-AttachVolumeNegativeTest-1957606009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc2054a4-60e4-40e6-9518-6ed8f65ad550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:26:25 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-cf06fd3b-ef67-4b90-8fa5-24edc8714f1a tempest-AttachVolumeNegativeTest-1957606009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32647781-0d7d-4ad5-8f35-fb215615c8c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:26:25 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-cf06fd3b-ef67-4b90-8fa5-24edc8714f1a tempest-AttachVolumeNegativeTest-1957606009 None] Volume 60f61781-9f97-4d66-99bc-0b097e7f349f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60f61781-9f97-4d66-99bc-0b097e7f349f', 'volume_size': 1} Sep 28 09:26:25 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-cf06fd3b-ef67-4b90-8fa5-24edc8714f1a tempest-AttachVolumeNegativeTest-1957606009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:26:35 devstack cinder-volume[86553]: DEBUG dbcounter [-] [86553] Writing DB stats cinder:UPDATE=1 {{(pid=86553) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 09:26:35 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-3ead959a-cf90-4193-a9e1-61499d30ab67 tempest-VolumesActionsTest-1710709349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 37.741s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:26:35 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-3ead959a-cf90-4193-a9e1-61499d30ab67 tempest-VolumesActionsTest-1710709349 None] Uploaded volume to glance image-id: fd8f26d4-ae89-493e-bfb1-d687dac12945. {{(pid=86553) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 28 09:26:35 devstack cinder-volume[86553]: DEBUG dbcounter [-] [86553] Writing DB stats cinder:SELECT=2 {{(pid=86553) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 09:26:35 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-336116ee-8701-4074-82ad-49cf2e8e308b tempest-AttachVolumeTestJSON-612710564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 23.077s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:26:35 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-336116ee-8701-4074-82ad-49cf2e8e308b tempest-AttachVolumeTestJSON-612710564 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:26:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-515750965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08c84622-bed2-4bb3-bca9-9510553de117,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bb70789f7694e3c98616e64328affc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:26:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:26:13Z,use_quota=True,user_id='247feee458a1454896a7c550b17f684d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:26:35 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-336116ee-8701-4074-82ad-49cf2e8e308b tempest-AttachVolumeTestJSON-612710564 None] Creating volume 08c84622-bed2-4bb3-bca9-9510553de117 {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:26:35 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-336116ee-8701-4074-82ad-49cf2e8e308b tempest-AttachVolumeTestJSON-612710564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:26:35 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-336116ee-8701-4074-82ad-49cf2e8e308b tempest-AttachVolumeTestJSON-612710564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:26:35 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-336116ee-8701-4074-82ad-49cf2e8e308b tempest-AttachVolumeTestJSON-612710564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:26:35 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-336116ee-8701-4074-82ad-49cf2e8e308b tempest-AttachVolumeTestJSON-612710564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:26:35 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-336116ee-8701-4074-82ad-49cf2e8e308b tempest-AttachVolumeTestJSON-612710564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:26:35 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-336116ee-8701-4074-82ad-49cf2e8e308b tempest-AttachVolumeTestJSON-612710564 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:26:35 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-336116ee-8701-4074-82ad-49cf2e8e308b tempest-AttachVolumeTestJSON-612710564 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:26:35 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-336116ee-8701-4074-82ad-49cf2e8e308b tempest-AttachVolumeTestJSON-612710564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-08c84622-bed2-4bb3-bca9-9510553de117 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:26:35 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-3ead959a-cf90-4193-a9e1-61499d30ab67 tempest-VolumesActionsTest-1710709349 None] Copy volume to image completed successfully. Sep 28 09:26:35 devstack sudo[93170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-08c84622-bed2-4bb3-bca9-9510553de117 1073741824 Sep 28 09:26:35 devstack sudo[93170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:26:36 devstack sudo[93170]: pam_unix(sudo:session): session closed for user root Sep 28 09:26:36 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-336116ee-8701-4074-82ad-49cf2e8e308b tempest-AttachVolumeTestJSON-612710564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-08c84622-bed2-4bb3-bca9-9510553de117 1073741824" returned: 0 in 0.752s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:26:36 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-336116ee-8701-4074-82ad-49cf2e8e308b tempest-AttachVolumeTestJSON-612710564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-08c84622-bed2-4bb3-bca9-9510553de117 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:26:36 devstack sudo[93188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-08c84622-bed2-4bb3-bca9-9510553de117 Sep 28 09:26:36 devstack sudo[93188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:26:36 devstack sudo[93188]: pam_unix(sudo:session): session closed for user root Sep 28 09:26:36 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-336116ee-8701-4074-82ad-49cf2e8e308b tempest-AttachVolumeTestJSON-612710564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-08c84622-bed2-4bb3-bca9-9510553de117" returned: 0 in 0.280s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:26:36 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-336116ee-8701-4074-82ad-49cf2e8e308b tempest-AttachVolumeTestJSON-612710564 None] <== create_volume: return (1104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:26:36 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-336116ee-8701-4074-82ad-49cf2e8e308b tempest-AttachVolumeTestJSON-612710564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.110s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:26:36 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-cf06fd3b-ef67-4b90-8fa5-24edc8714f1a tempest-AttachVolumeNegativeTest-1957606009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.269s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:26:36 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-cf06fd3b-ef67-4b90-8fa5-24edc8714f1a tempest-AttachVolumeNegativeTest-1957606009 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:26:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1240705852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60f61781-9f97-4d66-99bc-0b097e7f349f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae977ce2e750463c958ccb0bd085f517',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:26:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:26:25Z,use_quota=True,user_id='1ce42b207b3f42c3b1ea2429c628a473',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:26:36 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-cf06fd3b-ef67-4b90-8fa5-24edc8714f1a tempest-AttachVolumeNegativeTest-1957606009 None] Creating volume 60f61781-9f97-4d66-99bc-0b097e7f349f {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:26:36 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-cf06fd3b-ef67-4b90-8fa5-24edc8714f1a tempest-AttachVolumeNegativeTest-1957606009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:26:36 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-cf06fd3b-ef67-4b90-8fa5-24edc8714f1a tempest-AttachVolumeNegativeTest-1957606009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:26:36 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-cf06fd3b-ef67-4b90-8fa5-24edc8714f1a tempest-AttachVolumeNegativeTest-1957606009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:26:36 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-cf06fd3b-ef67-4b90-8fa5-24edc8714f1a tempest-AttachVolumeNegativeTest-1957606009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:26:36 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-cf06fd3b-ef67-4b90-8fa5-24edc8714f1a tempest-AttachVolumeNegativeTest-1957606009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:26:36 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-cf06fd3b-ef67-4b90-8fa5-24edc8714f1a tempest-AttachVolumeNegativeTest-1957606009 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:26:36 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-cf06fd3b-ef67-4b90-8fa5-24edc8714f1a tempest-AttachVolumeNegativeTest-1957606009 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:26:36 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-cf06fd3b-ef67-4b90-8fa5-24edc8714f1a tempest-AttachVolumeNegativeTest-1957606009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-60f61781-9f97-4d66-99bc-0b097e7f349f 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:26:37 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-336116ee-8701-4074-82ad-49cf2e8e308b tempest-AttachVolumeTestJSON-612710564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f16c7d0-91a2-4369-aaf6-2b6449e61655) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08c84622-bed2-4bb3-bca9-9510553de117', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:26:37 devstack sudo[93191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-60f61781-9f97-4d66-99bc-0b097e7f349f 1073741824 Sep 28 09:26:37 devstack sudo[93191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:26:37 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-336116ee-8701-4074-82ad-49cf2e8e308b tempest-AttachVolumeTestJSON-612710564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b69138e-4804-41ce-89a5-e6fc864a47df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:26:37 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-336116ee-8701-4074-82ad-49cf2e8e308b tempest-AttachVolumeTestJSON-612710564 None] Volume volume-08c84622-bed2-4bb3-bca9-9510553de117 (08c84622-bed2-4bb3-bca9-9510553de117): created successfully Sep 28 09:26:37 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-336116ee-8701-4074-82ad-49cf2e8e308b tempest-AttachVolumeTestJSON-612710564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b69138e-4804-41ce-89a5-e6fc864a47df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:26:37 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-336116ee-8701-4074-82ad-49cf2e8e308b tempest-AttachVolumeTestJSON-612710564 None] Flow 'volume_create_manager' (90f7cb60-840e-4f96-816e-9cc0111c64b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:26:37 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-336116ee-8701-4074-82ad-49cf2e8e308b tempest-AttachVolumeTestJSON-612710564 None] Created volume successfully. Sep 28 09:26:37 devstack sudo[93191]: pam_unix(sudo:session): session closed for user root Sep 28 09:26:37 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-cf06fd3b-ef67-4b90-8fa5-24edc8714f1a tempest-AttachVolumeNegativeTest-1957606009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-60f61781-9f97-4d66-99bc-0b097e7f349f 1073741824" returned: 0 in 0.935s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:26:37 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-cf06fd3b-ef67-4b90-8fa5-24edc8714f1a tempest-AttachVolumeNegativeTest-1957606009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-60f61781-9f97-4d66-99bc-0b097e7f349f {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:26:38 devstack sudo[93200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-60f61781-9f97-4d66-99bc-0b097e7f349f Sep 28 09:26:38 devstack sudo[93200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:26:38 devstack sudo[93200]: pam_unix(sudo:session): session closed for user root Sep 28 09:26:38 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-cf06fd3b-ef67-4b90-8fa5-24edc8714f1a tempest-AttachVolumeNegativeTest-1957606009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-60f61781-9f97-4d66-99bc-0b097e7f349f" returned: 0 in 0.406s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:26:38 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-cf06fd3b-ef67-4b90-8fa5-24edc8714f1a tempest-AttachVolumeNegativeTest-1957606009 None] <== create_volume: return (1409ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:26:38 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-cf06fd3b-ef67-4b90-8fa5-24edc8714f1a tempest-AttachVolumeNegativeTest-1957606009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.413s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:26:38 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-cf06fd3b-ef67-4b90-8fa5-24edc8714f1a tempest-AttachVolumeNegativeTest-1957606009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32647781-0d7d-4ad5-8f35-fb215615c8c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60f61781-9f97-4d66-99bc-0b097e7f349f', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:26:38 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-cf06fd3b-ef67-4b90-8fa5-24edc8714f1a tempest-AttachVolumeNegativeTest-1957606009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f033d0a8-8def-4fb3-b864-d32f92e8c1b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:26:38 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-cf06fd3b-ef67-4b90-8fa5-24edc8714f1a tempest-AttachVolumeNegativeTest-1957606009 None] Volume volume-60f61781-9f97-4d66-99bc-0b097e7f349f (60f61781-9f97-4d66-99bc-0b097e7f349f): created successfully Sep 28 09:26:38 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-cf06fd3b-ef67-4b90-8fa5-24edc8714f1a tempest-AttachVolumeNegativeTest-1957606009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f033d0a8-8def-4fb3-b864-d32f92e8c1b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:26:38 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-cf06fd3b-ef67-4b90-8fa5-24edc8714f1a tempest-AttachVolumeNegativeTest-1957606009 None] Flow 'volume_create_manager' (a087113e-49c1-4b99-b629-5541d160d119) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:26:38 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-cf06fd3b-ef67-4b90-8fa5-24edc8714f1a tempest-AttachVolumeNegativeTest-1957606009 None] Created volume successfully. Sep 28 09:26:38 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-f5a9fdee-0d08-42a8-92b8-6c1e8d0cb50c tempest-VolumesActionsTest-1710709349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:26:38 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-f5a9fdee-0d08-42a8-92b8-6c1e8d0cb50c tempest-VolumesActionsTest-1710709349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.007s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:26:38 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[29635fb0-7566-4240-9435-7184d45ca633]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:26:38 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f5a9fdee-0d08-42a8-92b8-6c1e8d0cb50c tempest-VolumesActionsTest-1710709349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-13cba42c-0ecc-407c-9b9f-01ed5fa7c4ec {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:26:39 devstack sudo[93208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-13cba42c-0ecc-407c-9b9f-01ed5fa7c4ec Sep 28 09:26:39 devstack sudo[93208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:26:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-d8016543-ca59-423e-bfd3-013252dc791b req-5c645bc8-95c9-45dc-8649-e0753b9cd5c8 tempest-AttachVolumeTestJSON-612710564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:26:39 devstack sudo[93208]: pam_unix(sudo:session): session closed for user root Sep 28 09:26:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f5a9fdee-0d08-42a8-92b8-6c1e8d0cb50c tempest-VolumesActionsTest-1710709349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-13cba42c-0ecc-407c-9b9f-01ed5fa7c4ec" returned: 0 in 0.737s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:26:39 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b040e0-7fff-4717-ae8c-e217f66fe8f3]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:26:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f5a9fdee-0d08-42a8-92b8-6c1e8d0cb50c tempest-VolumesActionsTest-1710709349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-13cba42c-0ecc-407c-9b9f-01ed5fa7c4ec {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:26:39 devstack sudo[93225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-13cba42c-0ecc-407c-9b9f-01ed5fa7c4ec Sep 28 09:26:39 devstack sudo[93225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:26:40 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-fbed0cb4-faa8-450b-b17b-488fd00c63f7 req-8ac73d34-5223-4024-89c9-0e4532f05ade tempest-AttachVolumeNegativeTest-1957606009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:26:40 devstack sudo[93225]: pam_unix(sudo:session): session closed for user root Sep 28 09:26:40 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f5a9fdee-0d08-42a8-92b8-6c1e8d0cb50c tempest-VolumesActionsTest-1710709349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-13cba42c-0ecc-407c-9b9f-01ed5fa7c4ec" returned: 0 in 0.947s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:26:40 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f5a9fdee-0d08-42a8-92b8-6c1e8d0cb50c tempest-VolumesActionsTest-1710709349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-13cba42c-0ecc-407c-9b9f-01ed5fa7c4ec /opt/stack/data/cinder/conversion/13cba42c-0ecc-407c-9b9f-01ed5fa7c4ec.temp_image.9537d10d-30b7-495a-ae1d-34d1eaa21d3ff4mzqi05.img {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:26:40 devstack sudo[93240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-13cba42c-0ecc-407c-9b9f-01ed5fa7c4ec /opt/stack/data/cinder/conversion/13cba42c-0ecc-407c-9b9f-01ed5fa7c4ec.temp_image.9537d10d-30b7-495a-ae1d-34d1eaa21d3ff4mzqi05.img Sep 28 09:26:40 devstack sudo[93240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:26:49 devstack sudo[93240]: pam_unix(sudo:session): session closed for user root Sep 28 09:26:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f5a9fdee-0d08-42a8-92b8-6c1e8d0cb50c tempest-VolumesActionsTest-1710709349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-13cba42c-0ecc-407c-9b9f-01ed5fa7c4ec /opt/stack/data/cinder/conversion/13cba42c-0ecc-407c-9b9f-01ed5fa7c4ec.temp_image.9537d10d-30b7-495a-ae1d-34d1eaa21d3ff4mzqi05.img" returned: 0 in 9.373s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:26:49 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a3f98f-889b-48a0-9656-a570d39f1a4f]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:26:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f5a9fdee-0d08-42a8-92b8-6c1e8d0cb50c tempest-VolumesActionsTest-1710709349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-13cba42c-0ecc-407c-9b9f-01ed5fa7c4ec {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:26:50 devstack sudo[93312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-13cba42c-0ecc-407c-9b9f-01ed5fa7c4ec Sep 28 09:26:50 devstack sudo[93312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:26:50 devstack cinder-volume[86553]: DEBUG dbcounter [-] [86553] Writing DB stats cinder:SELECT=5,cinder:UPDATE=4,cinder:DELETE=1,cinder:INSERT=1 {{(pid=86553) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 09:26:50 devstack cinder-volume[86553]: DEBUG dbcounter [-] [86553] Writing DB stats cinder:SELECT=5,cinder:UPDATE=7,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86553) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 09:26:50 devstack sudo[93312]: pam_unix(sudo:session): session closed for user root Sep 28 09:26:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f5a9fdee-0d08-42a8-92b8-6c1e8d0cb50c tempest-VolumesActionsTest-1710709349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-13cba42c-0ecc-407c-9b9f-01ed5fa7c4ec" returned: 0 in 0.573s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:26:50 devstack cinder-volume[86553]: DEBUG cinder.image.image_utils [None req-f5a9fdee-0d08-42a8-92b8-6c1e8d0cb50c tempest-VolumesActionsTest-1710709349 None] Image conversion details: src /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-13cba42c-0ecc-407c-9b9f-01ed5fa7c4ec, size 1024.00 MB, duration 9.38 sec, destination /opt/stack/data/cinder/conversion/13cba42c-0ecc-407c-9b9f-01ed5fa7c4ec.temp_image.9537d10d-30b7-495a-ae1d-34d1eaa21d3ff4mzqi05.img {{(pid=86553) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 09:26:50 devstack cinder-volume[86553]: INFO cinder.image.image_utils [None req-f5a9fdee-0d08-42a8-92b8-6c1e8d0cb50c tempest-VolumesActionsTest-1710709349 None] Converted 1024.00 MB image at 109.23 MB/s Sep 28 09:26:50 devstack cinder-volume[86553]: DEBUG cinder.image.image_utils [None req-f5a9fdee-0d08-42a8-92b8-6c1e8d0cb50c tempest-VolumesActionsTest-1710709349 None] 9537d10d-30b7-495a-ae1d-34d1eaa21d3f was raw, converting to qcow2 {{(pid=86553) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Sep 28 09:26:50 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cac50b4-6067-4228-ae23-59e91b7f11ab]: (4, 'raw') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:26:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f5a9fdee-0d08-42a8-92b8-6c1e8d0cb50c tempest-VolumesActionsTest-1710709349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/13cba42c-0ecc-407c-9b9f-01ed5fa7c4ec.temp_image.9537d10d-30b7-495a-ae1d-34d1eaa21d3ff4mzqi05.img {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:26:50 devstack sudo[93338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/13cba42c-0ecc-407c-9b9f-01ed5fa7c4ec.temp_image.9537d10d-30b7-495a-ae1d-34d1eaa21d3ff4mzqi05.img Sep 28 09:26:50 devstack sudo[93338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:26:50 devstack sudo[93338]: pam_unix(sudo:session): session closed for user root Sep 28 09:26:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f5a9fdee-0d08-42a8-92b8-6c1e8d0cb50c tempest-VolumesActionsTest-1710709349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/13cba42c-0ecc-407c-9b9f-01ed5fa7c4ec.temp_image.9537d10d-30b7-495a-ae1d-34d1eaa21d3ff4mzqi05.img" returned: 0 in 0.354s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:26:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f5a9fdee-0d08-42a8-92b8-6c1e8d0cb50c tempest-VolumesActionsTest-1710709349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/13cba42c-0ecc-407c-9b9f-01ed5fa7c4ec.temp_image.9537d10d-30b7-495a-ae1d-34d1eaa21d3ff4mzqi05.img {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:26:51 devstack sudo[93342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/13cba42c-0ecc-407c-9b9f-01ed5fa7c4ec.temp_image.9537d10d-30b7-495a-ae1d-34d1eaa21d3ff4mzqi05.img Sep 28 09:26:51 devstack sudo[93342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:26:51 devstack sudo[93342]: pam_unix(sudo:session): session closed for user root Sep 28 09:26:51 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f5a9fdee-0d08-42a8-92b8-6c1e8d0cb50c tempest-VolumesActionsTest-1710709349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/13cba42c-0ecc-407c-9b9f-01ed5fa7c4ec.temp_image.9537d10d-30b7-495a-ae1d-34d1eaa21d3ff4mzqi05.img" returned: 1 in 0.330s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:26:51 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f5a9fdee-0d08-42a8-92b8-6c1e8d0cb50c tempest-VolumesActionsTest-1710709349 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/13cba42c-0ecc-407c-9b9f-01ed5fa7c4ec.temp_image.9537d10d-30b7-495a-ae1d-34d1eaa21d3ff4mzqi05.img' failed. Not Retrying. {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 09:26:51 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f5a9fdee-0d08-42a8-92b8-6c1e8d0cb50c tempest-VolumesActionsTest-1710709349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/13cba42c-0ecc-407c-9b9f-01ed5fa7c4ec.temp_image.9537d10d-30b7-495a-ae1d-34d1eaa21d3ff4mzqi05.img /opt/stack/data/cinder/conversion/vol_upload_px3wcsfx {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:26:51 devstack sudo[93347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/13cba42c-0ecc-407c-9b9f-01ed5fa7c4ec.temp_image.9537d10d-30b7-495a-ae1d-34d1eaa21d3ff4mzqi05.img /opt/stack/data/cinder/conversion/vol_upload_px3wcsfx Sep 28 09:26:51 devstack sudo[93347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:26:51 devstack sudo[93347]: pam_unix(sudo:session): session closed for user root Sep 28 09:26:51 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f5a9fdee-0d08-42a8-92b8-6c1e8d0cb50c tempest-VolumesActionsTest-1710709349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/13cba42c-0ecc-407c-9b9f-01ed5fa7c4ec.temp_image.9537d10d-30b7-495a-ae1d-34d1eaa21d3ff4mzqi05.img /opt/stack/data/cinder/conversion/vol_upload_px3wcsfx" returned: 0 in 0.265s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:26:51 devstack cinder-volume[86553]: DEBUG cinder.image.image_utils [None req-f5a9fdee-0d08-42a8-92b8-6c1e8d0cb50c tempest-VolumesActionsTest-1710709349 None] Image conversion details: src /opt/stack/data/cinder/conversion/13cba42c-0ecc-407c-9b9f-01ed5fa7c4ec.temp_image.9537d10d-30b7-495a-ae1d-34d1eaa21d3ff4mzqi05.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_px3wcsfx {{(pid=86553) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 09:26:51 devstack cinder-volume[86553]: INFO cinder.image.image_utils [None req-f5a9fdee-0d08-42a8-92b8-6c1e8d0cb50c tempest-VolumesActionsTest-1710709349 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 28 09:26:51 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[458643fd-d045-41d2-b2d3-970986259188]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:26:51 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f5a9fdee-0d08-42a8-92b8-6c1e8d0cb50c tempest-VolumesActionsTest-1710709349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_px3wcsfx {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:26:51 devstack sudo[93352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_px3wcsfx Sep 28 09:26:51 devstack sudo[93352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:26:51 devstack sudo[93352]: pam_unix(sudo:session): session closed for user root Sep 28 09:26:51 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f5a9fdee-0d08-42a8-92b8-6c1e8d0cb50c tempest-VolumesActionsTest-1710709349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_px3wcsfx" returned: 0 in 0.336s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:26:53 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-f5a9fdee-0d08-42a8-92b8-6c1e8d0cb50c tempest-VolumesActionsTest-1710709349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 14.379s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:26:53 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-f5a9fdee-0d08-42a8-92b8-6c1e8d0cb50c tempest-VolumesActionsTest-1710709349 None] Uploaded volume to glance image-id: 9537d10d-30b7-495a-ae1d-34d1eaa21d3f. {{(pid=86553) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 28 09:26:53 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-d8016543-ca59-423e-bfd3-013252dc791b req-5c645bc8-95c9-45dc-8649-e0753b9cd5c8 tempest-AttachVolumeTestJSON-612710564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 13.920s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:26:53 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-d8016543-ca59-423e-bfd3-013252dc791b req-5c645bc8-95c9-45dc-8649-e0753b9cd5c8 tempest-AttachVolumeTestJSON-612710564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:26:53 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-fbed0cb4-faa8-450b-b17b-488fd00c63f7 req-8ac73d34-5223-4024-89c9-0e4532f05ade tempest-AttachVolumeNegativeTest-1957606009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 12.767s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:26:53 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-f5a9fdee-0d08-42a8-92b8-6c1e8d0cb50c tempest-VolumesActionsTest-1710709349 None] Copy volume to image completed successfully. Sep 28 09:26:53 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-fbed0cb4-faa8-450b-b17b-488fd00c63f7 req-8ac73d34-5223-4024-89c9-0e4532f05ade tempest-AttachVolumeNegativeTest-1957606009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:26:53 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [req-d8016543-ca59-423e-bfd3-013252dc791b req-5c645bc8-95c9-45dc-8649-e0753b9cd5c8 tempest-AttachVolumeTestJSON-612710564 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d', 'name': 'volume-08c84622-bed2-4bb3-bca9-9510553de117', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '305340b9-6200-418e-8913-c0e849a851ad', 'enforce_multipath': True} {{(pid=86553) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 09:26:53 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [req-fbed0cb4-faa8-450b-b17b-488fd00c63f7 req-8ac73d34-5223-4024-89c9-0e4532f05ade tempest-AttachVolumeNegativeTest-1957606009 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d', 'name': 'volume-60f61781-9f97-4d66-99bc-0b097e7f349f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8d285cc1-39fb-4f87-86c8-54c326650ce8', 'enforce_multipath': True} {{(pid=86553) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 09:26:53 devstack cinder-volume[86553]: INFO cinder.volume.manager [req-d8016543-ca59-423e-bfd3-013252dc791b req-5c645bc8-95c9-45dc-8649-e0753b9cd5c8 tempest-AttachVolumeTestJSON-612710564 None] attachment_update completed successfully. Sep 28 09:26:53 devstack cinder-volume[86553]: INFO cinder.volume.manager [req-fbed0cb4-faa8-450b-b17b-488fd00c63f7 req-8ac73d34-5223-4024-89c9-0e4532f05ade tempest-AttachVolumeNegativeTest-1957606009 None] attachment_update completed successfully. Sep 28 09:26:54 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc72f556-596e-46dc-bcb2-e1a20eaa5d4b tempest-ServerRescueNegativeTestJSON-542829816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:26:54 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-dc72f556-596e-46dc-bcb2-e1a20eaa5d4b tempest-ServerRescueNegativeTestJSON-542829816 None] Flow 'volume_create_manager' (f4b87bbe-9d0c-447d-8071-c7ad5efb7b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:26:54 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-dc72f556-596e-46dc-bcb2-e1a20eaa5d4b tempest-ServerRescueNegativeTestJSON-542829816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a64254d-9fcc-4d87-b98e-947195524be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:26:54 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-dc72f556-596e-46dc-bcb2-e1a20eaa5d4b tempest-ServerRescueNegativeTestJSON-542829816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a64254d-9fcc-4d87-b98e-947195524be2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:26:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-140144499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b0c9e2a-765f-4733-be21-31ecabc53acd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b55bc0cbb4545059a903fb481e5a0b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:26:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:26:54Z,use_quota=True,user_id='fdf91f9907384c8ba90ca64de5b3681e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:26:54 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-dc72f556-596e-46dc-bcb2-e1a20eaa5d4b tempest-ServerRescueNegativeTestJSON-542829816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f88eab0-4167-45eb-b70c-1fbc3dcc7b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:26:54 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-dc72f556-596e-46dc-bcb2-e1a20eaa5d4b tempest-ServerRescueNegativeTestJSON-542829816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f88eab0-4167-45eb-b70c-1fbc3dcc7b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:26:54 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-dc72f556-596e-46dc-bcb2-e1a20eaa5d4b tempest-ServerRescueNegativeTestJSON-542829816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3cb9da1-639c-4ff7-92fb-a9e25f245b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:26:54 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-dc72f556-596e-46dc-bcb2-e1a20eaa5d4b tempest-ServerRescueNegativeTestJSON-542829816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3cb9da1-639c-4ff7-92fb-a9e25f245b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b0c9e2a-765f-4733-be21-31ecabc53acd', 'volume_name': 'volume-6b0c9e2a-765f-4733-be21-31ecabc53acd', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:26:54 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-dc72f556-596e-46dc-bcb2-e1a20eaa5d4b tempest-ServerRescueNegativeTestJSON-542829816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86ad989a-8c2f-4f2c-94a3-ba227b235365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:26:54 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-dc72f556-596e-46dc-bcb2-e1a20eaa5d4b tempest-ServerRescueNegativeTestJSON-542829816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86ad989a-8c2f-4f2c-94a3-ba227b235365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:26:54 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-dc72f556-596e-46dc-bcb2-e1a20eaa5d4b tempest-ServerRescueNegativeTestJSON-542829816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6623809a-e40a-4b7e-926a-17d6fd807813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:26:54 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-dc72f556-596e-46dc-bcb2-e1a20eaa5d4b tempest-ServerRescueNegativeTestJSON-542829816 None] Volume 6b0c9e2a-765f-4733-be21-31ecabc53acd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b0c9e2a-765f-4733-be21-31ecabc53acd', 'volume_size': 1} Sep 28 09:26:54 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-dc72f556-596e-46dc-bcb2-e1a20eaa5d4b tempest-ServerRescueNegativeTestJSON-542829816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:26:54 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-dc72f556-596e-46dc-bcb2-e1a20eaa5d4b tempest-ServerRescueNegativeTestJSON-542829816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:26:54 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-dc72f556-596e-46dc-bcb2-e1a20eaa5d4b tempest-ServerRescueNegativeTestJSON-542829816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:26:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-140144499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b0c9e2a-765f-4733-be21-31ecabc53acd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b55bc0cbb4545059a903fb481e5a0b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:26:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:26:54Z,use_quota=True,user_id='fdf91f9907384c8ba90ca64de5b3681e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:26:54 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-dc72f556-596e-46dc-bcb2-e1a20eaa5d4b tempest-ServerRescueNegativeTestJSON-542829816 None] Creating volume 6b0c9e2a-765f-4733-be21-31ecabc53acd {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:26:54 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-dc72f556-596e-46dc-bcb2-e1a20eaa5d4b tempest-ServerRescueNegativeTestJSON-542829816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:26:54 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-dc72f556-596e-46dc-bcb2-e1a20eaa5d4b tempest-ServerRescueNegativeTestJSON-542829816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:26:54 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-dc72f556-596e-46dc-bcb2-e1a20eaa5d4b tempest-ServerRescueNegativeTestJSON-542829816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:26:54 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-dc72f556-596e-46dc-bcb2-e1a20eaa5d4b tempest-ServerRescueNegativeTestJSON-542829816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:26:54 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-dc72f556-596e-46dc-bcb2-e1a20eaa5d4b tempest-ServerRescueNegativeTestJSON-542829816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:26:54 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-dc72f556-596e-46dc-bcb2-e1a20eaa5d4b tempest-ServerRescueNegativeTestJSON-542829816 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:26:54 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-dc72f556-596e-46dc-bcb2-e1a20eaa5d4b tempest-ServerRescueNegativeTestJSON-542829816 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:26:54 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-dc72f556-596e-46dc-bcb2-e1a20eaa5d4b tempest-ServerRescueNegativeTestJSON-542829816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6b0c9e2a-765f-4733-be21-31ecabc53acd 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:26:54 devstack sudo[93778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6b0c9e2a-765f-4733-be21-31ecabc53acd 1073741824 Sep 28 09:26:54 devstack sudo[93778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:26:55 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-e2f4aea0-37f8-47d0-914a-ffcc7dc4de87 tempest-VolumesActionsTest-1710709349 None] Acquiring lock "cinder-13cba42c-0ecc-407c-9b9f-01ed5fa7c4ec-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:26:55 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-e2f4aea0-37f8-47d0-914a-ffcc7dc4de87 tempest-VolumesActionsTest-1710709349 None] Lock "cinder-13cba42c-0ecc-407c-9b9f-01ed5fa7c4ec-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:26:55 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-e2f4aea0-37f8-47d0-914a-ffcc7dc4de87 tempest-VolumesActionsTest-1710709349 None] Acquiring lock "cinder-quobyte-13cba42c-0ecc-407c-9b9f-01ed5fa7c4ec" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:26:55 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-e2f4aea0-37f8-47d0-914a-ffcc7dc4de87 tempest-VolumesActionsTest-1710709349 None] Lock "cinder-quobyte-13cba42c-0ecc-407c-9b9f-01ed5fa7c4ec" acquired by "delete_volume" :: waited 0.016s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:26:55 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[83eb3b37-34a4-47c3-94af-df269dbb177b]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:26:55 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e2f4aea0-37f8-47d0-914a-ffcc7dc4de87 tempest-VolumesActionsTest-1710709349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-13cba42c-0ecc-407c-9b9f-01ed5fa7c4ec {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:26:55 devstack sudo[93778]: pam_unix(sudo:session): session closed for user root Sep 28 09:26:55 devstack sudo[93785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-13cba42c-0ecc-407c-9b9f-01ed5fa7c4ec Sep 28 09:26:55 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-dc72f556-596e-46dc-bcb2-e1a20eaa5d4b tempest-ServerRescueNegativeTestJSON-542829816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6b0c9e2a-765f-4733-be21-31ecabc53acd 1073741824" returned: 0 in 0.861s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:26:55 devstack sudo[93785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:26:55 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-dc72f556-596e-46dc-bcb2-e1a20eaa5d4b tempest-ServerRescueNegativeTestJSON-542829816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6b0c9e2a-765f-4733-be21-31ecabc53acd {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:26:55 devstack sudo[93787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6b0c9e2a-765f-4733-be21-31ecabc53acd Sep 28 09:26:55 devstack sudo[93787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:26:55 devstack sudo[93785]: pam_unix(sudo:session): session closed for user root Sep 28 09:26:55 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e2f4aea0-37f8-47d0-914a-ffcc7dc4de87 tempest-VolumesActionsTest-1710709349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-13cba42c-0ecc-407c-9b9f-01ed5fa7c4ec" returned: 0 in 0.535s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:26:55 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e2f4aea0-37f8-47d0-914a-ffcc7dc4de87 tempest-VolumesActionsTest-1710709349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-13cba42c-0ecc-407c-9b9f-01ed5fa7c4ec {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:26:55 devstack sudo[93787]: pam_unix(sudo:session): session closed for user root Sep 28 09:26:55 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-dc72f556-596e-46dc-bcb2-e1a20eaa5d4b tempest-ServerRescueNegativeTestJSON-542829816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6b0c9e2a-765f-4733-be21-31ecabc53acd" returned: 0 in 0.344s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:26:55 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-dc72f556-596e-46dc-bcb2-e1a20eaa5d4b tempest-ServerRescueNegativeTestJSON-542829816 None] <== create_volume: return (1298ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:26:55 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-dc72f556-596e-46dc-bcb2-e1a20eaa5d4b tempest-ServerRescueNegativeTestJSON-542829816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.303s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:26:55 devstack sudo[93793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-13cba42c-0ecc-407c-9b9f-01ed5fa7c4ec Sep 28 09:26:55 devstack sudo[93793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:26:55 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-dc72f556-596e-46dc-bcb2-e1a20eaa5d4b tempest-ServerRescueNegativeTestJSON-542829816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6623809a-e40a-4b7e-926a-17d6fd807813) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b0c9e2a-765f-4733-be21-31ecabc53acd', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:26:55 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-dc72f556-596e-46dc-bcb2-e1a20eaa5d4b tempest-ServerRescueNegativeTestJSON-542829816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf1da641-ac3f-499a-bfb5-f2e4b467b404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:26:55 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-dc72f556-596e-46dc-bcb2-e1a20eaa5d4b tempest-ServerRescueNegativeTestJSON-542829816 None] Volume volume-6b0c9e2a-765f-4733-be21-31ecabc53acd (6b0c9e2a-765f-4733-be21-31ecabc53acd): created successfully Sep 28 09:26:55 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-dc72f556-596e-46dc-bcb2-e1a20eaa5d4b tempest-ServerRescueNegativeTestJSON-542829816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf1da641-ac3f-499a-bfb5-f2e4b467b404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:26:55 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-dc72f556-596e-46dc-bcb2-e1a20eaa5d4b tempest-ServerRescueNegativeTestJSON-542829816 None] Flow 'volume_create_manager' (f4b87bbe-9d0c-447d-8071-c7ad5efb7b78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:26:55 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-dc72f556-596e-46dc-bcb2-e1a20eaa5d4b tempest-ServerRescueNegativeTestJSON-542829816 None] Created volume successfully. Sep 28 09:26:56 devstack sudo[93793]: pam_unix(sudo:session): session closed for user root Sep 28 09:26:56 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e2f4aea0-37f8-47d0-914a-ffcc7dc4de87 tempest-VolumesActionsTest-1710709349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-13cba42c-0ecc-407c-9b9f-01ed5fa7c4ec" returned: 0 in 0.353s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:26:56 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-e2f4aea0-37f8-47d0-914a-ffcc7dc4de87 tempest-VolumesActionsTest-1710709349 None] Lock "cinder-quobyte-13cba42c-0ecc-407c-9b9f-01ed5fa7c4ec" released by "delete_volume" :: held 0.974s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:26:56 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-e2f4aea0-37f8-47d0-914a-ffcc7dc4de87 tempest-VolumesActionsTest-1710709349 None] Created reservations ['a99712cf-10da-4cdf-9174-d7bb35e22e49', 'd73eb4d7-b87a-45c6-bf2e-72cc16a15e68', '64b17b94-292d-4e1f-85a2-3e2cf246829b', '96f18314-3fcd-4914-a009-9521fbcab481'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:26:56 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-e2f4aea0-37f8-47d0-914a-ffcc7dc4de87 tempest-VolumesActionsTest-1710709349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:26:56 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-e2f4aea0-37f8-47d0-914a-ffcc7dc4de87 tempest-VolumesActionsTest-1710709349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:26:56 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-e2f4aea0-37f8-47d0-914a-ffcc7dc4de87 tempest-VolumesActionsTest-1710709349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:26:56 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-e2f4aea0-37f8-47d0-914a-ffcc7dc4de87 tempest-VolumesActionsTest-1710709349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:26:56 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-e2f4aea0-37f8-47d0-914a-ffcc7dc4de87 tempest-VolumesActionsTest-1710709349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:26:56 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e2f4aea0-37f8-47d0-914a-ffcc7dc4de87 tempest-VolumesActionsTest-1710709349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:26:56 devstack sudo[93800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:26:56 devstack sudo[93800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:26:57 devstack sudo[93800]: pam_unix(sudo:session): session closed for user root Sep 28 09:26:57 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e2f4aea0-37f8-47d0-914a-ffcc7dc4de87 tempest-VolumesActionsTest-1710709349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.540s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:26:57 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-e2f4aea0-37f8-47d0-914a-ffcc7dc4de87 tempest-VolumesActionsTest-1710709349 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:26:57 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-e2f4aea0-37f8-47d0-914a-ffcc7dc4de87 tempest-VolumesActionsTest-1710709349 None] Deleted volume successfully. Sep 28 09:26:57 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-e2f4aea0-37f8-47d0-914a-ffcc7dc4de87 tempest-VolumesActionsTest-1710709349 None] Lock "cinder-13cba42c-0ecc-407c-9b9f-01ed5fa7c4ec-delete_volume" released by "delete_volume" :: held 2.064s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:27:06 devstack cinder-volume[86553]: DEBUG dbcounter [-] [86553] Writing DB stats cinder:UPDATE=10,cinder:SELECT=26,cinder:INSERT=1 {{(pid=86553) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 09:27:07 devstack cinder-volume[86553]: DEBUG dbcounter [-] [86553] Writing DB stats cinder:SELECT=13,cinder:UPDATE=19,cinder:INSERT=4,cinder:DELETE=2 {{(pid=86553) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 09:27:15 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbf71722-9bd3-4b47-9923-a63b22530a00 tempest-VolumesListTestJSON-1957255114 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:27:15 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-cbf71722-9bd3-4b47-9923-a63b22530a00 tempest-VolumesListTestJSON-1957255114 None] Flow 'volume_create_manager' (e2048a81-e648-4027-9f4b-786b1a332d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:27:15 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-cbf71722-9bd3-4b47-9923-a63b22530a00 tempest-VolumesListTestJSON-1957255114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (772c4d64-65a5-4063-b85e-0d09f6356794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:27:15 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-cbf71722-9bd3-4b47-9923-a63b22530a00 tempest-VolumesListTestJSON-1957255114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (772c4d64-65a5-4063-b85e-0d09f6356794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:27:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2123353967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a583c824-3185-4557-bfc9-577ee9822d3e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cb1925e2950d4c1db68c96928e196653',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:27:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:27:15Z,use_quota=True,user_id='308c846ac37b4207b0a4f51bf14e66b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:27:15 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-cbf71722-9bd3-4b47-9923-a63b22530a00 tempest-VolumesListTestJSON-1957255114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5ecaefe-9e04-4d10-866b-77d971e43293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:27:15 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-cbf71722-9bd3-4b47-9923-a63b22530a00 tempest-VolumesListTestJSON-1957255114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5ecaefe-9e04-4d10-866b-77d971e43293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:27:15 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-cbf71722-9bd3-4b47-9923-a63b22530a00 tempest-VolumesListTestJSON-1957255114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86da264d-7b74-4fc1-b221-78b841de600d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:27:15 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-cbf71722-9bd3-4b47-9923-a63b22530a00 tempest-VolumesListTestJSON-1957255114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86da264d-7b74-4fc1-b221-78b841de600d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a583c824-3185-4557-bfc9-577ee9822d3e', 'volume_name': 'volume-a583c824-3185-4557-bfc9-577ee9822d3e', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:27:15 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-cbf71722-9bd3-4b47-9923-a63b22530a00 tempest-VolumesListTestJSON-1957255114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8771315-41d7-4973-874a-a13d99cb9361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:27:15 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-cbf71722-9bd3-4b47-9923-a63b22530a00 tempest-VolumesListTestJSON-1957255114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8771315-41d7-4973-874a-a13d99cb9361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:27:15 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-cbf71722-9bd3-4b47-9923-a63b22530a00 tempest-VolumesListTestJSON-1957255114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (928a563f-abcd-43f4-9dad-b21754453ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:27:15 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-cbf71722-9bd3-4b47-9923-a63b22530a00 tempest-VolumesListTestJSON-1957255114 None] Volume a583c824-3185-4557-bfc9-577ee9822d3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a583c824-3185-4557-bfc9-577ee9822d3e', 'volume_size': 1} Sep 28 09:27:15 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-cbf71722-9bd3-4b47-9923-a63b22530a00 tempest-VolumesListTestJSON-1957255114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:27:15 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-cbf71722-9bd3-4b47-9923-a63b22530a00 tempest-VolumesListTestJSON-1957255114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:27:15 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-cbf71722-9bd3-4b47-9923-a63b22530a00 tempest-VolumesListTestJSON-1957255114 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:27:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2123353967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a583c824-3185-4557-bfc9-577ee9822d3e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cb1925e2950d4c1db68c96928e196653',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:27:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:27:15Z,use_quota=True,user_id='308c846ac37b4207b0a4f51bf14e66b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:27:15 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-cbf71722-9bd3-4b47-9923-a63b22530a00 tempest-VolumesListTestJSON-1957255114 None] Creating volume a583c824-3185-4557-bfc9-577ee9822d3e {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:27:15 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-cbf71722-9bd3-4b47-9923-a63b22530a00 tempest-VolumesListTestJSON-1957255114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:27:15 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-cbf71722-9bd3-4b47-9923-a63b22530a00 tempest-VolumesListTestJSON-1957255114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:27:15 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-cbf71722-9bd3-4b47-9923-a63b22530a00 tempest-VolumesListTestJSON-1957255114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:27:15 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-cbf71722-9bd3-4b47-9923-a63b22530a00 tempest-VolumesListTestJSON-1957255114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:27:15 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-cbf71722-9bd3-4b47-9923-a63b22530a00 tempest-VolumesListTestJSON-1957255114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:27:15 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-cbf71722-9bd3-4b47-9923-a63b22530a00 tempest-VolumesListTestJSON-1957255114 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:27:15 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-cbf71722-9bd3-4b47-9923-a63b22530a00 tempest-VolumesListTestJSON-1957255114 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:27:15 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-cbf71722-9bd3-4b47-9923-a63b22530a00 tempest-VolumesListTestJSON-1957255114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a583c824-3185-4557-bfc9-577ee9822d3e 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:27:15 devstack sudo[94205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a583c824-3185-4557-bfc9-577ee9822d3e 1073741824 Sep 28 09:27:15 devstack sudo[94205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:27:17 devstack sudo[94205]: pam_unix(sudo:session): session closed for user root Sep 28 09:27:17 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-cbf71722-9bd3-4b47-9923-a63b22530a00 tempest-VolumesListTestJSON-1957255114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a583c824-3185-4557-bfc9-577ee9822d3e 1073741824" returned: 0 in 1.285s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:27:17 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-cbf71722-9bd3-4b47-9923-a63b22530a00 tempest-VolumesListTestJSON-1957255114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a583c824-3185-4557-bfc9-577ee9822d3e {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:27:17 devstack sudo[94225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a583c824-3185-4557-bfc9-577ee9822d3e Sep 28 09:27:17 devstack sudo[94225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:27:17 devstack sudo[94225]: pam_unix(sudo:session): session closed for user root Sep 28 09:27:17 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-cbf71722-9bd3-4b47-9923-a63b22530a00 tempest-VolumesListTestJSON-1957255114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a583c824-3185-4557-bfc9-577ee9822d3e" returned: 0 in 0.358s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:27:17 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-cbf71722-9bd3-4b47-9923-a63b22530a00 tempest-VolumesListTestJSON-1957255114 None] <== create_volume: return (1729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:27:17 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-cbf71722-9bd3-4b47-9923-a63b22530a00 tempest-VolumesListTestJSON-1957255114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.735s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:27:17 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-cbf71722-9bd3-4b47-9923-a63b22530a00 tempest-VolumesListTestJSON-1957255114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (928a563f-abcd-43f4-9dad-b21754453ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a583c824-3185-4557-bfc9-577ee9822d3e', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:27:17 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-cbf71722-9bd3-4b47-9923-a63b22530a00 tempest-VolumesListTestJSON-1957255114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f025131-7e29-4e55-9b8a-fe790810999b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:27:17 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-cbf71722-9bd3-4b47-9923-a63b22530a00 tempest-VolumesListTestJSON-1957255114 None] Volume volume-a583c824-3185-4557-bfc9-577ee9822d3e (a583c824-3185-4557-bfc9-577ee9822d3e): created successfully Sep 28 09:27:17 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-cbf71722-9bd3-4b47-9923-a63b22530a00 tempest-VolumesListTestJSON-1957255114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f025131-7e29-4e55-9b8a-fe790810999b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:27:17 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-cbf71722-9bd3-4b47-9923-a63b22530a00 tempest-VolumesListTestJSON-1957255114 None] Flow 'volume_create_manager' (e2048a81-e648-4027-9f4b-786b1a332d3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:27:17 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-cbf71722-9bd3-4b47-9923-a63b22530a00 tempest-VolumesListTestJSON-1957255114 None] Created volume successfully. Sep 28 09:27:18 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-19d27fb8-281f-4fe3-b8bf-2cc4bcc152b5 tempest-ServerRescueNegativeTestJSON-542829816 None] Acquiring lock "cinder-6b0c9e2a-765f-4733-be21-31ecabc53acd-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:27:18 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-19d27fb8-281f-4fe3-b8bf-2cc4bcc152b5 tempest-ServerRescueNegativeTestJSON-542829816 None] Lock "cinder-6b0c9e2a-765f-4733-be21-31ecabc53acd-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:27:18 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-19d27fb8-281f-4fe3-b8bf-2cc4bcc152b5 tempest-ServerRescueNegativeTestJSON-542829816 None] Acquiring lock "cinder-quobyte-6b0c9e2a-765f-4733-be21-31ecabc53acd" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:27:18 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-19d27fb8-281f-4fe3-b8bf-2cc4bcc152b5 tempest-ServerRescueNegativeTestJSON-542829816 None] Lock "cinder-quobyte-6b0c9e2a-765f-4733-be21-31ecabc53acd" acquired by "delete_volume" :: waited 0.039s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:27:18 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1797f2d-085f-46c0-9453-a7663183076e]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:27:18 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-19d27fb8-281f-4fe3-b8bf-2cc4bcc152b5 tempest-ServerRescueNegativeTestJSON-542829816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6b0c9e2a-765f-4733-be21-31ecabc53acd {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:27:18 devstack sudo[94246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6b0c9e2a-765f-4733-be21-31ecabc53acd Sep 28 09:27:18 devstack sudo[94246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:27:19 devstack sudo[94246]: pam_unix(sudo:session): session closed for user root Sep 28 09:27:19 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-19d27fb8-281f-4fe3-b8bf-2cc4bcc152b5 tempest-ServerRescueNegativeTestJSON-542829816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6b0c9e2a-765f-4733-be21-31ecabc53acd" returned: 0 in 1.295s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:27:19 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-19d27fb8-281f-4fe3-b8bf-2cc4bcc152b5 tempest-ServerRescueNegativeTestJSON-542829816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6b0c9e2a-765f-4733-be21-31ecabc53acd {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:27:20 devstack sudo[94253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6b0c9e2a-765f-4733-be21-31ecabc53acd Sep 28 09:27:20 devstack sudo[94253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:27:20 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-062c90ab-de51-4c46-bcfb-f640ab927fdd tempest-VolumesListTestJSON-1957255114 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:27:20 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-062c90ab-de51-4c46-bcfb-f640ab927fdd tempest-VolumesListTestJSON-1957255114 None] Flow 'volume_create_manager' (91574b33-e8ec-4b45-beb0-d87e11bb6f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:27:20 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-062c90ab-de51-4c46-bcfb-f640ab927fdd tempest-VolumesListTestJSON-1957255114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a70f44f8-4ff2-4431-adfb-d9b44fc922ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:27:20 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-062c90ab-de51-4c46-bcfb-f640ab927fdd tempest-VolumesListTestJSON-1957255114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a70f44f8-4ff2-4431-adfb-d9b44fc922ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:27:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-521015728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3feb106e-6371-4006-86d5-468c28904a07,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cb1925e2950d4c1db68c96928e196653',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:27:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:27:20Z,use_quota=True,user_id='308c846ac37b4207b0a4f51bf14e66b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:27:20 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-062c90ab-de51-4c46-bcfb-f640ab927fdd tempest-VolumesListTestJSON-1957255114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (865e1c34-bff4-41f1-8bdd-ac4ed9561dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:27:20 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-062c90ab-de51-4c46-bcfb-f640ab927fdd tempest-VolumesListTestJSON-1957255114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (865e1c34-bff4-41f1-8bdd-ac4ed9561dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:27:20 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-062c90ab-de51-4c46-bcfb-f640ab927fdd tempest-VolumesListTestJSON-1957255114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db225f9a-a8c0-4dbc-8a39-862f94077db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:27:20 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-062c90ab-de51-4c46-bcfb-f640ab927fdd tempest-VolumesListTestJSON-1957255114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db225f9a-a8c0-4dbc-8a39-862f94077db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3feb106e-6371-4006-86d5-468c28904a07', 'volume_name': 'volume-3feb106e-6371-4006-86d5-468c28904a07', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:27:20 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-062c90ab-de51-4c46-bcfb-f640ab927fdd tempest-VolumesListTestJSON-1957255114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fde4c002-ac93-495d-809e-a36934a0c248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:27:20 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-062c90ab-de51-4c46-bcfb-f640ab927fdd tempest-VolumesListTestJSON-1957255114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fde4c002-ac93-495d-809e-a36934a0c248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:27:20 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-062c90ab-de51-4c46-bcfb-f640ab927fdd tempest-VolumesListTestJSON-1957255114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ceba3d3e-8444-4810-8b85-286afe3d204a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:27:20 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-062c90ab-de51-4c46-bcfb-f640ab927fdd tempest-VolumesListTestJSON-1957255114 None] Volume 3feb106e-6371-4006-86d5-468c28904a07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3feb106e-6371-4006-86d5-468c28904a07', 'volume_size': 1} Sep 28 09:27:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-062c90ab-de51-4c46-bcfb-f640ab927fdd tempest-VolumesListTestJSON-1957255114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:27:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-062c90ab-de51-4c46-bcfb-f640ab927fdd tempest-VolumesListTestJSON-1957255114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:27:20 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-062c90ab-de51-4c46-bcfb-f640ab927fdd tempest-VolumesListTestJSON-1957255114 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:27:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-521015728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3feb106e-6371-4006-86d5-468c28904a07,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cb1925e2950d4c1db68c96928e196653',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:27:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:27:20Z,use_quota=True,user_id='308c846ac37b4207b0a4f51bf14e66b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:27:20 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-062c90ab-de51-4c46-bcfb-f640ab927fdd tempest-VolumesListTestJSON-1957255114 None] Creating volume 3feb106e-6371-4006-86d5-468c28904a07 {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:27:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-062c90ab-de51-4c46-bcfb-f640ab927fdd tempest-VolumesListTestJSON-1957255114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:27:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-062c90ab-de51-4c46-bcfb-f640ab927fdd tempest-VolumesListTestJSON-1957255114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:27:20 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-062c90ab-de51-4c46-bcfb-f640ab927fdd tempest-VolumesListTestJSON-1957255114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:27:20 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-062c90ab-de51-4c46-bcfb-f640ab927fdd tempest-VolumesListTestJSON-1957255114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:27:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-062c90ab-de51-4c46-bcfb-f640ab927fdd tempest-VolumesListTestJSON-1957255114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:27:20 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-062c90ab-de51-4c46-bcfb-f640ab927fdd tempest-VolumesListTestJSON-1957255114 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:27:20 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-062c90ab-de51-4c46-bcfb-f640ab927fdd tempest-VolumesListTestJSON-1957255114 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:27:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-062c90ab-de51-4c46-bcfb-f640ab927fdd tempest-VolumesListTestJSON-1957255114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3feb106e-6371-4006-86d5-468c28904a07 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:27:20 devstack sudo[94253]: pam_unix(sudo:session): session closed for user root Sep 28 09:27:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-19d27fb8-281f-4fe3-b8bf-2cc4bcc152b5 tempest-ServerRescueNegativeTestJSON-542829816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6b0c9e2a-765f-4733-be21-31ecabc53acd" returned: 0 in 0.577s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:27:20 devstack sudo[94257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3feb106e-6371-4006-86d5-468c28904a07 1073741824 Sep 28 09:27:20 devstack sudo[94257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:27:20 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-19d27fb8-281f-4fe3-b8bf-2cc4bcc152b5 tempest-ServerRescueNegativeTestJSON-542829816 None] Lock "cinder-quobyte-6b0c9e2a-765f-4733-be21-31ecabc53acd" released by "delete_volume" :: held 1.991s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:27:20 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-19d27fb8-281f-4fe3-b8bf-2cc4bcc152b5 tempest-ServerRescueNegativeTestJSON-542829816 None] Created reservations ['beb94ef4-c3dc-474f-ad8e-71b316ea6ae1', '0b68bea0-2c53-4ec6-a40c-5d2bb48b580e', '1c2dfe69-d45d-4354-9703-477d547eb268', '4931bad5-d649-4b8a-adf7-6876a0ace874'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:27:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-19d27fb8-281f-4fe3-b8bf-2cc4bcc152b5 tempest-ServerRescueNegativeTestJSON-542829816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:27:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-19d27fb8-281f-4fe3-b8bf-2cc4bcc152b5 tempest-ServerRescueNegativeTestJSON-542829816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:27:20 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-19d27fb8-281f-4fe3-b8bf-2cc4bcc152b5 tempest-ServerRescueNegativeTestJSON-542829816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:27:20 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-19d27fb8-281f-4fe3-b8bf-2cc4bcc152b5 tempest-ServerRescueNegativeTestJSON-542829816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:27:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-19d27fb8-281f-4fe3-b8bf-2cc4bcc152b5 tempest-ServerRescueNegativeTestJSON-542829816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:27:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-19d27fb8-281f-4fe3-b8bf-2cc4bcc152b5 tempest-ServerRescueNegativeTestJSON-542829816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:27:20 devstack sudo[94259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:27:20 devstack sudo[94259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:27:21 devstack sudo[94259]: pam_unix(sudo:session): session closed for user root Sep 28 09:27:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-19d27fb8-281f-4fe3-b8bf-2cc4bcc152b5 tempest-ServerRescueNegativeTestJSON-542829816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.491s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:27:21 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-19d27fb8-281f-4fe3-b8bf-2cc4bcc152b5 tempest-ServerRescueNegativeTestJSON-542829816 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:27:21 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-19d27fb8-281f-4fe3-b8bf-2cc4bcc152b5 tempest-ServerRescueNegativeTestJSON-542829816 None] Deleted volume successfully. Sep 28 09:27:21 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-19d27fb8-281f-4fe3-b8bf-2cc4bcc152b5 tempest-ServerRescueNegativeTestJSON-542829816 None] Lock "cinder-6b0c9e2a-765f-4733-be21-31ecabc53acd-delete_volume" released by "delete_volume" :: held 2.991s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:27:21 devstack cinder-volume[86553]: DEBUG oslo_service.periodic_task [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86553) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 09:27:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:27:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:27:21 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:27:21 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:27:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:27:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:27:21 devstack sudo[94274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:27:21 devstack sudo[94274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:27:21 devstack sudo[94257]: pam_unix(sudo:session): session closed for user root Sep 28 09:27:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-062c90ab-de51-4c46-bcfb-f640ab927fdd tempest-VolumesListTestJSON-1957255114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3feb106e-6371-4006-86d5-468c28904a07 1073741824" returned: 0 in 1.399s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:27:22 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-062c90ab-de51-4c46-bcfb-f640ab927fdd tempest-VolumesListTestJSON-1957255114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3feb106e-6371-4006-86d5-468c28904a07 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:27:22 devstack sudo[94280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3feb106e-6371-4006-86d5-468c28904a07 Sep 28 09:27:22 devstack sudo[94280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:27:22 devstack sudo[94274]: pam_unix(sudo:session): session closed for user root Sep 28 09:27:22 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.919s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:27:22 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:27:22 devstack cinder-volume[86553]: DEBUG oslo_service.periodic_task [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Running periodic task VolumeManager._thread_info {{(pid=86553) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 09:27:22 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] thread count: 28 {{(pid=86553) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 09:27:22 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] thread info: [<_MainThread(MainThread, started 134684877779072)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86553) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 09:27:22 devstack sudo[94280]: pam_unix(sudo:session): session closed for user root Sep 28 09:27:22 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-062c90ab-de51-4c46-bcfb-f640ab927fdd tempest-VolumesListTestJSON-1957255114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3feb106e-6371-4006-86d5-468c28904a07" returned: 0 in 0.636s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:27:22 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-062c90ab-de51-4c46-bcfb-f640ab927fdd tempest-VolumesListTestJSON-1957255114 None] <== create_volume: return (2143ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:27:22 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-062c90ab-de51-4c46-bcfb-f640ab927fdd tempest-VolumesListTestJSON-1957255114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.153s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:27:22 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-062c90ab-de51-4c46-bcfb-f640ab927fdd tempest-VolumesListTestJSON-1957255114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ceba3d3e-8444-4810-8b85-286afe3d204a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3feb106e-6371-4006-86d5-468c28904a07', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:27:22 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-062c90ab-de51-4c46-bcfb-f640ab927fdd tempest-VolumesListTestJSON-1957255114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70a9cf10-f687-4c70-b710-0393e4528af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:27:22 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-062c90ab-de51-4c46-bcfb-f640ab927fdd tempest-VolumesListTestJSON-1957255114 None] Volume volume-3feb106e-6371-4006-86d5-468c28904a07 (3feb106e-6371-4006-86d5-468c28904a07): created successfully Sep 28 09:27:22 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-062c90ab-de51-4c46-bcfb-f640ab927fdd tempest-VolumesListTestJSON-1957255114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70a9cf10-f687-4c70-b710-0393e4528af0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:27:22 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-062c90ab-de51-4c46-bcfb-f640ab927fdd tempest-VolumesListTestJSON-1957255114 None] Flow 'volume_create_manager' (91574b33-e8ec-4b45-beb0-d87e11bb6f1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:27:22 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-062c90ab-de51-4c46-bcfb-f640ab927fdd tempest-VolumesListTestJSON-1957255114 None] Created volume successfully. Sep 28 09:27:25 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-aca2a8f4-8568-4648-a3cb-1d3e95623903 tempest-VolumesListTestJSON-1957255114 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:27:25 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-aca2a8f4-8568-4648-a3cb-1d3e95623903 tempest-VolumesListTestJSON-1957255114 None] Flow 'volume_create_manager' (e26166dc-0e43-44af-9947-8db9bc8efa30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:27:25 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-aca2a8f4-8568-4648-a3cb-1d3e95623903 tempest-VolumesListTestJSON-1957255114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf0e0fd5-fdb9-417e-ad28-6757d3ce23c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:27:25 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-aca2a8f4-8568-4648-a3cb-1d3e95623903 tempest-VolumesListTestJSON-1957255114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf0e0fd5-fdb9-417e-ad28-6757d3ce23c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:27:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1073618726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=205067e2-92fa-46ae-8dac-a3ff6a28a62d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cb1925e2950d4c1db68c96928e196653',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:27:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:27:25Z,use_quota=True,user_id='308c846ac37b4207b0a4f51bf14e66b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:27:25 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-aca2a8f4-8568-4648-a3cb-1d3e95623903 tempest-VolumesListTestJSON-1957255114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05ad06b6-5b0b-403b-ba01-48966751c50c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:27:25 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-aca2a8f4-8568-4648-a3cb-1d3e95623903 tempest-VolumesListTestJSON-1957255114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05ad06b6-5b0b-403b-ba01-48966751c50c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:27:25 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-aca2a8f4-8568-4648-a3cb-1d3e95623903 tempest-VolumesListTestJSON-1957255114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (533158bb-d086-4171-923b-852732d2c8cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:27:25 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-aca2a8f4-8568-4648-a3cb-1d3e95623903 tempest-VolumesListTestJSON-1957255114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (533158bb-d086-4171-923b-852732d2c8cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '205067e2-92fa-46ae-8dac-a3ff6a28a62d', 'volume_name': 'volume-205067e2-92fa-46ae-8dac-a3ff6a28a62d', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:27:25 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-aca2a8f4-8568-4648-a3cb-1d3e95623903 tempest-VolumesListTestJSON-1957255114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e58d66ad-bb79-4c98-9229-2215b91d6bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:27:25 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-aca2a8f4-8568-4648-a3cb-1d3e95623903 tempest-VolumesListTestJSON-1957255114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e58d66ad-bb79-4c98-9229-2215b91d6bb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:27:25 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-aca2a8f4-8568-4648-a3cb-1d3e95623903 tempest-VolumesListTestJSON-1957255114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dde6246c-c768-481e-b0b2-4127c94d169e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:27:25 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-aca2a8f4-8568-4648-a3cb-1d3e95623903 tempest-VolumesListTestJSON-1957255114 None] Volume 205067e2-92fa-46ae-8dac-a3ff6a28a62d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-205067e2-92fa-46ae-8dac-a3ff6a28a62d', 'volume_size': 1} Sep 28 09:27:25 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-aca2a8f4-8568-4648-a3cb-1d3e95623903 tempest-VolumesListTestJSON-1957255114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:27:25 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-aca2a8f4-8568-4648-a3cb-1d3e95623903 tempest-VolumesListTestJSON-1957255114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:27:25 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-aca2a8f4-8568-4648-a3cb-1d3e95623903 tempest-VolumesListTestJSON-1957255114 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:27:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1073618726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=205067e2-92fa-46ae-8dac-a3ff6a28a62d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cb1925e2950d4c1db68c96928e196653',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:27:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:27:25Z,use_quota=True,user_id='308c846ac37b4207b0a4f51bf14e66b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:27:25 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-aca2a8f4-8568-4648-a3cb-1d3e95623903 tempest-VolumesListTestJSON-1957255114 None] Creating volume 205067e2-92fa-46ae-8dac-a3ff6a28a62d {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:27:25 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-aca2a8f4-8568-4648-a3cb-1d3e95623903 tempest-VolumesListTestJSON-1957255114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:27:25 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-aca2a8f4-8568-4648-a3cb-1d3e95623903 tempest-VolumesListTestJSON-1957255114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:27:25 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-aca2a8f4-8568-4648-a3cb-1d3e95623903 tempest-VolumesListTestJSON-1957255114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:27:25 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-aca2a8f4-8568-4648-a3cb-1d3e95623903 tempest-VolumesListTestJSON-1957255114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:27:25 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-aca2a8f4-8568-4648-a3cb-1d3e95623903 tempest-VolumesListTestJSON-1957255114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:27:25 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-aca2a8f4-8568-4648-a3cb-1d3e95623903 tempest-VolumesListTestJSON-1957255114 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:27:25 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-aca2a8f4-8568-4648-a3cb-1d3e95623903 tempest-VolumesListTestJSON-1957255114 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:27:25 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-aca2a8f4-8568-4648-a3cb-1d3e95623903 tempest-VolumesListTestJSON-1957255114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-205067e2-92fa-46ae-8dac-a3ff6a28a62d 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:27:25 devstack sudo[94318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-205067e2-92fa-46ae-8dac-a3ff6a28a62d 1073741824 Sep 28 09:27:25 devstack sudo[94318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:27:26 devstack sudo[94318]: pam_unix(sudo:session): session closed for user root Sep 28 09:27:26 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-aca2a8f4-8568-4648-a3cb-1d3e95623903 tempest-VolumesListTestJSON-1957255114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-205067e2-92fa-46ae-8dac-a3ff6a28a62d 1073741824" returned: 0 in 0.916s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:27:26 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-aca2a8f4-8568-4648-a3cb-1d3e95623903 tempest-VolumesListTestJSON-1957255114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-205067e2-92fa-46ae-8dac-a3ff6a28a62d {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:27:26 devstack sudo[94348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-205067e2-92fa-46ae-8dac-a3ff6a28a62d Sep 28 09:27:26 devstack sudo[94348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:27:26 devstack sudo[94348]: pam_unix(sudo:session): session closed for user root Sep 28 09:27:26 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-aca2a8f4-8568-4648-a3cb-1d3e95623903 tempest-VolumesListTestJSON-1957255114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-205067e2-92fa-46ae-8dac-a3ff6a28a62d" returned: 0 in 0.297s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:27:26 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-aca2a8f4-8568-4648-a3cb-1d3e95623903 tempest-VolumesListTestJSON-1957255114 None] <== create_volume: return (1305ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:27:26 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-aca2a8f4-8568-4648-a3cb-1d3e95623903 tempest-VolumesListTestJSON-1957255114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.308s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:27:26 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-aca2a8f4-8568-4648-a3cb-1d3e95623903 tempest-VolumesListTestJSON-1957255114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dde6246c-c768-481e-b0b2-4127c94d169e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-205067e2-92fa-46ae-8dac-a3ff6a28a62d', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:27:26 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-aca2a8f4-8568-4648-a3cb-1d3e95623903 tempest-VolumesListTestJSON-1957255114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4372a18-0a14-4cd1-b826-ce37c1436568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:27:26 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-aca2a8f4-8568-4648-a3cb-1d3e95623903 tempest-VolumesListTestJSON-1957255114 None] Volume volume-205067e2-92fa-46ae-8dac-a3ff6a28a62d (205067e2-92fa-46ae-8dac-a3ff6a28a62d): created successfully Sep 28 09:27:26 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-aca2a8f4-8568-4648-a3cb-1d3e95623903 tempest-VolumesListTestJSON-1957255114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4372a18-0a14-4cd1-b826-ce37c1436568) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:27:26 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-aca2a8f4-8568-4648-a3cb-1d3e95623903 tempest-VolumesListTestJSON-1957255114 None] Flow 'volume_create_manager' (e26166dc-0e43-44af-9947-8db9bc8efa30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:27:26 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-aca2a8f4-8568-4648-a3cb-1d3e95623903 tempest-VolumesListTestJSON-1957255114 None] Created volume successfully. Sep 28 09:27:29 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-98476413-c97a-4cba-a956-ab934749e98c tempest-VolumesListTestJSON-1957255114 None] Acquiring lock "cinder-205067e2-92fa-46ae-8dac-a3ff6a28a62d-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:27:30 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-98476413-c97a-4cba-a956-ab934749e98c tempest-VolumesListTestJSON-1957255114 None] Lock "cinder-205067e2-92fa-46ae-8dac-a3ff6a28a62d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:27:30 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-98476413-c97a-4cba-a956-ab934749e98c tempest-VolumesListTestJSON-1957255114 None] Acquiring lock "cinder-quobyte-205067e2-92fa-46ae-8dac-a3ff6a28a62d" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:27:30 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-98476413-c97a-4cba-a956-ab934749e98c tempest-VolumesListTestJSON-1957255114 None] Lock "cinder-quobyte-205067e2-92fa-46ae-8dac-a3ff6a28a62d" acquired by "delete_volume" :: waited 0.023s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:27:30 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb843cd-5f3e-4d41-a52d-09143b596f4a]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:27:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-98476413-c97a-4cba-a956-ab934749e98c tempest-VolumesListTestJSON-1957255114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-205067e2-92fa-46ae-8dac-a3ff6a28a62d {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:27:30 devstack sudo[94358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-205067e2-92fa-46ae-8dac-a3ff6a28a62d Sep 28 09:27:30 devstack sudo[94358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:27:30 devstack sudo[94358]: pam_unix(sudo:session): session closed for user root Sep 28 09:27:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-98476413-c97a-4cba-a956-ab934749e98c tempest-VolumesListTestJSON-1957255114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-205067e2-92fa-46ae-8dac-a3ff6a28a62d" returned: 0 in 0.383s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:27:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-98476413-c97a-4cba-a956-ab934749e98c tempest-VolumesListTestJSON-1957255114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-205067e2-92fa-46ae-8dac-a3ff6a28a62d {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:27:30 devstack sudo[94369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-205067e2-92fa-46ae-8dac-a3ff6a28a62d Sep 28 09:27:30 devstack sudo[94369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:27:30 devstack sudo[94369]: pam_unix(sudo:session): session closed for user root Sep 28 09:27:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-98476413-c97a-4cba-a956-ab934749e98c tempest-VolumesListTestJSON-1957255114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-205067e2-92fa-46ae-8dac-a3ff6a28a62d" returned: 0 in 0.277s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:27:30 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-98476413-c97a-4cba-a956-ab934749e98c tempest-VolumesListTestJSON-1957255114 None] Lock "cinder-quobyte-205067e2-92fa-46ae-8dac-a3ff6a28a62d" released by "delete_volume" :: held 0.711s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:27:30 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-98476413-c97a-4cba-a956-ab934749e98c tempest-VolumesListTestJSON-1957255114 None] Created reservations ['f07c74e6-438f-498a-a5a7-204e077c1b62', '6694143b-64c8-4894-92c0-f8ac82980505', 'c88d5b8a-5907-405f-bb9d-5f5d7a8d7756', '62acbf6d-3ed7-4cac-a172-f402c40bac9e'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:27:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-98476413-c97a-4cba-a956-ab934749e98c tempest-VolumesListTestJSON-1957255114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:27:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-98476413-c97a-4cba-a956-ab934749e98c tempest-VolumesListTestJSON-1957255114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:27:30 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-98476413-c97a-4cba-a956-ab934749e98c tempest-VolumesListTestJSON-1957255114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:27:30 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-98476413-c97a-4cba-a956-ab934749e98c tempest-VolumesListTestJSON-1957255114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:27:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-98476413-c97a-4cba-a956-ab934749e98c tempest-VolumesListTestJSON-1957255114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:27:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-98476413-c97a-4cba-a956-ab934749e98c tempest-VolumesListTestJSON-1957255114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:27:31 devstack sudo[94372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:27:31 devstack sudo[94372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:27:31 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-a8e6d220-edcb-49e3-9c6d-7d0442d2caf0 tempest-VolumesListTestJSON-1957255114 None] Acquiring lock "cinder-3feb106e-6371-4006-86d5-468c28904a07-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:27:31 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-a8e6d220-edcb-49e3-9c6d-7d0442d2caf0 tempest-VolumesListTestJSON-1957255114 None] Lock "cinder-3feb106e-6371-4006-86d5-468c28904a07-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:27:31 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-a8e6d220-edcb-49e3-9c6d-7d0442d2caf0 tempest-VolumesListTestJSON-1957255114 None] Acquiring lock "cinder-quobyte-3feb106e-6371-4006-86d5-468c28904a07" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:27:31 devstack sudo[94372]: pam_unix(sudo:session): session closed for user root Sep 28 09:27:31 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-98476413-c97a-4cba-a956-ab934749e98c tempest-VolumesListTestJSON-1957255114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.374s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:27:31 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-98476413-c97a-4cba-a956-ab934749e98c tempest-VolumesListTestJSON-1957255114 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:27:31 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-98476413-c97a-4cba-a956-ab934749e98c tempest-VolumesListTestJSON-1957255114 None] Deleted volume successfully. Sep 28 09:27:31 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-a8e6d220-edcb-49e3-9c6d-7d0442d2caf0 tempest-VolumesListTestJSON-1957255114 None] Lock "cinder-quobyte-3feb106e-6371-4006-86d5-468c28904a07" acquired by "delete_volume" :: waited 0.028s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:27:31 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb16e78-ec01-428f-93f1-16e3a75d9be3]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:27:31 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a8e6d220-edcb-49e3-9c6d-7d0442d2caf0 tempest-VolumesListTestJSON-1957255114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3feb106e-6371-4006-86d5-468c28904a07 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:27:31 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-98476413-c97a-4cba-a956-ab934749e98c tempest-VolumesListTestJSON-1957255114 None] Lock "cinder-205067e2-92fa-46ae-8dac-a3ff6a28a62d-delete_volume" released by "delete_volume" :: held 1.404s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:27:31 devstack sudo[94375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3feb106e-6371-4006-86d5-468c28904a07 Sep 28 09:27:31 devstack sudo[94375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:27:31 devstack sudo[94375]: pam_unix(sudo:session): session closed for user root Sep 28 09:27:31 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a8e6d220-edcb-49e3-9c6d-7d0442d2caf0 tempest-VolumesListTestJSON-1957255114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3feb106e-6371-4006-86d5-468c28904a07" returned: 0 in 0.463s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:27:31 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a8e6d220-edcb-49e3-9c6d-7d0442d2caf0 tempest-VolumesListTestJSON-1957255114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3feb106e-6371-4006-86d5-468c28904a07 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:27:31 devstack sudo[94396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3feb106e-6371-4006-86d5-468c28904a07 Sep 28 09:27:31 devstack sudo[94396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:27:32 devstack sudo[94396]: pam_unix(sudo:session): session closed for user root Sep 28 09:27:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a8e6d220-edcb-49e3-9c6d-7d0442d2caf0 tempest-VolumesListTestJSON-1957255114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3feb106e-6371-4006-86d5-468c28904a07" returned: 0 in 0.488s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:27:32 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-a8e6d220-edcb-49e3-9c6d-7d0442d2caf0 tempest-VolumesListTestJSON-1957255114 None] Lock "cinder-quobyte-3feb106e-6371-4006-86d5-468c28904a07" released by "delete_volume" :: held 1.022s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:27:32 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-a8e6d220-edcb-49e3-9c6d-7d0442d2caf0 tempest-VolumesListTestJSON-1957255114 None] Created reservations ['b206922a-796b-4d53-927d-7bccfeb4bfe5', '6101e096-2c2b-46db-b10e-811f8c056adf', 'cddf5e43-8d19-4159-b2f3-82a41f564f66', '999d18a1-ba85-488f-a722-da07d1474303'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:27:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-a8e6d220-edcb-49e3-9c6d-7d0442d2caf0 tempest-VolumesListTestJSON-1957255114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:27:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-a8e6d220-edcb-49e3-9c6d-7d0442d2caf0 tempest-VolumesListTestJSON-1957255114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:27:32 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-a8e6d220-edcb-49e3-9c6d-7d0442d2caf0 tempest-VolumesListTestJSON-1957255114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:27:32 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-a8e6d220-edcb-49e3-9c6d-7d0442d2caf0 tempest-VolumesListTestJSON-1957255114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:27:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-a8e6d220-edcb-49e3-9c6d-7d0442d2caf0 tempest-VolumesListTestJSON-1957255114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:27:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a8e6d220-edcb-49e3-9c6d-7d0442d2caf0 tempest-VolumesListTestJSON-1957255114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:27:32 devstack sudo[94399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:27:32 devstack sudo[94399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:27:32 devstack sudo[94399]: pam_unix(sudo:session): session closed for user root Sep 28 09:27:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a8e6d220-edcb-49e3-9c6d-7d0442d2caf0 tempest-VolumesListTestJSON-1957255114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.301s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:27:32 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-a8e6d220-edcb-49e3-9c6d-7d0442d2caf0 tempest-VolumesListTestJSON-1957255114 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:27:32 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-a8e6d220-edcb-49e3-9c6d-7d0442d2caf0 tempest-VolumesListTestJSON-1957255114 None] Deleted volume successfully. Sep 28 09:27:32 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-a8e6d220-edcb-49e3-9c6d-7d0442d2caf0 tempest-VolumesListTestJSON-1957255114 None] Lock "cinder-3feb106e-6371-4006-86d5-468c28904a07-delete_volume" released by "delete_volume" :: held 1.620s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:27:33 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-66bbaa2a-5722-417c-8dec-b5c53205230d tempest-VolumesListTestJSON-1957255114 None] Acquiring lock "cinder-a583c824-3185-4557-bfc9-577ee9822d3e-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:27:33 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-66bbaa2a-5722-417c-8dec-b5c53205230d tempest-VolumesListTestJSON-1957255114 None] Lock "cinder-a583c824-3185-4557-bfc9-577ee9822d3e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:27:33 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-66bbaa2a-5722-417c-8dec-b5c53205230d tempest-VolumesListTestJSON-1957255114 None] Acquiring lock "cinder-quobyte-a583c824-3185-4557-bfc9-577ee9822d3e" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:27:33 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-66bbaa2a-5722-417c-8dec-b5c53205230d tempest-VolumesListTestJSON-1957255114 None] Lock "cinder-quobyte-a583c824-3185-4557-bfc9-577ee9822d3e" acquired by "delete_volume" :: waited 0.032s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:27:33 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[d20eb2df-b087-4fd5-820c-838d4d77e8a2]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:27:33 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-66bbaa2a-5722-417c-8dec-b5c53205230d tempest-VolumesListTestJSON-1957255114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a583c824-3185-4557-bfc9-577ee9822d3e {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:27:33 devstack sudo[94403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a583c824-3185-4557-bfc9-577ee9822d3e Sep 28 09:27:33 devstack sudo[94403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:27:34 devstack sudo[94403]: pam_unix(sudo:session): session closed for user root Sep 28 09:27:34 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-66bbaa2a-5722-417c-8dec-b5c53205230d tempest-VolumesListTestJSON-1957255114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a583c824-3185-4557-bfc9-577ee9822d3e" returned: 0 in 0.403s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:27:34 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-66bbaa2a-5722-417c-8dec-b5c53205230d tempest-VolumesListTestJSON-1957255114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a583c824-3185-4557-bfc9-577ee9822d3e {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:27:34 devstack sudo[94408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a583c824-3185-4557-bfc9-577ee9822d3e Sep 28 09:27:34 devstack sudo[94408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:27:34 devstack sudo[94408]: pam_unix(sudo:session): session closed for user root Sep 28 09:27:34 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-66bbaa2a-5722-417c-8dec-b5c53205230d tempest-VolumesListTestJSON-1957255114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a583c824-3185-4557-bfc9-577ee9822d3e" returned: 0 in 0.259s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:27:34 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-66bbaa2a-5722-417c-8dec-b5c53205230d tempest-VolumesListTestJSON-1957255114 None] Lock "cinder-quobyte-a583c824-3185-4557-bfc9-577ee9822d3e" released by "delete_volume" :: held 0.731s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:27:34 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-66bbaa2a-5722-417c-8dec-b5c53205230d tempest-VolumesListTestJSON-1957255114 None] Created reservations ['6359b234-604f-481c-84f4-935e03e359ab', 'ff6c543d-4b7e-41a7-8c16-2a189d71fc90', '56caae65-7686-4ce8-ac2b-475c6eb400e7', '793f0f42-634c-4e0f-8d0a-15d0eaf966cb'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:27:34 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-66bbaa2a-5722-417c-8dec-b5c53205230d tempest-VolumesListTestJSON-1957255114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:27:34 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-66bbaa2a-5722-417c-8dec-b5c53205230d tempest-VolumesListTestJSON-1957255114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:27:34 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-66bbaa2a-5722-417c-8dec-b5c53205230d tempest-VolumesListTestJSON-1957255114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:27:34 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-66bbaa2a-5722-417c-8dec-b5c53205230d tempest-VolumesListTestJSON-1957255114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:27:34 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-66bbaa2a-5722-417c-8dec-b5c53205230d tempest-VolumesListTestJSON-1957255114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:27:34 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-66bbaa2a-5722-417c-8dec-b5c53205230d tempest-VolumesListTestJSON-1957255114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:27:34 devstack sudo[94411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:27:34 devstack sudo[94411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:27:34 devstack sudo[94411]: pam_unix(sudo:session): session closed for user root Sep 28 09:27:34 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-66bbaa2a-5722-417c-8dec-b5c53205230d tempest-VolumesListTestJSON-1957255114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.260s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:27:34 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-66bbaa2a-5722-417c-8dec-b5c53205230d tempest-VolumesListTestJSON-1957255114 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:27:34 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-66bbaa2a-5722-417c-8dec-b5c53205230d tempest-VolumesListTestJSON-1957255114 None] Deleted volume successfully. Sep 28 09:27:34 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-66bbaa2a-5722-417c-8dec-b5c53205230d tempest-VolumesListTestJSON-1957255114 None] Lock "cinder-a583c824-3185-4557-bfc9-577ee9822d3e-delete_volume" released by "delete_volume" :: held 1.230s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:27:38 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb9bb7db-dc92-4d3b-99ec-e2cc1b08ade7 tempest-VolumesNegativeTest-804619259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:27:38 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-eb9bb7db-dc92-4d3b-99ec-e2cc1b08ade7 tempest-VolumesNegativeTest-804619259 None] Flow 'volume_create_manager' (87e45fdc-5f2e-4a2d-9d9f-9fa89a04fbfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:27:38 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-eb9bb7db-dc92-4d3b-99ec-e2cc1b08ade7 tempest-VolumesNegativeTest-804619259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (deffafa2-238c-4fef-82e9-d6578f2202f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:27:38 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-eb9bb7db-dc92-4d3b-99ec-e2cc1b08ade7 tempest-VolumesNegativeTest-804619259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (deffafa2-238c-4fef-82e9-d6578f2202f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:27:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1623845861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4af69570-27a4-41d4-8d7f-a2de4b77abd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77be4039b28d486f80907a59c6483df5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:27:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:27:39Z,use_quota=True,user_id='c7205ad304734c959a4ff93fdf487baf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:27:38 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-eb9bb7db-dc92-4d3b-99ec-e2cc1b08ade7 tempest-VolumesNegativeTest-804619259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cd5fcc4-4131-4fb8-9ea0-c46dd5736a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:27:38 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-eb9bb7db-dc92-4d3b-99ec-e2cc1b08ade7 tempest-VolumesNegativeTest-804619259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cd5fcc4-4131-4fb8-9ea0-c46dd5736a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:27:38 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-eb9bb7db-dc92-4d3b-99ec-e2cc1b08ade7 tempest-VolumesNegativeTest-804619259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee72163c-b408-49db-a0be-9a391f522aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:27:38 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-eb9bb7db-dc92-4d3b-99ec-e2cc1b08ade7 tempest-VolumesNegativeTest-804619259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee72163c-b408-49db-a0be-9a391f522aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4af69570-27a4-41d4-8d7f-a2de4b77abd7', 'volume_name': 'volume-4af69570-27a4-41d4-8d7f-a2de4b77abd7', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:27:38 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-eb9bb7db-dc92-4d3b-99ec-e2cc1b08ade7 tempest-VolumesNegativeTest-804619259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c04cbc5-9219-4e10-a0d0-b538b444e1ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:27:38 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-eb9bb7db-dc92-4d3b-99ec-e2cc1b08ade7 tempest-VolumesNegativeTest-804619259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c04cbc5-9219-4e10-a0d0-b538b444e1ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:27:38 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-eb9bb7db-dc92-4d3b-99ec-e2cc1b08ade7 tempest-VolumesNegativeTest-804619259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64dfe3c9-8806-42c0-b1c6-023f78a63ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:27:38 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-eb9bb7db-dc92-4d3b-99ec-e2cc1b08ade7 tempest-VolumesNegativeTest-804619259 None] Volume 4af69570-27a4-41d4-8d7f-a2de4b77abd7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4af69570-27a4-41d4-8d7f-a2de4b77abd7', 'volume_size': 1} Sep 28 09:27:38 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-eb9bb7db-dc92-4d3b-99ec-e2cc1b08ade7 tempest-VolumesNegativeTest-804619259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:27:38 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-eb9bb7db-dc92-4d3b-99ec-e2cc1b08ade7 tempest-VolumesNegativeTest-804619259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:27:38 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-eb9bb7db-dc92-4d3b-99ec-e2cc1b08ade7 tempest-VolumesNegativeTest-804619259 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:27:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1623845861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4af69570-27a4-41d4-8d7f-a2de4b77abd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77be4039b28d486f80907a59c6483df5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:27:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:27:39Z,use_quota=True,user_id='c7205ad304734c959a4ff93fdf487baf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:27:38 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-eb9bb7db-dc92-4d3b-99ec-e2cc1b08ade7 tempest-VolumesNegativeTest-804619259 None] Creating volume 4af69570-27a4-41d4-8d7f-a2de4b77abd7 {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:27:38 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-eb9bb7db-dc92-4d3b-99ec-e2cc1b08ade7 tempest-VolumesNegativeTest-804619259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:27:38 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-eb9bb7db-dc92-4d3b-99ec-e2cc1b08ade7 tempest-VolumesNegativeTest-804619259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:27:38 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-eb9bb7db-dc92-4d3b-99ec-e2cc1b08ade7 tempest-VolumesNegativeTest-804619259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:27:38 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-eb9bb7db-dc92-4d3b-99ec-e2cc1b08ade7 tempest-VolumesNegativeTest-804619259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:27:38 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-eb9bb7db-dc92-4d3b-99ec-e2cc1b08ade7 tempest-VolumesNegativeTest-804619259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:27:38 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-eb9bb7db-dc92-4d3b-99ec-e2cc1b08ade7 tempest-VolumesNegativeTest-804619259 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:27:38 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-eb9bb7db-dc92-4d3b-99ec-e2cc1b08ade7 tempest-VolumesNegativeTest-804619259 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:27:38 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-eb9bb7db-dc92-4d3b-99ec-e2cc1b08ade7 tempest-VolumesNegativeTest-804619259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-4af69570-27a4-41d4-8d7f-a2de4b77abd7 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:27:38 devstack sudo[94415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-4af69570-27a4-41d4-8d7f-a2de4b77abd7 1073741824 Sep 28 09:27:38 devstack sudo[94415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:27:39 devstack sudo[94415]: pam_unix(sudo:session): session closed for user root Sep 28 09:27:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-eb9bb7db-dc92-4d3b-99ec-e2cc1b08ade7 tempest-VolumesNegativeTest-804619259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-4af69570-27a4-41d4-8d7f-a2de4b77abd7 1073741824" returned: 0 in 0.556s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:27:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-eb9bb7db-dc92-4d3b-99ec-e2cc1b08ade7 tempest-VolumesNegativeTest-804619259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-4af69570-27a4-41d4-8d7f-a2de4b77abd7 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:27:39 devstack sudo[94421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-4af69570-27a4-41d4-8d7f-a2de4b77abd7 Sep 28 09:27:39 devstack sudo[94421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:27:39 devstack sudo[94421]: pam_unix(sudo:session): session closed for user root Sep 28 09:27:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-eb9bb7db-dc92-4d3b-99ec-e2cc1b08ade7 tempest-VolumesNegativeTest-804619259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-4af69570-27a4-41d4-8d7f-a2de4b77abd7" returned: 0 in 0.270s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:27:39 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-eb9bb7db-dc92-4d3b-99ec-e2cc1b08ade7 tempest-VolumesNegativeTest-804619259 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:27:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-eb9bb7db-dc92-4d3b-99ec-e2cc1b08ade7 tempest-VolumesNegativeTest-804619259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:27:39 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-eb9bb7db-dc92-4d3b-99ec-e2cc1b08ade7 tempest-VolumesNegativeTest-804619259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64dfe3c9-8806-42c0-b1c6-023f78a63ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4af69570-27a4-41d4-8d7f-a2de4b77abd7', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:27:39 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-eb9bb7db-dc92-4d3b-99ec-e2cc1b08ade7 tempest-VolumesNegativeTest-804619259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8df5640-04fb-4011-a48a-b9ccf2c512d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:27:39 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-eb9bb7db-dc92-4d3b-99ec-e2cc1b08ade7 tempest-VolumesNegativeTest-804619259 None] Volume volume-4af69570-27a4-41d4-8d7f-a2de4b77abd7 (4af69570-27a4-41d4-8d7f-a2de4b77abd7): created successfully Sep 28 09:27:39 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-eb9bb7db-dc92-4d3b-99ec-e2cc1b08ade7 tempest-VolumesNegativeTest-804619259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8df5640-04fb-4011-a48a-b9ccf2c512d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:27:39 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-eb9bb7db-dc92-4d3b-99ec-e2cc1b08ade7 tempest-VolumesNegativeTest-804619259 None] Flow 'volume_create_manager' (87e45fdc-5f2e-4a2d-9d9f-9fa89a04fbfe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:27:39 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-eb9bb7db-dc92-4d3b-99ec-e2cc1b08ade7 tempest-VolumesNegativeTest-804619259 None] Created volume successfully. Sep 28 09:27:47 devstack cinder-volume[86553]: INFO cinder.volume.manager [req-e6cff148-7c2b-44c5-9fc8-73be52fa7ece req-18eb9973-8894-4b70-a235-377d53388352 tempest-AttachVolumeTestJSON-612710564 None] Terminate volume connection completed successfully. Sep 28 09:27:47 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [req-e6cff148-7c2b-44c5-9fc8-73be52fa7ece req-18eb9973-8894-4b70-a235-377d53388352 tempest-AttachVolumeTestJSON-612710564 None] Deleting attachment 305340b9-6200-418e-8913-c0e849a851ad. {{(pid=86553) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 09:27:52 devstack cinder-volume[86553]: INFO cinder.volume.manager [req-5a8dc8f6-4116-4b00-8e14-692d25ead871 req-4dabd69b-a807-46aa-9c08-1fe3d53fc994 tempest-AttachVolumeNegativeTest-1957606009 None] Terminate volume connection completed successfully. Sep 28 09:27:52 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [req-5a8dc8f6-4116-4b00-8e14-692d25ead871 req-4dabd69b-a807-46aa-9c08-1fe3d53fc994 tempest-AttachVolumeNegativeTest-1957606009 None] Deleting attachment 8d285cc1-39fb-4f87-86c8-54c326650ce8. {{(pid=86553) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 09:28:02 devstack cinder-volume[86553]: DEBUG dbcounter [-] [86553] Writing DB stats cinder:SELECT=33,cinder:UPDATE=39,cinder:DELETE=5,cinder:INSERT=12 {{(pid=86553) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 09:28:02 devstack cinder-volume[86553]: DEBUG dbcounter [-] [86553] Writing DB stats cinder:UPDATE=50,cinder:INSERT=8,cinder:SELECT=28,cinder:DELETE=3 {{(pid=86553) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 09:28:11 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-a6da2dc3-90d2-4b71-a695-a6e2a6e83afc tempest-VolumesNegativeTest-804619259 None] Acquiring lock "cinder-4af69570-27a4-41d4-8d7f-a2de4b77abd7-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:28:11 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-a6da2dc3-90d2-4b71-a695-a6e2a6e83afc tempest-VolumesNegativeTest-804619259 None] Lock "cinder-4af69570-27a4-41d4-8d7f-a2de4b77abd7-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:28:11 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-a6da2dc3-90d2-4b71-a695-a6e2a6e83afc tempest-VolumesNegativeTest-804619259 None] Acquiring lock "cinder-quobyte-4af69570-27a4-41d4-8d7f-a2de4b77abd7" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:28:11 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-a6da2dc3-90d2-4b71-a695-a6e2a6e83afc tempest-VolumesNegativeTest-804619259 None] Lock "cinder-quobyte-4af69570-27a4-41d4-8d7f-a2de4b77abd7" acquired by "delete_volume" :: waited 0.034s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:28:11 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa05c47a-5ab2-4831-9b0a-84fc4df620a1]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:28:11 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a6da2dc3-90d2-4b71-a695-a6e2a6e83afc tempest-VolumesNegativeTest-804619259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-4af69570-27a4-41d4-8d7f-a2de4b77abd7 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:28:11 devstack sudo[94882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-4af69570-27a4-41d4-8d7f-a2de4b77abd7 Sep 28 09:28:11 devstack sudo[94882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:28:12 devstack sudo[94882]: pam_unix(sudo:session): session closed for user root Sep 28 09:28:12 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a6da2dc3-90d2-4b71-a695-a6e2a6e83afc tempest-VolumesNegativeTest-804619259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-4af69570-27a4-41d4-8d7f-a2de4b77abd7" returned: 0 in 0.790s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:28:12 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a6da2dc3-90d2-4b71-a695-a6e2a6e83afc tempest-VolumesNegativeTest-804619259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-4af69570-27a4-41d4-8d7f-a2de4b77abd7 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:28:12 devstack sudo[94918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-4af69570-27a4-41d4-8d7f-a2de4b77abd7 Sep 28 09:28:12 devstack sudo[94918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:28:12 devstack sudo[94918]: pam_unix(sudo:session): session closed for user root Sep 28 09:28:12 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a6da2dc3-90d2-4b71-a695-a6e2a6e83afc tempest-VolumesNegativeTest-804619259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-4af69570-27a4-41d4-8d7f-a2de4b77abd7" returned: 0 in 0.578s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:28:13 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-a6da2dc3-90d2-4b71-a695-a6e2a6e83afc tempest-VolumesNegativeTest-804619259 None] Lock "cinder-quobyte-4af69570-27a4-41d4-8d7f-a2de4b77abd7" released by "delete_volume" :: held 1.489s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:28:13 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-a6da2dc3-90d2-4b71-a695-a6e2a6e83afc tempest-VolumesNegativeTest-804619259 None] Created reservations ['1862a79c-cb62-46da-b717-fdf77d61c8f0', '59e61172-ffe3-432d-8e33-27d868f8ffec', '667bf31c-7d82-4761-b57c-42bfb0ca408a', 'dcd7a909-2b57-4d32-99de-fbb05a6f7a0e'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:28:13 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-a6da2dc3-90d2-4b71-a695-a6e2a6e83afc tempest-VolumesNegativeTest-804619259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:28:13 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-a6da2dc3-90d2-4b71-a695-a6e2a6e83afc tempest-VolumesNegativeTest-804619259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:28:13 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-a6da2dc3-90d2-4b71-a695-a6e2a6e83afc tempest-VolumesNegativeTest-804619259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:28:13 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-a6da2dc3-90d2-4b71-a695-a6e2a6e83afc tempest-VolumesNegativeTest-804619259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:28:13 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-a6da2dc3-90d2-4b71-a695-a6e2a6e83afc tempest-VolumesNegativeTest-804619259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:28:13 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a6da2dc3-90d2-4b71-a695-a6e2a6e83afc tempest-VolumesNegativeTest-804619259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:28:13 devstack sudo[94948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:28:13 devstack sudo[94948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:28:13 devstack sudo[94948]: pam_unix(sudo:session): session closed for user root Sep 28 09:28:13 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a6da2dc3-90d2-4b71-a695-a6e2a6e83afc tempest-VolumesNegativeTest-804619259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.524s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:28:13 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-a6da2dc3-90d2-4b71-a695-a6e2a6e83afc tempest-VolumesNegativeTest-804619259 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:28:13 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-a6da2dc3-90d2-4b71-a695-a6e2a6e83afc tempest-VolumesNegativeTest-804619259 None] Deleted volume successfully. Sep 28 09:28:13 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-a6da2dc3-90d2-4b71-a695-a6e2a6e83afc tempest-VolumesNegativeTest-804619259 None] Lock "cinder-4af69570-27a4-41d4-8d7f-a2de4b77abd7-delete_volume" released by "delete_volume" :: held 2.474s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:28:21 devstack cinder-volume[86553]: DEBUG oslo_service.periodic_task [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86553) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 09:28:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:28:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:28:21 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:28:21 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:28:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:28:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:28:21 devstack sudo[95072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:28:21 devstack sudo[95072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:28:22 devstack sudo[95072]: pam_unix(sudo:session): session closed for user root Sep 28 09:28:22 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.734s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:28:22 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:28:22 devstack cinder-volume[86553]: DEBUG oslo_service.periodic_task [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Running periodic task VolumeManager._thread_info {{(pid=86553) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 09:28:22 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] thread count: 28 {{(pid=86553) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 09:28:22 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] thread info: [<_MainThread(MainThread, started 134684877779072)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86553) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 09:28:23 devstack cinder-volume[86553]: DEBUG dbcounter [-] [86553] Writing DB stats cinder:SELECT=4,cinder:INSERT=2,cinder:UPDATE=7 {{(pid=86553) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 09:28:23 devstack cinder-volume[86553]: DEBUG dbcounter [-] [86553] Writing DB stats cinder:SELECT=6,cinder:UPDATE=9,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86553) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 09:28:34 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-7daf5c40-7938-4b19-bbc6-cfe5fb347791 tempest-AttachVolumeShelveTestJSON-491900363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:28:34 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7daf5c40-7938-4b19-bbc6-cfe5fb347791 tempest-AttachVolumeShelveTestJSON-491900363 None] Flow 'volume_create_manager' (f557138f-5e93-4831-a39d-4354db3c4ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:28:34 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7daf5c40-7938-4b19-bbc6-cfe5fb347791 tempest-AttachVolumeShelveTestJSON-491900363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d6d2368-9020-4212-91e9-97b7d2aa9365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:28:34 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7daf5c40-7938-4b19-bbc6-cfe5fb347791 tempest-AttachVolumeShelveTestJSON-491900363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d6d2368-9020-4212-91e9-97b7d2aa9365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:28:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-2138897960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93ceb9b1-d5a7-44ce-93ab-99221a55226b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef6c34c4b93441119d4b18e568a37a76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:28:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:28:35Z,use_quota=True,user_id='e2f1e1676cf44203a1889e18f181ab57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:28:35 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7daf5c40-7938-4b19-bbc6-cfe5fb347791 tempest-AttachVolumeShelveTestJSON-491900363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a78c7ec-7b34-4f66-b735-19ca1c036ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:28:35 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7daf5c40-7938-4b19-bbc6-cfe5fb347791 tempest-AttachVolumeShelveTestJSON-491900363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a78c7ec-7b34-4f66-b735-19ca1c036ecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:28:35 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7daf5c40-7938-4b19-bbc6-cfe5fb347791 tempest-AttachVolumeShelveTestJSON-491900363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7394b46-48f9-465e-b21c-b6bc3f9fe9ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:28:35 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7daf5c40-7938-4b19-bbc6-cfe5fb347791 tempest-AttachVolumeShelveTestJSON-491900363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7394b46-48f9-465e-b21c-b6bc3f9fe9ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93ceb9b1-d5a7-44ce-93ab-99221a55226b', 'volume_name': 'volume-93ceb9b1-d5a7-44ce-93ab-99221a55226b', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:28:35 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7daf5c40-7938-4b19-bbc6-cfe5fb347791 tempest-AttachVolumeShelveTestJSON-491900363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b126eee6-8712-490c-9f4b-102df8794eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:28:35 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7daf5c40-7938-4b19-bbc6-cfe5fb347791 tempest-AttachVolumeShelveTestJSON-491900363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b126eee6-8712-490c-9f4b-102df8794eae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:28:35 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7daf5c40-7938-4b19-bbc6-cfe5fb347791 tempest-AttachVolumeShelveTestJSON-491900363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (000f86c5-8293-4d3c-874f-ec47309250db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:28:35 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-7daf5c40-7938-4b19-bbc6-cfe5fb347791 tempest-AttachVolumeShelveTestJSON-491900363 None] Volume 93ceb9b1-d5a7-44ce-93ab-99221a55226b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93ceb9b1-d5a7-44ce-93ab-99221a55226b', 'volume_size': 1} Sep 28 09:28:35 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-7daf5c40-7938-4b19-bbc6-cfe5fb347791 tempest-AttachVolumeShelveTestJSON-491900363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:28:35 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-7daf5c40-7938-4b19-bbc6-cfe5fb347791 tempest-AttachVolumeShelveTestJSON-491900363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:28:35 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-7daf5c40-7938-4b19-bbc6-cfe5fb347791 tempest-AttachVolumeShelveTestJSON-491900363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:28:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-2138897960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93ceb9b1-d5a7-44ce-93ab-99221a55226b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef6c34c4b93441119d4b18e568a37a76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:28:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:28:35Z,use_quota=True,user_id='e2f1e1676cf44203a1889e18f181ab57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:28:35 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-7daf5c40-7938-4b19-bbc6-cfe5fb347791 tempest-AttachVolumeShelveTestJSON-491900363 None] Creating volume 93ceb9b1-d5a7-44ce-93ab-99221a55226b {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:28:35 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-7daf5c40-7938-4b19-bbc6-cfe5fb347791 tempest-AttachVolumeShelveTestJSON-491900363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:28:35 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-7daf5c40-7938-4b19-bbc6-cfe5fb347791 tempest-AttachVolumeShelveTestJSON-491900363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:28:35 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-7daf5c40-7938-4b19-bbc6-cfe5fb347791 tempest-AttachVolumeShelveTestJSON-491900363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:28:35 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-7daf5c40-7938-4b19-bbc6-cfe5fb347791 tempest-AttachVolumeShelveTestJSON-491900363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:28:35 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-7daf5c40-7938-4b19-bbc6-cfe5fb347791 tempest-AttachVolumeShelveTestJSON-491900363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:28:35 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-7daf5c40-7938-4b19-bbc6-cfe5fb347791 tempest-AttachVolumeShelveTestJSON-491900363 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:28:35 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-7daf5c40-7938-4b19-bbc6-cfe5fb347791 tempest-AttachVolumeShelveTestJSON-491900363 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:28:35 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-7daf5c40-7938-4b19-bbc6-cfe5fb347791 tempest-AttachVolumeShelveTestJSON-491900363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-93ceb9b1-d5a7-44ce-93ab-99221a55226b 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:28:35 devstack sudo[95238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-93ceb9b1-d5a7-44ce-93ab-99221a55226b 1073741824 Sep 28 09:28:35 devstack sudo[95238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:28:35 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-9687883c-05b7-4a7e-a4c9-b7c46f8044d7 tempest-VolumesSnapshotTestJSON-217259837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:28:35 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-9687883c-05b7-4a7e-a4c9-b7c46f8044d7 tempest-VolumesSnapshotTestJSON-217259837 None] Flow 'volume_create_manager' (7b0ebf75-3a9c-4ec8-b31f-dd20feeeb973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:28:35 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-9687883c-05b7-4a7e-a4c9-b7c46f8044d7 tempest-VolumesSnapshotTestJSON-217259837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da324918-81a8-43d6-a6d5-1a424b4259c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:28:35 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-9687883c-05b7-4a7e-a4c9-b7c46f8044d7 tempest-VolumesSnapshotTestJSON-217259837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da324918-81a8-43d6-a6d5-1a424b4259c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:28:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1126555920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b864794-072a-4a95-84de-b09e4ea5fb37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bbcf34b7f064aea995bcb5be8a2c1d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:28:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:28:35Z,use_quota=True,user_id='cc1d0bb36b3f4787bb419c14842829ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:28:35 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-9687883c-05b7-4a7e-a4c9-b7c46f8044d7 tempest-VolumesSnapshotTestJSON-217259837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d974b4c8-4a4a-496a-8a4d-92e5a4e71b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:28:35 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-9687883c-05b7-4a7e-a4c9-b7c46f8044d7 tempest-VolumesSnapshotTestJSON-217259837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d974b4c8-4a4a-496a-8a4d-92e5a4e71b78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:28:35 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-9687883c-05b7-4a7e-a4c9-b7c46f8044d7 tempest-VolumesSnapshotTestJSON-217259837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8038a26-762e-45b7-8b9f-df40de9ef762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:28:35 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-9687883c-05b7-4a7e-a4c9-b7c46f8044d7 tempest-VolumesSnapshotTestJSON-217259837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8038a26-762e-45b7-8b9f-df40de9ef762) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b864794-072a-4a95-84de-b09e4ea5fb37', 'volume_name': 'volume-9b864794-072a-4a95-84de-b09e4ea5fb37', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:28:35 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-9687883c-05b7-4a7e-a4c9-b7c46f8044d7 tempest-VolumesSnapshotTestJSON-217259837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f86a4780-bee7-42db-9cbb-0a565d18f4ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:28:35 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-9687883c-05b7-4a7e-a4c9-b7c46f8044d7 tempest-VolumesSnapshotTestJSON-217259837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f86a4780-bee7-42db-9cbb-0a565d18f4ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:28:35 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-9687883c-05b7-4a7e-a4c9-b7c46f8044d7 tempest-VolumesSnapshotTestJSON-217259837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e19da62-7ddd-4918-a49d-bbc96e3011e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:28:35 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-9687883c-05b7-4a7e-a4c9-b7c46f8044d7 tempest-VolumesSnapshotTestJSON-217259837 None] Volume 9b864794-072a-4a95-84de-b09e4ea5fb37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b864794-072a-4a95-84de-b09e4ea5fb37', 'volume_size': 1} Sep 28 09:28:35 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-9687883c-05b7-4a7e-a4c9-b7c46f8044d7 tempest-VolumesSnapshotTestJSON-217259837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:28:35 devstack sudo[95238]: pam_unix(sudo:session): session closed for user root Sep 28 09:28:35 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-7daf5c40-7938-4b19-bbc6-cfe5fb347791 tempest-AttachVolumeShelveTestJSON-491900363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-93ceb9b1-d5a7-44ce-93ab-99221a55226b 1073741824" returned: 0 in 0.542s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:28:35 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-7daf5c40-7938-4b19-bbc6-cfe5fb347791 tempest-AttachVolumeShelveTestJSON-491900363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-93ceb9b1-d5a7-44ce-93ab-99221a55226b {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:28:35 devstack sudo[95254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-93ceb9b1-d5a7-44ce-93ab-99221a55226b Sep 28 09:28:35 devstack sudo[95254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:28:35 devstack sudo[95254]: pam_unix(sudo:session): session closed for user root Sep 28 09:28:35 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-7daf5c40-7938-4b19-bbc6-cfe5fb347791 tempest-AttachVolumeShelveTestJSON-491900363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-93ceb9b1-d5a7-44ce-93ab-99221a55226b" returned: 0 in 0.299s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:28:35 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-7daf5c40-7938-4b19-bbc6-cfe5fb347791 tempest-AttachVolumeShelveTestJSON-491900363 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:28:35 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-7daf5c40-7938-4b19-bbc6-cfe5fb347791 tempest-AttachVolumeShelveTestJSON-491900363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:28:35 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-9687883c-05b7-4a7e-a4c9-b7c46f8044d7 tempest-VolumesSnapshotTestJSON-217259837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.642s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:28:35 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-9687883c-05b7-4a7e-a4c9-b7c46f8044d7 tempest-VolumesSnapshotTestJSON-217259837 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:28:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1126555920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b864794-072a-4a95-84de-b09e4ea5fb37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bbcf34b7f064aea995bcb5be8a2c1d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:28:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:28:35Z,use_quota=True,user_id='cc1d0bb36b3f4787bb419c14842829ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:28:35 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-9687883c-05b7-4a7e-a4c9-b7c46f8044d7 tempest-VolumesSnapshotTestJSON-217259837 None] Creating volume 9b864794-072a-4a95-84de-b09e4ea5fb37 {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:28:35 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-9687883c-05b7-4a7e-a4c9-b7c46f8044d7 tempest-VolumesSnapshotTestJSON-217259837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:28:35 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-9687883c-05b7-4a7e-a4c9-b7c46f8044d7 tempest-VolumesSnapshotTestJSON-217259837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:28:35 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-9687883c-05b7-4a7e-a4c9-b7c46f8044d7 tempest-VolumesSnapshotTestJSON-217259837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:28:35 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-9687883c-05b7-4a7e-a4c9-b7c46f8044d7 tempest-VolumesSnapshotTestJSON-217259837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:28:35 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-9687883c-05b7-4a7e-a4c9-b7c46f8044d7 tempest-VolumesSnapshotTestJSON-217259837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:28:35 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-9687883c-05b7-4a7e-a4c9-b7c46f8044d7 tempest-VolumesSnapshotTestJSON-217259837 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:28:35 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-9687883c-05b7-4a7e-a4c9-b7c46f8044d7 tempest-VolumesSnapshotTestJSON-217259837 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:28:35 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-9687883c-05b7-4a7e-a4c9-b7c46f8044d7 tempest-VolumesSnapshotTestJSON-217259837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9b864794-072a-4a95-84de-b09e4ea5fb37 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:28:35 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7daf5c40-7938-4b19-bbc6-cfe5fb347791 tempest-AttachVolumeShelveTestJSON-491900363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (000f86c5-8293-4d3c-874f-ec47309250db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93ceb9b1-d5a7-44ce-93ab-99221a55226b', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:28:36 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7daf5c40-7938-4b19-bbc6-cfe5fb347791 tempest-AttachVolumeShelveTestJSON-491900363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (113da1c0-218e-4e46-b1b9-80f5cb95edbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:28:36 devstack sudo[95257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9b864794-072a-4a95-84de-b09e4ea5fb37 1073741824 Sep 28 09:28:36 devstack sudo[95257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:28:36 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-7daf5c40-7938-4b19-bbc6-cfe5fb347791 tempest-AttachVolumeShelveTestJSON-491900363 None] Volume volume-93ceb9b1-d5a7-44ce-93ab-99221a55226b (93ceb9b1-d5a7-44ce-93ab-99221a55226b): created successfully Sep 28 09:28:36 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7daf5c40-7938-4b19-bbc6-cfe5fb347791 tempest-AttachVolumeShelveTestJSON-491900363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (113da1c0-218e-4e46-b1b9-80f5cb95edbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:28:36 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7daf5c40-7938-4b19-bbc6-cfe5fb347791 tempest-AttachVolumeShelveTestJSON-491900363 None] Flow 'volume_create_manager' (f557138f-5e93-4831-a39d-4354db3c4ece) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:28:36 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-7daf5c40-7938-4b19-bbc6-cfe5fb347791 tempest-AttachVolumeShelveTestJSON-491900363 None] Created volume successfully. Sep 28 09:28:36 devstack sudo[95257]: pam_unix(sudo:session): session closed for user root Sep 28 09:28:36 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-9687883c-05b7-4a7e-a4c9-b7c46f8044d7 tempest-VolumesSnapshotTestJSON-217259837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9b864794-072a-4a95-84de-b09e4ea5fb37 1073741824" returned: 0 in 0.679s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:28:36 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-9687883c-05b7-4a7e-a4c9-b7c46f8044d7 tempest-VolumesSnapshotTestJSON-217259837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9b864794-072a-4a95-84de-b09e4ea5fb37 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:28:36 devstack sudo[95265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9b864794-072a-4a95-84de-b09e4ea5fb37 Sep 28 09:28:36 devstack sudo[95265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:28:36 devstack sudo[95265]: pam_unix(sudo:session): session closed for user root Sep 28 09:28:37 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-9687883c-05b7-4a7e-a4c9-b7c46f8044d7 tempest-VolumesSnapshotTestJSON-217259837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9b864794-072a-4a95-84de-b09e4ea5fb37" returned: 0 in 0.322s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:28:37 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-9687883c-05b7-4a7e-a4c9-b7c46f8044d7 tempest-VolumesSnapshotTestJSON-217259837 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:28:37 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-9687883c-05b7-4a7e-a4c9-b7c46f8044d7 tempest-VolumesSnapshotTestJSON-217259837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:28:37 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-9687883c-05b7-4a7e-a4c9-b7c46f8044d7 tempest-VolumesSnapshotTestJSON-217259837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e19da62-7ddd-4918-a49d-bbc96e3011e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b864794-072a-4a95-84de-b09e4ea5fb37', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:28:37 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-9687883c-05b7-4a7e-a4c9-b7c46f8044d7 tempest-VolumesSnapshotTestJSON-217259837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a12dac5e-55de-4b28-ae96-1d81c9066dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:28:37 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-9687883c-05b7-4a7e-a4c9-b7c46f8044d7 tempest-VolumesSnapshotTestJSON-217259837 None] Volume volume-9b864794-072a-4a95-84de-b09e4ea5fb37 (9b864794-072a-4a95-84de-b09e4ea5fb37): created successfully Sep 28 09:28:37 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-9687883c-05b7-4a7e-a4c9-b7c46f8044d7 tempest-VolumesSnapshotTestJSON-217259837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a12dac5e-55de-4b28-ae96-1d81c9066dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:28:37 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-9687883c-05b7-4a7e-a4c9-b7c46f8044d7 tempest-VolumesSnapshotTestJSON-217259837 None] Flow 'volume_create_manager' (7b0ebf75-3a9c-4ec8-b31f-dd20feeeb973) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:28:37 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-9687883c-05b7-4a7e-a4c9-b7c46f8044d7 tempest-VolumesSnapshotTestJSON-217259837 None] Created volume successfully. Sep 28 09:28:37 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-27567810-f68e-4b16-b0da-bd5da43e2c80 tempest-VolumesSnapshotTestJSON-217259837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:28:37 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-27567810-f68e-4b16-b0da-bd5da43e2c80 tempest-VolumesSnapshotTestJSON-217259837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:28:37 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-27567810-f68e-4b16-b0da-bd5da43e2c80 tempest-VolumesSnapshotTestJSON-217259837 None] Creating offline snapshot 87bc1d6b-0cf4-4872-bae2-422ef2712036 of volume 9b864794-072a-4a95-84de-b09e4ea5fb37 {{(pid=86553) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 09:28:38 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[4112c9d1-caa0-469b-b31d-958d22f767b1]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:28:38 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-27567810-f68e-4b16-b0da-bd5da43e2c80 tempest-VolumesSnapshotTestJSON-217259837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9b864794-072a-4a95-84de-b09e4ea5fb37 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:28:38 devstack sudo[95273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9b864794-072a-4a95-84de-b09e4ea5fb37 Sep 28 09:28:38 devstack sudo[95273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:28:38 devstack sudo[95273]: pam_unix(sudo:session): session closed for user root Sep 28 09:28:38 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-27567810-f68e-4b16-b0da-bd5da43e2c80 tempest-VolumesSnapshotTestJSON-217259837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9b864794-072a-4a95-84de-b09e4ea5fb37" returned: 0 in 0.759s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:28:38 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-27567810-f68e-4b16-b0da-bd5da43e2c80 tempest-VolumesSnapshotTestJSON-217259837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9b864794-072a-4a95-84de-b09e4ea5fb37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9b864794-072a-4a95-84de-b09e4ea5fb37.87bc1d6b-0cf4-4872-bae2-422ef2712036 1G {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:28:38 devstack sudo[95281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9b864794-072a-4a95-84de-b09e4ea5fb37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9b864794-072a-4a95-84de-b09e4ea5fb37.87bc1d6b-0cf4-4872-bae2-422ef2712036 1G Sep 28 09:28:38 devstack sudo[95281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:28:39 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-258f8895-a3a3-4385-bfde-79ed367118d6 tempest-AttachVolumeNegativeTest-1957606009 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:28:39 devstack sudo[95281]: pam_unix(sudo:session): session closed for user root Sep 28 09:28:39 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-258f8895-a3a3-4385-bfde-79ed367118d6 tempest-AttachVolumeNegativeTest-1957606009 None] Flow 'volume_create_manager' (5c2b5e0e-5c5e-4ebc-9da6-ec5cc300c0f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:28:39 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-258f8895-a3a3-4385-bfde-79ed367118d6 tempest-AttachVolumeNegativeTest-1957606009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2a6c57a-cd95-4281-a262-ba64a9c8c040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:28:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-27567810-f68e-4b16-b0da-bd5da43e2c80 tempest-VolumesSnapshotTestJSON-217259837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9b864794-072a-4a95-84de-b09e4ea5fb37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9b864794-072a-4a95-84de-b09e4ea5fb37.87bc1d6b-0cf4-4872-bae2-422ef2712036 1G" returned: 0 in 1.071s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:28:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-27567810-f68e-4b16-b0da-bd5da43e2c80 tempest-VolumesSnapshotTestJSON-217259837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b864794-072a-4a95-84de-b09e4ea5fb37 -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9b864794-072a-4a95-84de-b09e4ea5fb37.87bc1d6b-0cf4-4872-bae2-422ef2712036 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:28:39 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-258f8895-a3a3-4385-bfde-79ed367118d6 tempest-AttachVolumeNegativeTest-1957606009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2a6c57a-cd95-4281-a262-ba64a9c8c040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:28:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2014663017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f38a184e-5427-40e2-a344-c19b2976ba15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae977ce2e750463c958ccb0bd085f517',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:28:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:28:40Z,use_quota=True,user_id='1ce42b207b3f42c3b1ea2429c628a473',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:28:39 devstack sudo[95296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b864794-072a-4a95-84de-b09e4ea5fb37 -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9b864794-072a-4a95-84de-b09e4ea5fb37.87bc1d6b-0cf4-4872-bae2-422ef2712036 Sep 28 09:28:39 devstack sudo[95296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:28:39 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-258f8895-a3a3-4385-bfde-79ed367118d6 tempest-AttachVolumeNegativeTest-1957606009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc848b62-21e6-4101-83e6-f6b8402542cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:28:39 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-258f8895-a3a3-4385-bfde-79ed367118d6 tempest-AttachVolumeNegativeTest-1957606009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc848b62-21e6-4101-83e6-f6b8402542cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:28:39 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-258f8895-a3a3-4385-bfde-79ed367118d6 tempest-AttachVolumeNegativeTest-1957606009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7f0208b-1b63-4ad0-9b37-2b75766be9bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:28:39 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-258f8895-a3a3-4385-bfde-79ed367118d6 tempest-AttachVolumeNegativeTest-1957606009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7f0208b-1b63-4ad0-9b37-2b75766be9bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f38a184e-5427-40e2-a344-c19b2976ba15', 'volume_name': 'volume-f38a184e-5427-40e2-a344-c19b2976ba15', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:28:39 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-258f8895-a3a3-4385-bfde-79ed367118d6 tempest-AttachVolumeNegativeTest-1957606009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ec5af34-5e26-40ed-8443-37aef17b77b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:28:39 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-258f8895-a3a3-4385-bfde-79ed367118d6 tempest-AttachVolumeNegativeTest-1957606009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ec5af34-5e26-40ed-8443-37aef17b77b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:28:39 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-258f8895-a3a3-4385-bfde-79ed367118d6 tempest-AttachVolumeNegativeTest-1957606009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0276146a-d581-44e5-a8e6-cde8a75b3a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:28:39 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-258f8895-a3a3-4385-bfde-79ed367118d6 tempest-AttachVolumeNegativeTest-1957606009 None] Volume f38a184e-5427-40e2-a344-c19b2976ba15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f38a184e-5427-40e2-a344-c19b2976ba15', 'volume_size': 1} Sep 28 09:28:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-258f8895-a3a3-4385-bfde-79ed367118d6 tempest-AttachVolumeNegativeTest-1957606009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:28:40 devstack sudo[95296]: pam_unix(sudo:session): session closed for user root Sep 28 09:28:40 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-27567810-f68e-4b16-b0da-bd5da43e2c80 tempest-VolumesSnapshotTestJSON-217259837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b864794-072a-4a95-84de-b09e4ea5fb37 -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9b864794-072a-4a95-84de-b09e4ea5fb37.87bc1d6b-0cf4-4872-bae2-422ef2712036" returned: 0 in 0.466s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:28:40 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-27567810-f68e-4b16-b0da-bd5da43e2c80 tempest-VolumesSnapshotTestJSON-217259837 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9b864794-072a-4a95-84de-b09e4ea5fb37.87bc1d6b-0cf4-4872-bae2-422ef2712036 is being set with open permissions: ugo+rw Sep 28 09:28:40 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-27567810-f68e-4b16-b0da-bd5da43e2c80 tempest-VolumesSnapshotTestJSON-217259837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9b864794-072a-4a95-84de-b09e4ea5fb37.87bc1d6b-0cf4-4872-bae2-422ef2712036 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:28:40 devstack sudo[95307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9b864794-072a-4a95-84de-b09e4ea5fb37.87bc1d6b-0cf4-4872-bae2-422ef2712036 Sep 28 09:28:40 devstack sudo[95307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:28:40 devstack sudo[95307]: pam_unix(sudo:session): session closed for user root Sep 28 09:28:40 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-27567810-f68e-4b16-b0da-bd5da43e2c80 tempest-VolumesSnapshotTestJSON-217259837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9b864794-072a-4a95-84de-b09e4ea5fb37.87bc1d6b-0cf4-4872-bae2-422ef2712036" returned: 0 in 0.293s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:28:40 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-27567810-f68e-4b16-b0da-bd5da43e2c80 tempest-VolumesSnapshotTestJSON-217259837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9b864794-072a-4a95-84de-b09e4ea5fb37.info {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:28:40 devstack sudo[95311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9b864794-072a-4a95-84de-b09e4ea5fb37.info Sep 28 09:28:40 devstack sudo[95311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:28:40 devstack sudo[95311]: pam_unix(sudo:session): session closed for user root Sep 28 09:28:40 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-27567810-f68e-4b16-b0da-bd5da43e2c80 tempest-VolumesSnapshotTestJSON-217259837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9b864794-072a-4a95-84de-b09e4ea5fb37.info" returned: 0 in 0.297s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:28:40 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-27567810-f68e-4b16-b0da-bd5da43e2c80 tempest-VolumesSnapshotTestJSON-217259837 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9b864794-072a-4a95-84de-b09e4ea5fb37.info is being set with open permissions: ugo+rw Sep 28 09:28:40 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-27567810-f68e-4b16-b0da-bd5da43e2c80 tempest-VolumesSnapshotTestJSON-217259837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9b864794-072a-4a95-84de-b09e4ea5fb37.info {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:28:41 devstack sudo[95314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9b864794-072a-4a95-84de-b09e4ea5fb37.info Sep 28 09:28:41 devstack sudo[95314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:28:41 devstack sudo[95314]: pam_unix(sudo:session): session closed for user root Sep 28 09:28:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-27567810-f68e-4b16-b0da-bd5da43e2c80 tempest-VolumesSnapshotTestJSON-217259837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9b864794-072a-4a95-84de-b09e4ea5fb37.info" returned: 0 in 0.289s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:28:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-27567810-f68e-4b16-b0da-bd5da43e2c80 tempest-VolumesSnapshotTestJSON-217259837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.324s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:28:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-258f8895-a3a3-4385-bfde-79ed367118d6 tempest-AttachVolumeNegativeTest-1957606009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.349s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:28:41 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-258f8895-a3a3-4385-bfde-79ed367118d6 tempest-AttachVolumeNegativeTest-1957606009 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:28:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2014663017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f38a184e-5427-40e2-a344-c19b2976ba15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae977ce2e750463c958ccb0bd085f517',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:28:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:28:40Z,use_quota=True,user_id='1ce42b207b3f42c3b1ea2429c628a473',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:28:41 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-258f8895-a3a3-4385-bfde-79ed367118d6 tempest-AttachVolumeNegativeTest-1957606009 None] Creating volume f38a184e-5427-40e2-a344-c19b2976ba15 {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:28:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-258f8895-a3a3-4385-bfde-79ed367118d6 tempest-AttachVolumeNegativeTest-1957606009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:28:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-258f8895-a3a3-4385-bfde-79ed367118d6 tempest-AttachVolumeNegativeTest-1957606009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:28:41 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-258f8895-a3a3-4385-bfde-79ed367118d6 tempest-AttachVolumeNegativeTest-1957606009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:28:41 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-258f8895-a3a3-4385-bfde-79ed367118d6 tempest-AttachVolumeNegativeTest-1957606009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:28:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-258f8895-a3a3-4385-bfde-79ed367118d6 tempest-AttachVolumeNegativeTest-1957606009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:28:41 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-258f8895-a3a3-4385-bfde-79ed367118d6 tempest-AttachVolumeNegativeTest-1957606009 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:28:41 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-258f8895-a3a3-4385-bfde-79ed367118d6 tempest-AttachVolumeNegativeTest-1957606009 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:28:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-258f8895-a3a3-4385-bfde-79ed367118d6 tempest-AttachVolumeNegativeTest-1957606009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f38a184e-5427-40e2-a344-c19b2976ba15 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:28:41 devstack sudo[95317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f38a184e-5427-40e2-a344-c19b2976ba15 1073741824 Sep 28 09:28:41 devstack sudo[95317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:28:41 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-27567810-f68e-4b16-b0da-bd5da43e2c80 tempest-VolumesSnapshotTestJSON-217259837 None] Create snapshot completed successfully Sep 28 09:28:41 devstack sudo[95317]: pam_unix(sudo:session): session closed for user root Sep 28 09:28:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-258f8895-a3a3-4385-bfde-79ed367118d6 tempest-AttachVolumeNegativeTest-1957606009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f38a184e-5427-40e2-a344-c19b2976ba15 1073741824" returned: 0 in 0.496s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:28:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-258f8895-a3a3-4385-bfde-79ed367118d6 tempest-AttachVolumeNegativeTest-1957606009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f38a184e-5427-40e2-a344-c19b2976ba15 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:28:41 devstack sudo[95323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f38a184e-5427-40e2-a344-c19b2976ba15 Sep 28 09:28:41 devstack sudo[95323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:28:42 devstack sudo[95323]: pam_unix(sudo:session): session closed for user root Sep 28 09:28:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-258f8895-a3a3-4385-bfde-79ed367118d6 tempest-AttachVolumeNegativeTest-1957606009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f38a184e-5427-40e2-a344-c19b2976ba15" returned: 0 in 0.278s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:28:42 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-258f8895-a3a3-4385-bfde-79ed367118d6 tempest-AttachVolumeNegativeTest-1957606009 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:28:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-258f8895-a3a3-4385-bfde-79ed367118d6 tempest-AttachVolumeNegativeTest-1957606009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:28:42 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-258f8895-a3a3-4385-bfde-79ed367118d6 tempest-AttachVolumeNegativeTest-1957606009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0276146a-d581-44e5-a8e6-cde8a75b3a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f38a184e-5427-40e2-a344-c19b2976ba15', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:28:42 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-258f8895-a3a3-4385-bfde-79ed367118d6 tempest-AttachVolumeNegativeTest-1957606009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78b231c2-e0d1-40ea-a736-a2dda132a0f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:28:42 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-258f8895-a3a3-4385-bfde-79ed367118d6 tempest-AttachVolumeNegativeTest-1957606009 None] Volume volume-f38a184e-5427-40e2-a344-c19b2976ba15 (f38a184e-5427-40e2-a344-c19b2976ba15): created successfully Sep 28 09:28:42 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-258f8895-a3a3-4385-bfde-79ed367118d6 tempest-AttachVolumeNegativeTest-1957606009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78b231c2-e0d1-40ea-a736-a2dda132a0f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:28:42 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-258f8895-a3a3-4385-bfde-79ed367118d6 tempest-AttachVolumeNegativeTest-1957606009 None] Flow 'volume_create_manager' (5c2b5e0e-5c5e-4ebc-9da6-ec5cc300c0f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:28:42 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-258f8895-a3a3-4385-bfde-79ed367118d6 tempest-AttachVolumeNegativeTest-1957606009 None] Created volume successfully. Sep 28 09:28:42 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-e311230e-3988-49bf-84fd-ec62b721980f tempest-VolumesSnapshotTestJSON-217259837 None] Acquiring lock "cinder-87bc1d6b-0cf4-4872-bae2-422ef2712036-delete_snapshot" by "delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:28:42 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-e311230e-3988-49bf-84fd-ec62b721980f tempest-VolumesSnapshotTestJSON-217259837 None] Lock "cinder-87bc1d6b-0cf4-4872-bae2-422ef2712036-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:28:42 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-e311230e-3988-49bf-84fd-ec62b721980f tempest-VolumesSnapshotTestJSON-217259837 None] Acquiring lock "cinder-quobyte-9b864794-072a-4a95-84de-b09e4ea5fb37" by "delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:28:42 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-e311230e-3988-49bf-84fd-ec62b721980f tempest-VolumesSnapshotTestJSON-217259837 None] Lock "cinder-quobyte-9b864794-072a-4a95-84de-b09e4ea5fb37" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:28:42 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-e311230e-3988-49bf-84fd-ec62b721980f tempest-VolumesSnapshotTestJSON-217259837 None] Acquiring lock "cinder-quobyte-87bc1d6b-0cf4-4872-bae2-422ef2712036" by "_delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:28:42 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-e311230e-3988-49bf-84fd-ec62b721980f tempest-VolumesSnapshotTestJSON-217259837 None] Lock "cinder-quobyte-87bc1d6b-0cf4-4872-bae2-422ef2712036" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:28:42 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-e311230e-3988-49bf-84fd-ec62b721980f tempest-VolumesSnapshotTestJSON-217259837 None] Deleting offline snapshot 87bc1d6b-0cf4-4872-bae2-422ef2712036 of volume 9b864794-072a-4a95-84de-b09e4ea5fb37 {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 09:28:42 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-e311230e-3988-49bf-84fd-ec62b721980f tempest-VolumesSnapshotTestJSON-217259837 None] snapshot_file for this snap is: volume-9b864794-072a-4a95-84de-b09e4ea5fb37.87bc1d6b-0cf4-4872-bae2-422ef2712036 {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 09:28:42 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[520e1be0-e4e1-46a4-afbc-1633fc9de299]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:28:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e311230e-3988-49bf-84fd-ec62b721980f tempest-VolumesSnapshotTestJSON-217259837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9b864794-072a-4a95-84de-b09e4ea5fb37.87bc1d6b-0cf4-4872-bae2-422ef2712036 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:28:42 devstack sudo[95326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9b864794-072a-4a95-84de-b09e4ea5fb37.87bc1d6b-0cf4-4872-bae2-422ef2712036 Sep 28 09:28:42 devstack sudo[95326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:28:43 devstack sudo[95326]: pam_unix(sudo:session): session closed for user root Sep 28 09:28:43 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e311230e-3988-49bf-84fd-ec62b721980f tempest-VolumesSnapshotTestJSON-217259837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9b864794-072a-4a95-84de-b09e4ea5fb37.87bc1d6b-0cf4-4872-bae2-422ef2712036" returned: 0 in 0.437s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:28:43 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-e311230e-3988-49bf-84fd-ec62b721980f tempest-VolumesSnapshotTestJSON-217259837 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9b864794-072a-4a95-84de-b09e4ea5fb37(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86553) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 09:28:43 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[87151673-1765-4e0a-bc7b-b85109a3aa22]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:28:43 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e311230e-3988-49bf-84fd-ec62b721980f tempest-VolumesSnapshotTestJSON-217259837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9b864794-072a-4a95-84de-b09e4ea5fb37 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:28:43 devstack sudo[95336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9b864794-072a-4a95-84de-b09e4ea5fb37 Sep 28 09:28:43 devstack sudo[95336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:28:43 devstack sudo[95336]: pam_unix(sudo:session): session closed for user root Sep 28 09:28:43 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e311230e-3988-49bf-84fd-ec62b721980f tempest-VolumesSnapshotTestJSON-217259837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9b864794-072a-4a95-84de-b09e4ea5fb37" returned: 0 in 0.750s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:28:43 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e311230e-3988-49bf-84fd-ec62b721980f tempest-VolumesSnapshotTestJSON-217259837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9b864794-072a-4a95-84de-b09e4ea5fb37.87bc1d6b-0cf4-4872-bae2-422ef2712036 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:28:43 devstack sudo[95350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9b864794-072a-4a95-84de-b09e4ea5fb37.87bc1d6b-0cf4-4872-bae2-422ef2712036 Sep 28 09:28:43 devstack sudo[95350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:28:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-82c83901-58be-460c-adbd-52ef8f7ce250 req-3303a5e3-f817-43dc-8b3f-25bb5fde3d5d tempest-AttachVolumeNegativeTest-1957606009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:28:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-82c83901-58be-460c-adbd-52ef8f7ce250 req-3303a5e3-f817-43dc-8b3f-25bb5fde3d5d tempest-AttachVolumeNegativeTest-1957606009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:28:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-82c83901-58be-460c-adbd-52ef8f7ce250 req-3303a5e3-f817-43dc-8b3f-25bb5fde3d5d tempest-AttachVolumeNegativeTest-1957606009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:28:44 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [req-82c83901-58be-460c-adbd-52ef8f7ce250 req-3303a5e3-f817-43dc-8b3f-25bb5fde3d5d tempest-AttachVolumeNegativeTest-1957606009 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d', 'name': 'volume-f38a184e-5427-40e2-a344-c19b2976ba15', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '486edb22-3f95-42b7-a864-61caa0367674', 'enforce_multipath': True} {{(pid=86553) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 09:28:44 devstack cinder-volume[86553]: INFO cinder.volume.manager [req-82c83901-58be-460c-adbd-52ef8f7ce250 req-3303a5e3-f817-43dc-8b3f-25bb5fde3d5d tempest-AttachVolumeNegativeTest-1957606009 None] attachment_update completed successfully. Sep 28 09:28:44 devstack sudo[95350]: pam_unix(sudo:session): session closed for user root Sep 28 09:28:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e311230e-3988-49bf-84fd-ec62b721980f tempest-VolumesSnapshotTestJSON-217259837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9b864794-072a-4a95-84de-b09e4ea5fb37.87bc1d6b-0cf4-4872-bae2-422ef2712036" returned: 0 in 0.440s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:28:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e311230e-3988-49bf-84fd-ec62b721980f tempest-VolumesSnapshotTestJSON-217259837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9b864794-072a-4a95-84de-b09e4ea5fb37.87bc1d6b-0cf4-4872-bae2-422ef2712036 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:28:44 devstack sudo[95357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9b864794-072a-4a95-84de-b09e4ea5fb37.87bc1d6b-0cf4-4872-bae2-422ef2712036 Sep 28 09:28:44 devstack sudo[95357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:28:44 devstack sudo[95357]: pam_unix(sudo:session): session closed for user root Sep 28 09:28:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e311230e-3988-49bf-84fd-ec62b721980f tempest-VolumesSnapshotTestJSON-217259837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9b864794-072a-4a95-84de-b09e4ea5fb37.87bc1d6b-0cf4-4872-bae2-422ef2712036" returned: 0 in 0.381s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:28:44 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-e311230e-3988-49bf-84fd-ec62b721980f tempest-VolumesSnapshotTestJSON-217259837 None] Lock "cinder-quobyte-87bc1d6b-0cf4-4872-bae2-422ef2712036" released by "_delete_snapshot" :: held 2.179s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:28:44 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-e311230e-3988-49bf-84fd-ec62b721980f tempest-VolumesSnapshotTestJSON-217259837 None] Lock "cinder-quobyte-9b864794-072a-4a95-84de-b09e4ea5fb37" released by "delete_snapshot" :: held 2.218s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:28:44 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-e311230e-3988-49bf-84fd-ec62b721980f tempest-VolumesSnapshotTestJSON-217259837 None] Created reservations ['d5f4677a-c2c0-450f-a4be-db396d5d14ed', '1cffeeb3-0b81-4ef4-95de-491adb912fa0', 'f22fb381-a193-4462-83db-5bfde782eb4e', '230fd84f-00bf-4355-b1dc-6982c507e36e'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:28:44 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-e311230e-3988-49bf-84fd-ec62b721980f tempest-VolumesSnapshotTestJSON-217259837 None] Delete snapshot completed successfully. Sep 28 09:28:45 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-e311230e-3988-49bf-84fd-ec62b721980f tempest-VolumesSnapshotTestJSON-217259837 None] Lock "cinder-87bc1d6b-0cf4-4872-bae2-422ef2712036-delete_snapshot" released by "delete_snapshot" :: held 2.482s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:28:46 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-34e38c1e-6cac-4322-bd5f-7c60b32cfc5c tempest-VolumesSnapshotTestJSON-217259837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:28:46 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-34e38c1e-6cac-4322-bd5f-7c60b32cfc5c tempest-VolumesSnapshotTestJSON-217259837 None] Flow 'volume_create_manager' (858942b8-3aaa-4522-bfb4-c4ab92830e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:28:46 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-34e38c1e-6cac-4322-bd5f-7c60b32cfc5c tempest-VolumesSnapshotTestJSON-217259837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbad303e-f04d-45c6-93f8-9223173aa1a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:28:46 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-34e38c1e-6cac-4322-bd5f-7c60b32cfc5c tempest-VolumesSnapshotTestJSON-217259837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbad303e-f04d-45c6-93f8-9223173aa1a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:28:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1045675883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc0f442e-1825-42ae-b546-bec64d63bebe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bbcf34b7f064aea995bcb5be8a2c1d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:28:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:28:47Z,use_quota=True,user_id='cc1d0bb36b3f4787bb419c14842829ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:28:46 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-34e38c1e-6cac-4322-bd5f-7c60b32cfc5c tempest-VolumesSnapshotTestJSON-217259837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c3bdab4-25a7-4863-96fa-107faf89405c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:28:46 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-34e38c1e-6cac-4322-bd5f-7c60b32cfc5c tempest-VolumesSnapshotTestJSON-217259837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c3bdab4-25a7-4863-96fa-107faf89405c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:28:46 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-34e38c1e-6cac-4322-bd5f-7c60b32cfc5c tempest-VolumesSnapshotTestJSON-217259837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72602724-bacd-47cd-a117-59230850a60a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:28:46 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-34e38c1e-6cac-4322-bd5f-7c60b32cfc5c tempest-VolumesSnapshotTestJSON-217259837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72602724-bacd-47cd-a117-59230850a60a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc0f442e-1825-42ae-b546-bec64d63bebe', 'volume_name': 'volume-dc0f442e-1825-42ae-b546-bec64d63bebe', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:28:46 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-34e38c1e-6cac-4322-bd5f-7c60b32cfc5c tempest-VolumesSnapshotTestJSON-217259837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (733b486b-edb4-47e5-ba08-54439203d037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:28:46 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-34e38c1e-6cac-4322-bd5f-7c60b32cfc5c tempest-VolumesSnapshotTestJSON-217259837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (733b486b-edb4-47e5-ba08-54439203d037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:28:46 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-34e38c1e-6cac-4322-bd5f-7c60b32cfc5c tempest-VolumesSnapshotTestJSON-217259837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29fb7090-2f0d-414a-bb68-a0584eca0f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:28:46 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-34e38c1e-6cac-4322-bd5f-7c60b32cfc5c tempest-VolumesSnapshotTestJSON-217259837 None] Volume dc0f442e-1825-42ae-b546-bec64d63bebe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc0f442e-1825-42ae-b546-bec64d63bebe', 'volume_size': 1} Sep 28 09:28:46 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-34e38c1e-6cac-4322-bd5f-7c60b32cfc5c tempest-VolumesSnapshotTestJSON-217259837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:28:46 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-34e38c1e-6cac-4322-bd5f-7c60b32cfc5c tempest-VolumesSnapshotTestJSON-217259837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:28:46 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-34e38c1e-6cac-4322-bd5f-7c60b32cfc5c tempest-VolumesSnapshotTestJSON-217259837 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:28:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1045675883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc0f442e-1825-42ae-b546-bec64d63bebe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bbcf34b7f064aea995bcb5be8a2c1d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:28:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:28:47Z,use_quota=True,user_id='cc1d0bb36b3f4787bb419c14842829ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:28:46 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-34e38c1e-6cac-4322-bd5f-7c60b32cfc5c tempest-VolumesSnapshotTestJSON-217259837 None] Creating volume dc0f442e-1825-42ae-b546-bec64d63bebe {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:28:46 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-34e38c1e-6cac-4322-bd5f-7c60b32cfc5c tempest-VolumesSnapshotTestJSON-217259837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:28:46 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-34e38c1e-6cac-4322-bd5f-7c60b32cfc5c tempest-VolumesSnapshotTestJSON-217259837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:28:46 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-34e38c1e-6cac-4322-bd5f-7c60b32cfc5c tempest-VolumesSnapshotTestJSON-217259837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:28:47 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-34e38c1e-6cac-4322-bd5f-7c60b32cfc5c tempest-VolumesSnapshotTestJSON-217259837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:28:47 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-34e38c1e-6cac-4322-bd5f-7c60b32cfc5c tempest-VolumesSnapshotTestJSON-217259837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:28:47 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-34e38c1e-6cac-4322-bd5f-7c60b32cfc5c tempest-VolumesSnapshotTestJSON-217259837 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:28:47 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-34e38c1e-6cac-4322-bd5f-7c60b32cfc5c tempest-VolumesSnapshotTestJSON-217259837 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:28:47 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-34e38c1e-6cac-4322-bd5f-7c60b32cfc5c tempest-VolumesSnapshotTestJSON-217259837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-dc0f442e-1825-42ae-b546-bec64d63bebe 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:28:47 devstack sudo[95791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-dc0f442e-1825-42ae-b546-bec64d63bebe 1073741824 Sep 28 09:28:47 devstack sudo[95791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:28:47 devstack cinder-volume[86553]: INFO cinder.volume.manager [req-87524a54-a2c0-4eb8-8700-0fbf2b474343 req-df597777-2c2f-49b0-8125-73e19ab97a9a tempest-AttachVolumeNegativeTest-1957606009 None] Terminate volume connection completed successfully. Sep 28 09:28:47 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [req-87524a54-a2c0-4eb8-8700-0fbf2b474343 req-df597777-2c2f-49b0-8125-73e19ab97a9a tempest-AttachVolumeNegativeTest-1957606009 None] Deleting attachment 486edb22-3f95-42b7-a864-61caa0367674. {{(pid=86553) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 09:28:47 devstack sudo[95791]: pam_unix(sudo:session): session closed for user root Sep 28 09:28:47 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-34e38c1e-6cac-4322-bd5f-7c60b32cfc5c tempest-VolumesSnapshotTestJSON-217259837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-dc0f442e-1825-42ae-b546-bec64d63bebe 1073741824" returned: 0 in 0.718s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:28:47 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-34e38c1e-6cac-4322-bd5f-7c60b32cfc5c tempest-VolumesSnapshotTestJSON-217259837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-dc0f442e-1825-42ae-b546-bec64d63bebe {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:28:47 devstack sudo[95829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-dc0f442e-1825-42ae-b546-bec64d63bebe Sep 28 09:28:47 devstack sudo[95829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:28:48 devstack sudo[95829]: pam_unix(sudo:session): session closed for user root Sep 28 09:28:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-34e38c1e-6cac-4322-bd5f-7c60b32cfc5c tempest-VolumesSnapshotTestJSON-217259837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-dc0f442e-1825-42ae-b546-bec64d63bebe" returned: 0 in 0.314s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:28:48 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-34e38c1e-6cac-4322-bd5f-7c60b32cfc5c tempest-VolumesSnapshotTestJSON-217259837 None] <== create_volume: return (1110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:28:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-34e38c1e-6cac-4322-bd5f-7c60b32cfc5c tempest-VolumesSnapshotTestJSON-217259837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.114s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:28:48 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-34e38c1e-6cac-4322-bd5f-7c60b32cfc5c tempest-VolumesSnapshotTestJSON-217259837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29fb7090-2f0d-414a-bb68-a0584eca0f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc0f442e-1825-42ae-b546-bec64d63bebe', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:28:48 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-34e38c1e-6cac-4322-bd5f-7c60b32cfc5c tempest-VolumesSnapshotTestJSON-217259837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c26c2e2f-d581-4a90-890e-4dc038d7fb78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:28:48 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-34e38c1e-6cac-4322-bd5f-7c60b32cfc5c tempest-VolumesSnapshotTestJSON-217259837 None] Volume volume-dc0f442e-1825-42ae-b546-bec64d63bebe (dc0f442e-1825-42ae-b546-bec64d63bebe): created successfully Sep 28 09:28:48 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-34e38c1e-6cac-4322-bd5f-7c60b32cfc5c tempest-VolumesSnapshotTestJSON-217259837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c26c2e2f-d581-4a90-890e-4dc038d7fb78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:28:48 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-34e38c1e-6cac-4322-bd5f-7c60b32cfc5c tempest-VolumesSnapshotTestJSON-217259837 None] Flow 'volume_create_manager' (858942b8-3aaa-4522-bfb4-c4ab92830e02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:28:48 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-34e38c1e-6cac-4322-bd5f-7c60b32cfc5c tempest-VolumesSnapshotTestJSON-217259837 None] Created volume successfully. Sep 28 09:28:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-03c319ea-9db2-455c-9295-a969c0ae8bcc tempest-VolumesSnapshotTestJSON-217259837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:28:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-03c319ea-9db2-455c-9295-a969c0ae8bcc tempest-VolumesSnapshotTestJSON-217259837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:28:48 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-03c319ea-9db2-455c-9295-a969c0ae8bcc tempest-VolumesSnapshotTestJSON-217259837 None] Creating offline snapshot 1e5ab227-3ec1-44d0-afab-de138528edc3 of volume dc0f442e-1825-42ae-b546-bec64d63bebe {{(pid=86553) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 09:28:48 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcbe8af6-30e1-47a3-bcfc-53e1fc72d438]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:28:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-03c319ea-9db2-455c-9295-a969c0ae8bcc tempest-VolumesSnapshotTestJSON-217259837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-dc0f442e-1825-42ae-b546-bec64d63bebe {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:28:49 devstack sudo[95832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-dc0f442e-1825-42ae-b546-bec64d63bebe Sep 28 09:28:49 devstack sudo[95832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:28:49 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [req-bd7f882e-06c7-4a4c-a6ab-ea51db08be2f req-1a224824-c2d1-45c5-8f2a-553892e180a4 tempest-AttachVolumeShelveTestJSON-491900363 None] No connector for attachment f880a4a4-3137-407d-a799-f834c39f4912; skipping storage backend terminate_connection call. {{(pid=86553) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 28 09:28:49 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [req-bd7f882e-06c7-4a4c-a6ab-ea51db08be2f req-1a224824-c2d1-45c5-8f2a-553892e180a4 tempest-AttachVolumeShelveTestJSON-491900363 None] Deleting attachment f880a4a4-3137-407d-a799-f834c39f4912. {{(pid=86553) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 09:28:49 devstack sudo[95832]: pam_unix(sudo:session): session closed for user root Sep 28 09:28:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-03c319ea-9db2-455c-9295-a969c0ae8bcc tempest-VolumesSnapshotTestJSON-217259837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-dc0f442e-1825-42ae-b546-bec64d63bebe" returned: 0 in 0.684s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:28:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-03c319ea-9db2-455c-9295-a969c0ae8bcc tempest-VolumesSnapshotTestJSON-217259837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-dc0f442e-1825-42ae-b546-bec64d63bebe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-dc0f442e-1825-42ae-b546-bec64d63bebe.1e5ab227-3ec1-44d0-afab-de138528edc3 1G {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:28:49 devstack sudo[95857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-dc0f442e-1825-42ae-b546-bec64d63bebe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-dc0f442e-1825-42ae-b546-bec64d63bebe.1e5ab227-3ec1-44d0-afab-de138528edc3 1G Sep 28 09:28:49 devstack sudo[95857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:28:50 devstack sudo[95857]: pam_unix(sudo:session): session closed for user root Sep 28 09:28:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-03c319ea-9db2-455c-9295-a969c0ae8bcc tempest-VolumesSnapshotTestJSON-217259837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-dc0f442e-1825-42ae-b546-bec64d63bebe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-dc0f442e-1825-42ae-b546-bec64d63bebe.1e5ab227-3ec1-44d0-afab-de138528edc3 1G" returned: 0 in 0.742s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:28:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-03c319ea-9db2-455c-9295-a969c0ae8bcc tempest-VolumesSnapshotTestJSON-217259837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc0f442e-1825-42ae-b546-bec64d63bebe -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-dc0f442e-1825-42ae-b546-bec64d63bebe.1e5ab227-3ec1-44d0-afab-de138528edc3 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:28:50 devstack sudo[95884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc0f442e-1825-42ae-b546-bec64d63bebe -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-dc0f442e-1825-42ae-b546-bec64d63bebe.1e5ab227-3ec1-44d0-afab-de138528edc3 Sep 28 09:28:50 devstack sudo[95884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:28:50 devstack sudo[95884]: pam_unix(sudo:session): session closed for user root Sep 28 09:28:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-03c319ea-9db2-455c-9295-a969c0ae8bcc tempest-VolumesSnapshotTestJSON-217259837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc0f442e-1825-42ae-b546-bec64d63bebe -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-dc0f442e-1825-42ae-b546-bec64d63bebe.1e5ab227-3ec1-44d0-afab-de138528edc3" returned: 0 in 0.456s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:28:50 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-03c319ea-9db2-455c-9295-a969c0ae8bcc tempest-VolumesSnapshotTestJSON-217259837 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-dc0f442e-1825-42ae-b546-bec64d63bebe.1e5ab227-3ec1-44d0-afab-de138528edc3 is being set with open permissions: ugo+rw Sep 28 09:28:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-03c319ea-9db2-455c-9295-a969c0ae8bcc tempest-VolumesSnapshotTestJSON-217259837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-dc0f442e-1825-42ae-b546-bec64d63bebe.1e5ab227-3ec1-44d0-afab-de138528edc3 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:28:50 devstack sudo[95891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-dc0f442e-1825-42ae-b546-bec64d63bebe.1e5ab227-3ec1-44d0-afab-de138528edc3 Sep 28 09:28:50 devstack sudo[95891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:28:51 devstack sudo[95891]: pam_unix(sudo:session): session closed for user root Sep 28 09:28:51 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-03c319ea-9db2-455c-9295-a969c0ae8bcc tempest-VolumesSnapshotTestJSON-217259837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-dc0f442e-1825-42ae-b546-bec64d63bebe.1e5ab227-3ec1-44d0-afab-de138528edc3" returned: 0 in 0.308s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:28:51 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-03c319ea-9db2-455c-9295-a969c0ae8bcc tempest-VolumesSnapshotTestJSON-217259837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-dc0f442e-1825-42ae-b546-bec64d63bebe.info {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:28:51 devstack sudo[95897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-dc0f442e-1825-42ae-b546-bec64d63bebe.info Sep 28 09:28:51 devstack sudo[95897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:28:51 devstack sudo[95897]: pam_unix(sudo:session): session closed for user root Sep 28 09:28:51 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-03c319ea-9db2-455c-9295-a969c0ae8bcc tempest-VolumesSnapshotTestJSON-217259837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-dc0f442e-1825-42ae-b546-bec64d63bebe.info" returned: 0 in 0.354s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:28:51 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-03c319ea-9db2-455c-9295-a969c0ae8bcc tempest-VolumesSnapshotTestJSON-217259837 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-dc0f442e-1825-42ae-b546-bec64d63bebe.info is being set with open permissions: ugo+rw Sep 28 09:28:51 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-03c319ea-9db2-455c-9295-a969c0ae8bcc tempest-VolumesSnapshotTestJSON-217259837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-dc0f442e-1825-42ae-b546-bec64d63bebe.info {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:28:51 devstack sudo[95901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-dc0f442e-1825-42ae-b546-bec64d63bebe.info Sep 28 09:28:51 devstack sudo[95901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:28:51 devstack sudo[95901]: pam_unix(sudo:session): session closed for user root Sep 28 09:28:51 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-03c319ea-9db2-455c-9295-a969c0ae8bcc tempest-VolumesSnapshotTestJSON-217259837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-dc0f442e-1825-42ae-b546-bec64d63bebe.info" returned: 0 in 0.288s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:28:51 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-03c319ea-9db2-455c-9295-a969c0ae8bcc tempest-VolumesSnapshotTestJSON-217259837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.972s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:28:51 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-03c319ea-9db2-455c-9295-a969c0ae8bcc tempest-VolumesSnapshotTestJSON-217259837 None] Create snapshot completed successfully Sep 28 09:28:52 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-405efe05-19a4-48b8-8cc8-f335ea362838 tempest-VolumesSnapshotTestJSON-217259837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:28:52 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-405efe05-19a4-48b8-8cc8-f335ea362838 tempest-VolumesSnapshotTestJSON-217259837 None] Flow 'volume_create_manager' (d8747830-35d3-4fe3-903d-fe60f3633e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:28:52 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-405efe05-19a4-48b8-8cc8-f335ea362838 tempest-VolumesSnapshotTestJSON-217259837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eba6e974-0c84-4ab4-a304-f2e1d9307e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:28:52 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-405efe05-19a4-48b8-8cc8-f335ea362838 tempest-VolumesSnapshotTestJSON-217259837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eba6e974-0c84-4ab4-a304-f2e1d9307e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:28:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1639897985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25dd9ee9-7a59-4d0a-8f7f-baeeb4703303,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bbcf34b7f064aea995bcb5be8a2c1d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:28:53Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=1e5ab227-3ec1-44d0-afab-de138528edc3,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:28:53Z,use_quota=True,user_id='cc1d0bb36b3f4787bb419c14842829ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:28:52 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-405efe05-19a4-48b8-8cc8-f335ea362838 tempest-VolumesSnapshotTestJSON-217259837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afd88639-428b-48ca-a9f9-a0b55584b792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:28:52 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-405efe05-19a4-48b8-8cc8-f335ea362838 tempest-VolumesSnapshotTestJSON-217259837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afd88639-428b-48ca-a9f9-a0b55584b792) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:28:52 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-405efe05-19a4-48b8-8cc8-f335ea362838 tempest-VolumesSnapshotTestJSON-217259837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (218fad76-3d42-45f5-872f-584540cba5e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:28:52 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-405efe05-19a4-48b8-8cc8-f335ea362838 tempest-VolumesSnapshotTestJSON-217259837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (218fad76-3d42-45f5-872f-584540cba5e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '25dd9ee9-7a59-4d0a-8f7f-baeeb4703303', 'volume_name': 'volume-25dd9ee9-7a59-4d0a-8f7f-baeeb4703303', 'volume_size': 2, 'snapshot_id': '1e5ab227-3ec1-44d0-afab-de138528edc3'}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:28:52 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-405efe05-19a4-48b8-8cc8-f335ea362838 tempest-VolumesSnapshotTestJSON-217259837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (032d9fbc-aa59-4841-927a-1a43402120ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:28:52 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-405efe05-19a4-48b8-8cc8-f335ea362838 tempest-VolumesSnapshotTestJSON-217259837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (032d9fbc-aa59-4841-927a-1a43402120ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:28:52 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-405efe05-19a4-48b8-8cc8-f335ea362838 tempest-VolumesSnapshotTestJSON-217259837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82ec50e0-0ff4-4c20-b413-49158189224a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:28:52 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-405efe05-19a4-48b8-8cc8-f335ea362838 tempest-VolumesSnapshotTestJSON-217259837 None] Volume 25dd9ee9-7a59-4d0a-8f7f-baeeb4703303: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-25dd9ee9-7a59-4d0a-8f7f-baeeb4703303', 'volume_size': 2, 'snapshot_id': '1e5ab227-3ec1-44d0-afab-de138528edc3'} Sep 28 09:28:52 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-405efe05-19a4-48b8-8cc8-f335ea362838 tempest-VolumesSnapshotTestJSON-217259837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:28:52 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-405efe05-19a4-48b8-8cc8-f335ea362838 tempest-VolumesSnapshotTestJSON-217259837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:28:52 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-405efe05-19a4-48b8-8cc8-f335ea362838 tempest-VolumesSnapshotTestJSON-217259837 None] Acquiring lock "cinder-quobyte-1e5ab227-3ec1-44d0-afab-de138528edc3-25dd9ee9-7a59-4d0a-8f7f-baeeb4703303" by "_create_volume_from_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:28:52 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-405efe05-19a4-48b8-8cc8-f335ea362838 tempest-VolumesSnapshotTestJSON-217259837 None] Lock "cinder-quobyte-1e5ab227-3ec1-44d0-afab-de138528edc3-25dd9ee9-7a59-4d0a-8f7f-baeeb4703303" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:28:52 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-405efe05-19a4-48b8-8cc8-f335ea362838 tempest-VolumesSnapshotTestJSON-217259837 None] Creating volume 25dd9ee9-7a59-4d0a-8f7f-baeeb4703303 from snapshot 1e5ab227-3ec1-44d0-afab-de138528edc3 {{(pid=86553) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 09:28:52 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-405efe05-19a4-48b8-8cc8-f335ea362838 tempest-VolumesSnapshotTestJSON-217259837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:28:52 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-405efe05-19a4-48b8-8cc8-f335ea362838 tempest-VolumesSnapshotTestJSON-217259837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:28:52 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-405efe05-19a4-48b8-8cc8-f335ea362838 tempest-VolumesSnapshotTestJSON-217259837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:28:52 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-405efe05-19a4-48b8-8cc8-f335ea362838 tempest-VolumesSnapshotTestJSON-217259837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:28:52 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-405efe05-19a4-48b8-8cc8-f335ea362838 tempest-VolumesSnapshotTestJSON-217259837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:28:52 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-405efe05-19a4-48b8-8cc8-f335ea362838 tempest-VolumesSnapshotTestJSON-217259837 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:28:52 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-405efe05-19a4-48b8-8cc8-f335ea362838 tempest-VolumesSnapshotTestJSON-217259837 None] Acquiring lock "cinder-quobyte-25dd9ee9-7a59-4d0a-8f7f-baeeb4703303" by "_copy_volume_from_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:28:52 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-405efe05-19a4-48b8-8cc8-f335ea362838 tempest-VolumesSnapshotTestJSON-217259837 None] Lock "cinder-quobyte-25dd9ee9-7a59-4d0a-8f7f-baeeb4703303" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:28:52 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-405efe05-19a4-48b8-8cc8-f335ea362838 tempest-VolumesSnapshotTestJSON-217259837 None] snapshot: 1e5ab227-3ec1-44d0-afab-de138528edc3, volume: 25dd9ee9-7a59-4d0a-8f7f-baeeb4703303, {{(pid=86553) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 09:28:53 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-405efe05-19a4-48b8-8cc8-f335ea362838 tempest-VolumesSnapshotTestJSON-217259837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:28:53 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-405efe05-19a4-48b8-8cc8-f335ea362838 tempest-VolumesSnapshotTestJSON-217259837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:28:53 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-405efe05-19a4-48b8-8cc8-f335ea362838 tempest-VolumesSnapshotTestJSON-217259837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:28:53 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-405efe05-19a4-48b8-8cc8-f335ea362838 tempest-VolumesSnapshotTestJSON-217259837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:28:53 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-405efe05-19a4-48b8-8cc8-f335ea362838 tempest-VolumesSnapshotTestJSON-217259837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:28:53 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[c44aa3b2-cbd4-46ac-93cf-1cdf792d6c3a]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:28:53 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-405efe05-19a4-48b8-8cc8-f335ea362838 tempest-VolumesSnapshotTestJSON-217259837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-dc0f442e-1825-42ae-b546-bec64d63bebe.1e5ab227-3ec1-44d0-afab-de138528edc3 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:28:53 devstack sudo[95904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-dc0f442e-1825-42ae-b546-bec64d63bebe.1e5ab227-3ec1-44d0-afab-de138528edc3 Sep 28 09:28:53 devstack sudo[95904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:28:53 devstack sudo[95904]: pam_unix(sudo:session): session closed for user root Sep 28 09:28:53 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-405efe05-19a4-48b8-8cc8-f335ea362838 tempest-VolumesSnapshotTestJSON-217259837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-dc0f442e-1825-42ae-b546-bec64d63bebe.1e5ab227-3ec1-44d0-afab-de138528edc3" returned: 0 in 0.428s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:28:53 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-405efe05-19a4-48b8-8cc8-f335ea362838 tempest-VolumesSnapshotTestJSON-217259837 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dc0f442e-1825-42ae-b546-bec64d63bebe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86553) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 09:28:53 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bea4ed5-35d9-452e-8571-bc35ae994591]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:28:53 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-405efe05-19a4-48b8-8cc8-f335ea362838 tempest-VolumesSnapshotTestJSON-217259837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-dc0f442e-1825-42ae-b546-bec64d63bebe {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:28:53 devstack sudo[95909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-dc0f442e-1825-42ae-b546-bec64d63bebe Sep 28 09:28:53 devstack sudo[95909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:28:54 devstack sudo[95909]: pam_unix(sudo:session): session closed for user root Sep 28 09:28:54 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-405efe05-19a4-48b8-8cc8-f335ea362838 tempest-VolumesSnapshotTestJSON-217259837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-dc0f442e-1825-42ae-b546-bec64d63bebe" returned: 0 in 0.512s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:28:54 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-405efe05-19a4-48b8-8cc8-f335ea362838 tempest-VolumesSnapshotTestJSON-217259837 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-dc0f442e-1825-42ae-b546-bec64d63bebe {{(pid=86553) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 09:28:54 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-405efe05-19a4-48b8-8cc8-f335ea362838 tempest-VolumesSnapshotTestJSON-217259837 None] Creating direct copy from snapshot {{(pid=86553) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 09:28:54 devstack cinder-volume[86553]: DEBUG cinder.utils [None req-405efe05-19a4-48b8-8cc8-f335ea362838 tempest-VolumesSnapshotTestJSON-217259837 None] Path /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-25dd9ee9-7a59-4d0a-8f7f-baeeb4703303 not found in is_blk_device check {{(pid=86553) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 09:28:54 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-405efe05-19a4-48b8-8cc8-f335ea362838 tempest-VolumesSnapshotTestJSON-217259837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-dc0f442e-1825-42ae-b546-bec64d63bebe /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-25dd9ee9-7a59-4d0a-8f7f-baeeb4703303 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:28:54 devstack sudo[95915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-dc0f442e-1825-42ae-b546-bec64d63bebe /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-25dd9ee9-7a59-4d0a-8f7f-baeeb4703303 Sep 28 09:28:54 devstack sudo[95915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:29:02 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-335c2ab7-6cb1-4131-93e9-76d6bfac5ff5 tempest-AttachVolumeTestJSON-612710564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:29:03 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-335c2ab7-6cb1-4131-93e9-76d6bfac5ff5 tempest-AttachVolumeTestJSON-612710564 None] Flow 'volume_create_manager' (ac6f43f4-518a-47b4-b85e-0282f7125cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:29:03 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-335c2ab7-6cb1-4131-93e9-76d6bfac5ff5 tempest-AttachVolumeTestJSON-612710564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e877509-1bae-4242-8047-241bed632dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:29:03 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-335c2ab7-6cb1-4131-93e9-76d6bfac5ff5 tempest-AttachVolumeTestJSON-612710564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e877509-1bae-4242-8047-241bed632dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:29:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1116627585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c761e4c-eed8-4468-8770-ed1dc47b49e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bb70789f7694e3c98616e64328affc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:29:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:29:03Z,use_quota=True,user_id='247feee458a1454896a7c550b17f684d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:29:03 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-335c2ab7-6cb1-4131-93e9-76d6bfac5ff5 tempest-AttachVolumeTestJSON-612710564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3de4fd1f-676f-415b-9cda-4a1300d48392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:29:03 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-335c2ab7-6cb1-4131-93e9-76d6bfac5ff5 tempest-AttachVolumeTestJSON-612710564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3de4fd1f-676f-415b-9cda-4a1300d48392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:29:03 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-335c2ab7-6cb1-4131-93e9-76d6bfac5ff5 tempest-AttachVolumeTestJSON-612710564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b643aade-4000-4fd3-a516-3790b15ad8c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:29:03 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-335c2ab7-6cb1-4131-93e9-76d6bfac5ff5 tempest-AttachVolumeTestJSON-612710564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b643aade-4000-4fd3-a516-3790b15ad8c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c761e4c-eed8-4468-8770-ed1dc47b49e5', 'volume_name': 'volume-8c761e4c-eed8-4468-8770-ed1dc47b49e5', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:29:03 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-335c2ab7-6cb1-4131-93e9-76d6bfac5ff5 tempest-AttachVolumeTestJSON-612710564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67287911-e00b-4f3e-a207-b19b6bd095be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:29:03 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-335c2ab7-6cb1-4131-93e9-76d6bfac5ff5 tempest-AttachVolumeTestJSON-612710564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67287911-e00b-4f3e-a207-b19b6bd095be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:29:03 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-335c2ab7-6cb1-4131-93e9-76d6bfac5ff5 tempest-AttachVolumeTestJSON-612710564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1e7ebf5-fa64-4ef3-8802-fe7155b7d6f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:29:03 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-335c2ab7-6cb1-4131-93e9-76d6bfac5ff5 tempest-AttachVolumeTestJSON-612710564 None] Volume 8c761e4c-eed8-4468-8770-ed1dc47b49e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c761e4c-eed8-4468-8770-ed1dc47b49e5', 'volume_size': 1} Sep 28 09:29:03 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-335c2ab7-6cb1-4131-93e9-76d6bfac5ff5 tempest-AttachVolumeTestJSON-612710564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:29:04 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-405efe05-19a4-48b8-8cc8-f335ea362838 tempest-VolumesSnapshotTestJSON-217259837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-dc0f442e-1825-42ae-b546-bec64d63bebe /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-25dd9ee9-7a59-4d0a-8f7f-baeeb4703303" returned: 0 in 10.323s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:29:04 devstack cinder-volume[86553]: DEBUG cinder.image.image_utils [None req-405efe05-19a4-48b8-8cc8-f335ea362838 tempest-VolumesSnapshotTestJSON-217259837 None] Image conversion details: src /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-dc0f442e-1825-42ae-b546-bec64d63bebe, size 1024.00 MB, duration 10.32 sec, destination /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-25dd9ee9-7a59-4d0a-8f7f-baeeb4703303 {{(pid=86553) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 09:29:04 devstack cinder-volume[86553]: INFO cinder.image.image_utils [None req-405efe05-19a4-48b8-8cc8-f335ea362838 tempest-VolumesSnapshotTestJSON-217259837 None] Converted 1024.00 MB image at 99.18 MB/s Sep 28 09:29:04 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-405efe05-19a4-48b8-8cc8-f335ea362838 tempest-VolumesSnapshotTestJSON-217259837 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-25dd9ee9-7a59-4d0a-8f7f-baeeb4703303 is being set with open permissions: ugo+rw Sep 28 09:29:04 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-405efe05-19a4-48b8-8cc8-f335ea362838 tempest-VolumesSnapshotTestJSON-217259837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-25dd9ee9-7a59-4d0a-8f7f-baeeb4703303 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:29:04 devstack sudo[96000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-25dd9ee9-7a59-4d0a-8f7f-baeeb4703303 Sep 28 09:29:04 devstack sudo[96000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:29:04 devstack sudo[96000]: pam_unix(sudo:session): session closed for user root Sep 28 09:29:04 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-405efe05-19a4-48b8-8cc8-f335ea362838 tempest-VolumesSnapshotTestJSON-217259837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-25dd9ee9-7a59-4d0a-8f7f-baeeb4703303" returned: 0 in 0.512s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:29:04 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-405efe05-19a4-48b8-8cc8-f335ea362838 tempest-VolumesSnapshotTestJSON-217259837 None] Lock "cinder-quobyte-25dd9ee9-7a59-4d0a-8f7f-baeeb4703303" released by "_copy_volume_from_snapshot" :: held 11.900s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:29:04 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-405efe05-19a4-48b8-8cc8-f335ea362838 tempest-VolumesSnapshotTestJSON-217259837 None] Lock "cinder-quobyte-1e5ab227-3ec1-44d0-afab-de138528edc3-25dd9ee9-7a59-4d0a-8f7f-baeeb4703303" released by "_create_volume_from_snapshot" :: held 12.017s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:29:04 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-405efe05-19a4-48b8-8cc8-f335ea362838 tempest-VolumesSnapshotTestJSON-217259837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.035s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:29:04 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-335c2ab7-6cb1-4131-93e9-76d6bfac5ff5 tempest-AttachVolumeTestJSON-612710564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.785s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:29:04 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-335c2ab7-6cb1-4131-93e9-76d6bfac5ff5 tempest-AttachVolumeTestJSON-612710564 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:29:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1116627585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c761e4c-eed8-4468-8770-ed1dc47b49e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bb70789f7694e3c98616e64328affc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:29:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:29:03Z,use_quota=True,user_id='247feee458a1454896a7c550b17f684d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:29:04 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-335c2ab7-6cb1-4131-93e9-76d6bfac5ff5 tempest-AttachVolumeTestJSON-612710564 None] Creating volume 8c761e4c-eed8-4468-8770-ed1dc47b49e5 {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:29:04 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-335c2ab7-6cb1-4131-93e9-76d6bfac5ff5 tempest-AttachVolumeTestJSON-612710564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:29:04 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-335c2ab7-6cb1-4131-93e9-76d6bfac5ff5 tempest-AttachVolumeTestJSON-612710564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:29:04 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-335c2ab7-6cb1-4131-93e9-76d6bfac5ff5 tempest-AttachVolumeTestJSON-612710564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:29:04 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-335c2ab7-6cb1-4131-93e9-76d6bfac5ff5 tempest-AttachVolumeTestJSON-612710564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:29:04 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-335c2ab7-6cb1-4131-93e9-76d6bfac5ff5 tempest-AttachVolumeTestJSON-612710564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:29:04 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-335c2ab7-6cb1-4131-93e9-76d6bfac5ff5 tempest-AttachVolumeTestJSON-612710564 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:29:04 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-335c2ab7-6cb1-4131-93e9-76d6bfac5ff5 tempest-AttachVolumeTestJSON-612710564 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:29:04 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-335c2ab7-6cb1-4131-93e9-76d6bfac5ff5 tempest-AttachVolumeTestJSON-612710564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-8c761e4c-eed8-4468-8770-ed1dc47b49e5 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:29:05 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-405efe05-19a4-48b8-8cc8-f335ea362838 tempest-VolumesSnapshotTestJSON-217259837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82ec50e0-0ff4-4c20-b413-49158189224a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25dd9ee9-7a59-4d0a-8f7f-baeeb4703303', 'volume_size': 2, 'snapshot_id': '1e5ab227-3ec1-44d0-afab-de138528edc3'}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:29:05 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-405efe05-19a4-48b8-8cc8-f335ea362838 tempest-VolumesSnapshotTestJSON-217259837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (902dc29c-a4d3-49ad-bae0-589d8d57b426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:29:05 devstack sudo[96036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-8c761e4c-eed8-4468-8770-ed1dc47b49e5 1073741824 Sep 28 09:29:05 devstack sudo[96036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:29:05 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-405efe05-19a4-48b8-8cc8-f335ea362838 tempest-VolumesSnapshotTestJSON-217259837 None] Volume volume-25dd9ee9-7a59-4d0a-8f7f-baeeb4703303 (25dd9ee9-7a59-4d0a-8f7f-baeeb4703303): created successfully Sep 28 09:29:05 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-405efe05-19a4-48b8-8cc8-f335ea362838 tempest-VolumesSnapshotTestJSON-217259837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (902dc29c-a4d3-49ad-bae0-589d8d57b426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:29:05 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-405efe05-19a4-48b8-8cc8-f335ea362838 tempest-VolumesSnapshotTestJSON-217259837 None] Flow 'volume_create_manager' (d8747830-35d3-4fe3-903d-fe60f3633e84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:29:05 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-405efe05-19a4-48b8-8cc8-f335ea362838 tempest-VolumesSnapshotTestJSON-217259837 None] Created volume successfully. Sep 28 09:29:05 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-4520163c-afd7-4c9f-86dc-ed45246158ff tempest-VolumesSnapshotTestJSON-217259837 None] Acquiring lock "cinder-25dd9ee9-7a59-4d0a-8f7f-baeeb4703303-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:29:05 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-4520163c-afd7-4c9f-86dc-ed45246158ff tempest-VolumesSnapshotTestJSON-217259837 None] Lock "cinder-25dd9ee9-7a59-4d0a-8f7f-baeeb4703303-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:29:05 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-4520163c-afd7-4c9f-86dc-ed45246158ff tempest-VolumesSnapshotTestJSON-217259837 None] Acquiring lock "cinder-quobyte-25dd9ee9-7a59-4d0a-8f7f-baeeb4703303" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:29:05 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-4520163c-afd7-4c9f-86dc-ed45246158ff tempest-VolumesSnapshotTestJSON-217259837 None] Lock "cinder-quobyte-25dd9ee9-7a59-4d0a-8f7f-baeeb4703303" acquired by "delete_volume" :: waited 0.018s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:29:05 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[17144048-0690-41d9-b8dc-50f50fd2d1a9]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:29:05 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-4520163c-afd7-4c9f-86dc-ed45246158ff tempest-VolumesSnapshotTestJSON-217259837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-25dd9ee9-7a59-4d0a-8f7f-baeeb4703303 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:29:05 devstack sudo[96071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-25dd9ee9-7a59-4d0a-8f7f-baeeb4703303 Sep 28 09:29:05 devstack sudo[96071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:29:05 devstack sudo[96036]: pam_unix(sudo:session): session closed for user root Sep 28 09:29:05 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-335c2ab7-6cb1-4131-93e9-76d6bfac5ff5 tempest-AttachVolumeTestJSON-612710564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-8c761e4c-eed8-4468-8770-ed1dc47b49e5 1073741824" returned: 0 in 0.977s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:29:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-335c2ab7-6cb1-4131-93e9-76d6bfac5ff5 tempest-AttachVolumeTestJSON-612710564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-8c761e4c-eed8-4468-8770-ed1dc47b49e5 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:29:06 devstack sudo[96080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-8c761e4c-eed8-4468-8770-ed1dc47b49e5 Sep 28 09:29:06 devstack sudo[96080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:29:06 devstack sudo[96071]: pam_unix(sudo:session): session closed for user root Sep 28 09:29:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-4520163c-afd7-4c9f-86dc-ed45246158ff tempest-VolumesSnapshotTestJSON-217259837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-25dd9ee9-7a59-4d0a-8f7f-baeeb4703303" returned: 0 in 0.562s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:29:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-4520163c-afd7-4c9f-86dc-ed45246158ff tempest-VolumesSnapshotTestJSON-217259837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-25dd9ee9-7a59-4d0a-8f7f-baeeb4703303 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:29:06 devstack sudo[96080]: pam_unix(sudo:session): session closed for user root Sep 28 09:29:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-335c2ab7-6cb1-4131-93e9-76d6bfac5ff5 tempest-AttachVolumeTestJSON-612710564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-8c761e4c-eed8-4468-8770-ed1dc47b49e5" returned: 0 in 0.380s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:29:06 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-335c2ab7-6cb1-4131-93e9-76d6bfac5ff5 tempest-AttachVolumeTestJSON-612710564 None] <== create_volume: return (1432ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:29:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-335c2ab7-6cb1-4131-93e9-76d6bfac5ff5 tempest-AttachVolumeTestJSON-612710564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.437s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:29:06 devstack sudo[96086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-25dd9ee9-7a59-4d0a-8f7f-baeeb4703303 Sep 28 09:29:06 devstack sudo[96086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:29:06 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-335c2ab7-6cb1-4131-93e9-76d6bfac5ff5 tempest-AttachVolumeTestJSON-612710564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1e7ebf5-fa64-4ef3-8802-fe7155b7d6f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c761e4c-eed8-4468-8770-ed1dc47b49e5', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:29:06 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-335c2ab7-6cb1-4131-93e9-76d6bfac5ff5 tempest-AttachVolumeTestJSON-612710564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abfd7162-2d70-4797-939a-6f22ed27eab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:29:06 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-335c2ab7-6cb1-4131-93e9-76d6bfac5ff5 tempest-AttachVolumeTestJSON-612710564 None] Volume volume-8c761e4c-eed8-4468-8770-ed1dc47b49e5 (8c761e4c-eed8-4468-8770-ed1dc47b49e5): created successfully Sep 28 09:29:06 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-335c2ab7-6cb1-4131-93e9-76d6bfac5ff5 tempest-AttachVolumeTestJSON-612710564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abfd7162-2d70-4797-939a-6f22ed27eab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:29:06 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-335c2ab7-6cb1-4131-93e9-76d6bfac5ff5 tempest-AttachVolumeTestJSON-612710564 None] Flow 'volume_create_manager' (ac6f43f4-518a-47b4-b85e-0282f7125cec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:29:06 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-335c2ab7-6cb1-4131-93e9-76d6bfac5ff5 tempest-AttachVolumeTestJSON-612710564 None] Created volume successfully. Sep 28 09:29:06 devstack sudo[96086]: pam_unix(sudo:session): session closed for user root Sep 28 09:29:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-4520163c-afd7-4c9f-86dc-ed45246158ff tempest-VolumesSnapshotTestJSON-217259837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-25dd9ee9-7a59-4d0a-8f7f-baeeb4703303" returned: 0 in 0.368s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:29:06 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-4520163c-afd7-4c9f-86dc-ed45246158ff tempest-VolumesSnapshotTestJSON-217259837 None] Lock "cinder-quobyte-25dd9ee9-7a59-4d0a-8f7f-baeeb4703303" released by "delete_volume" :: held 0.998s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:29:06 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-4520163c-afd7-4c9f-86dc-ed45246158ff tempest-VolumesSnapshotTestJSON-217259837 None] Created reservations ['eab9e932-f43c-4e20-80d8-c14d0756eb76', '2338943a-1e2f-4e59-9e7e-c81486505636', '7e7eccfc-9dc7-481d-907a-769bb2a1e422', '87b48008-042a-4858-9a97-595886fa0f75'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:29:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-4520163c-afd7-4c9f-86dc-ed45246158ff tempest-VolumesSnapshotTestJSON-217259837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:29:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-4520163c-afd7-4c9f-86dc-ed45246158ff tempest-VolumesSnapshotTestJSON-217259837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:29:06 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-4520163c-afd7-4c9f-86dc-ed45246158ff tempest-VolumesSnapshotTestJSON-217259837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:29:06 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-4520163c-afd7-4c9f-86dc-ed45246158ff tempest-VolumesSnapshotTestJSON-217259837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:29:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-4520163c-afd7-4c9f-86dc-ed45246158ff tempest-VolumesSnapshotTestJSON-217259837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:29:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-4520163c-afd7-4c9f-86dc-ed45246158ff tempest-VolumesSnapshotTestJSON-217259837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:29:06 devstack sudo[96090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:29:06 devstack sudo[96090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:29:07 devstack sudo[96090]: pam_unix(sudo:session): session closed for user root Sep 28 09:29:07 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-4520163c-afd7-4c9f-86dc-ed45246158ff tempest-VolumesSnapshotTestJSON-217259837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.487s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:29:07 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-4520163c-afd7-4c9f-86dc-ed45246158ff tempest-VolumesSnapshotTestJSON-217259837 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:29:07 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-4520163c-afd7-4c9f-86dc-ed45246158ff tempest-VolumesSnapshotTestJSON-217259837 None] Deleted volume successfully. Sep 28 09:29:07 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-4520163c-afd7-4c9f-86dc-ed45246158ff tempest-VolumesSnapshotTestJSON-217259837 None] Lock "cinder-25dd9ee9-7a59-4d0a-8f7f-baeeb4703303-delete_volume" released by "delete_volume" :: held 1.786s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:29:08 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-367d264c-2362-4dc0-9ea5-b92bb6d7db64 tempest-VolumesSnapshotTestJSON-217259837 None] Acquiring lock "cinder-1e5ab227-3ec1-44d0-afab-de138528edc3-delete_snapshot" by "delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:29:08 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-367d264c-2362-4dc0-9ea5-b92bb6d7db64 tempest-VolumesSnapshotTestJSON-217259837 None] Lock "cinder-1e5ab227-3ec1-44d0-afab-de138528edc3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.090s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:29:08 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-367d264c-2362-4dc0-9ea5-b92bb6d7db64 tempest-VolumesSnapshotTestJSON-217259837 None] Acquiring lock "cinder-quobyte-dc0f442e-1825-42ae-b546-bec64d63bebe" by "delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:29:08 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-367d264c-2362-4dc0-9ea5-b92bb6d7db64 tempest-VolumesSnapshotTestJSON-217259837 None] Lock "cinder-quobyte-dc0f442e-1825-42ae-b546-bec64d63bebe" acquired by "delete_snapshot" :: waited 0.056s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:29:08 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-367d264c-2362-4dc0-9ea5-b92bb6d7db64 tempest-VolumesSnapshotTestJSON-217259837 None] Acquiring lock "cinder-quobyte-1e5ab227-3ec1-44d0-afab-de138528edc3" by "_delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:29:08 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-367d264c-2362-4dc0-9ea5-b92bb6d7db64 tempest-VolumesSnapshotTestJSON-217259837 None] Lock "cinder-quobyte-1e5ab227-3ec1-44d0-afab-de138528edc3" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:29:08 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-367d264c-2362-4dc0-9ea5-b92bb6d7db64 tempest-VolumesSnapshotTestJSON-217259837 None] Deleting offline snapshot 1e5ab227-3ec1-44d0-afab-de138528edc3 of volume dc0f442e-1825-42ae-b546-bec64d63bebe {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 09:29:08 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-367d264c-2362-4dc0-9ea5-b92bb6d7db64 tempest-VolumesSnapshotTestJSON-217259837 None] snapshot_file for this snap is: volume-dc0f442e-1825-42ae-b546-bec64d63bebe.1e5ab227-3ec1-44d0-afab-de138528edc3 {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 09:29:08 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b12788b-1c0b-4609-89c1-1bbff7f277de]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:29:08 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-367d264c-2362-4dc0-9ea5-b92bb6d7db64 tempest-VolumesSnapshotTestJSON-217259837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-dc0f442e-1825-42ae-b546-bec64d63bebe.1e5ab227-3ec1-44d0-afab-de138528edc3 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:29:08 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-3f3f0447-ab55-4a9a-955d-a08bb0e7761a req-9aa7c7de-8585-4c48-a4ec-b7451550508d tempest-AttachVolumeTestJSON-612710564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:29:08 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-3f3f0447-ab55-4a9a-955d-a08bb0e7761a req-9aa7c7de-8585-4c48-a4ec-b7451550508d tempest-AttachVolumeTestJSON-612710564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.007s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:29:09 devstack sudo[96131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-dc0f442e-1825-42ae-b546-bec64d63bebe.1e5ab227-3ec1-44d0-afab-de138528edc3 Sep 28 09:29:09 devstack sudo[96131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:29:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-3f3f0447-ab55-4a9a-955d-a08bb0e7761a req-9aa7c7de-8585-4c48-a4ec-b7451550508d tempest-AttachVolumeTestJSON-612710564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.059s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:29:09 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [req-3f3f0447-ab55-4a9a-955d-a08bb0e7761a req-9aa7c7de-8585-4c48-a4ec-b7451550508d tempest-AttachVolumeTestJSON-612710564 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d', 'name': 'volume-8c761e4c-eed8-4468-8770-ed1dc47b49e5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4ea7b03e-8cfe-4127-a76b-d78ec99a39d1', 'enforce_multipath': True} {{(pid=86553) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 09:29:09 devstack cinder-volume[86553]: INFO cinder.volume.manager [req-3f3f0447-ab55-4a9a-955d-a08bb0e7761a req-9aa7c7de-8585-4c48-a4ec-b7451550508d tempest-AttachVolumeTestJSON-612710564 None] attachment_update completed successfully. Sep 28 09:29:09 devstack sudo[96131]: pam_unix(sudo:session): session closed for user root Sep 28 09:29:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-367d264c-2362-4dc0-9ea5-b92bb6d7db64 tempest-VolumesSnapshotTestJSON-217259837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-dc0f442e-1825-42ae-b546-bec64d63bebe.1e5ab227-3ec1-44d0-afab-de138528edc3" returned: 0 in 0.998s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:29:09 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-367d264c-2362-4dc0-9ea5-b92bb6d7db64 tempest-VolumesSnapshotTestJSON-217259837 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dc0f442e-1825-42ae-b546-bec64d63bebe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86553) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 09:29:09 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b2e774c-5f2d-4d8e-bcac-807b51daaf08]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:29:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-367d264c-2362-4dc0-9ea5-b92bb6d7db64 tempest-VolumesSnapshotTestJSON-217259837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-dc0f442e-1825-42ae-b546-bec64d63bebe {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:29:10 devstack sudo[96185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-dc0f442e-1825-42ae-b546-bec64d63bebe Sep 28 09:29:10 devstack sudo[96185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:29:10 devstack sudo[96185]: pam_unix(sudo:session): session closed for user root Sep 28 09:29:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-367d264c-2362-4dc0-9ea5-b92bb6d7db64 tempest-VolumesSnapshotTestJSON-217259837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-dc0f442e-1825-42ae-b546-bec64d63bebe" returned: 0 in 1.092s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:29:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-367d264c-2362-4dc0-9ea5-b92bb6d7db64 tempest-VolumesSnapshotTestJSON-217259837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-dc0f442e-1825-42ae-b546-bec64d63bebe.1e5ab227-3ec1-44d0-afab-de138528edc3 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:29:10 devstack sudo[96610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-dc0f442e-1825-42ae-b546-bec64d63bebe.1e5ab227-3ec1-44d0-afab-de138528edc3 Sep 28 09:29:10 devstack sudo[96610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:29:11 devstack sudo[96610]: pam_unix(sudo:session): session closed for user root Sep 28 09:29:11 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-367d264c-2362-4dc0-9ea5-b92bb6d7db64 tempest-VolumesSnapshotTestJSON-217259837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-dc0f442e-1825-42ae-b546-bec64d63bebe.1e5ab227-3ec1-44d0-afab-de138528edc3" returned: 0 in 0.491s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:29:11 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-367d264c-2362-4dc0-9ea5-b92bb6d7db64 tempest-VolumesSnapshotTestJSON-217259837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-dc0f442e-1825-42ae-b546-bec64d63bebe.1e5ab227-3ec1-44d0-afab-de138528edc3 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:29:11 devstack sudo[96615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-dc0f442e-1825-42ae-b546-bec64d63bebe.1e5ab227-3ec1-44d0-afab-de138528edc3 Sep 28 09:29:11 devstack sudo[96615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:29:11 devstack sudo[96615]: pam_unix(sudo:session): session closed for user root Sep 28 09:29:11 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-367d264c-2362-4dc0-9ea5-b92bb6d7db64 tempest-VolumesSnapshotTestJSON-217259837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-dc0f442e-1825-42ae-b546-bec64d63bebe.1e5ab227-3ec1-44d0-afab-de138528edc3" returned: 0 in 0.508s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:29:11 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-367d264c-2362-4dc0-9ea5-b92bb6d7db64 tempest-VolumesSnapshotTestJSON-217259837 None] Lock "cinder-quobyte-1e5ab227-3ec1-44d0-afab-de138528edc3" released by "_delete_snapshot" :: held 3.369s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:29:11 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-367d264c-2362-4dc0-9ea5-b92bb6d7db64 tempest-VolumesSnapshotTestJSON-217259837 None] Lock "cinder-quobyte-dc0f442e-1825-42ae-b546-bec64d63bebe" released by "delete_snapshot" :: held 3.435s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:29:12 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-367d264c-2362-4dc0-9ea5-b92bb6d7db64 tempest-VolumesSnapshotTestJSON-217259837 None] Created reservations ['21aae9cc-b5f3-448a-92e7-9e857efa2a27', '21c7d413-1468-4c73-b4b7-cf1f1cf3e7f1', '980334a9-8fff-4488-9349-e50d9140014a', 'c01cc5b2-65bb-46cb-b74a-5f84fdf272b0'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:29:12 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-367d264c-2362-4dc0-9ea5-b92bb6d7db64 tempest-VolumesSnapshotTestJSON-217259837 None] Delete snapshot completed successfully. Sep 28 09:29:12 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-367d264c-2362-4dc0-9ea5-b92bb6d7db64 tempest-VolumesSnapshotTestJSON-217259837 None] Lock "cinder-1e5ab227-3ec1-44d0-afab-de138528edc3-delete_snapshot" released by "delete_snapshot" :: held 3.748s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:29:12 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa28ee8c-870c-42bc-937a-44c86c4c4b39 tempest-AttachVolumeTestJSON-612710564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:29:12 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-aa28ee8c-870c-42bc-937a-44c86c4c4b39 tempest-AttachVolumeTestJSON-612710564 None] Flow 'volume_create_manager' (64817a0a-93b6-4d6e-99f0-8d9a7f0f17d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:29:12 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-aa28ee8c-870c-42bc-937a-44c86c4c4b39 tempest-AttachVolumeTestJSON-612710564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4deb18d1-763a-429c-9b3b-8ab0f799f07f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:29:12 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-aa28ee8c-870c-42bc-937a-44c86c4c4b39 tempest-AttachVolumeTestJSON-612710564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4deb18d1-763a-429c-9b3b-8ab0f799f07f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:29:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1632288085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b21496f-2e2c-480a-bcfe-1b740d400627,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bb70789f7694e3c98616e64328affc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:29:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:29:13Z,use_quota=True,user_id='247feee458a1454896a7c550b17f684d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:29:12 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-aa28ee8c-870c-42bc-937a-44c86c4c4b39 tempest-AttachVolumeTestJSON-612710564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b72d31fe-dc44-4e07-9804-068ba30e90ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:29:12 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-aa28ee8c-870c-42bc-937a-44c86c4c4b39 tempest-AttachVolumeTestJSON-612710564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b72d31fe-dc44-4e07-9804-068ba30e90ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:29:12 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-aa28ee8c-870c-42bc-937a-44c86c4c4b39 tempest-AttachVolumeTestJSON-612710564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4600b4ca-4ce8-4b9b-b174-1e8dd4e33bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:29:12 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-aa28ee8c-870c-42bc-937a-44c86c4c4b39 tempest-AttachVolumeTestJSON-612710564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4600b4ca-4ce8-4b9b-b174-1e8dd4e33bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b21496f-2e2c-480a-bcfe-1b740d400627', 'volume_name': 'volume-2b21496f-2e2c-480a-bcfe-1b740d400627', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:29:12 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-aa28ee8c-870c-42bc-937a-44c86c4c4b39 tempest-AttachVolumeTestJSON-612710564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (545d46f2-7da7-4655-8030-00011bd47c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:29:12 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-aa28ee8c-870c-42bc-937a-44c86c4c4b39 tempest-AttachVolumeTestJSON-612710564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (545d46f2-7da7-4655-8030-00011bd47c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:29:12 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-aa28ee8c-870c-42bc-937a-44c86c4c4b39 tempest-AttachVolumeTestJSON-612710564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a319d98-d670-4b6d-82df-69b7e3f742ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:29:12 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-aa28ee8c-870c-42bc-937a-44c86c4c4b39 tempest-AttachVolumeTestJSON-612710564 None] Volume 2b21496f-2e2c-480a-bcfe-1b740d400627: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b21496f-2e2c-480a-bcfe-1b740d400627', 'volume_size': 1} Sep 28 09:29:12 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-aa28ee8c-870c-42bc-937a-44c86c4c4b39 tempest-AttachVolumeTestJSON-612710564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:29:12 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-aa28ee8c-870c-42bc-937a-44c86c4c4b39 tempest-AttachVolumeTestJSON-612710564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:29:12 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-aa28ee8c-870c-42bc-937a-44c86c4c4b39 tempest-AttachVolumeTestJSON-612710564 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:29:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1632288085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b21496f-2e2c-480a-bcfe-1b740d400627,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bb70789f7694e3c98616e64328affc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:29:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:29:13Z,use_quota=True,user_id='247feee458a1454896a7c550b17f684d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:29:12 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-aa28ee8c-870c-42bc-937a-44c86c4c4b39 tempest-AttachVolumeTestJSON-612710564 None] Creating volume 2b21496f-2e2c-480a-bcfe-1b740d400627 {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:29:12 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-aa28ee8c-870c-42bc-937a-44c86c4c4b39 tempest-AttachVolumeTestJSON-612710564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:29:12 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-aa28ee8c-870c-42bc-937a-44c86c4c4b39 tempest-AttachVolumeTestJSON-612710564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:29:12 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-aa28ee8c-870c-42bc-937a-44c86c4c4b39 tempest-AttachVolumeTestJSON-612710564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:29:12 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-aa28ee8c-870c-42bc-937a-44c86c4c4b39 tempest-AttachVolumeTestJSON-612710564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:29:12 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-aa28ee8c-870c-42bc-937a-44c86c4c4b39 tempest-AttachVolumeTestJSON-612710564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:29:12 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-aa28ee8c-870c-42bc-937a-44c86c4c4b39 tempest-AttachVolumeTestJSON-612710564 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:29:12 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-aa28ee8c-870c-42bc-937a-44c86c4c4b39 tempest-AttachVolumeTestJSON-612710564 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:29:12 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-aa28ee8c-870c-42bc-937a-44c86c4c4b39 tempest-AttachVolumeTestJSON-612710564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-2b21496f-2e2c-480a-bcfe-1b740d400627 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:29:12 devstack sudo[96620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-2b21496f-2e2c-480a-bcfe-1b740d400627 1073741824 Sep 28 09:29:12 devstack sudo[96620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:29:12 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-c710fb62-b594-434d-ad69-e3f98f8af1dd tempest-VolumesSnapshotTestJSON-217259837 None] Acquiring lock "cinder-dc0f442e-1825-42ae-b546-bec64d63bebe-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:29:13 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-c710fb62-b594-434d-ad69-e3f98f8af1dd tempest-VolumesSnapshotTestJSON-217259837 None] Lock "cinder-dc0f442e-1825-42ae-b546-bec64d63bebe-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:29:13 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-c710fb62-b594-434d-ad69-e3f98f8af1dd tempest-VolumesSnapshotTestJSON-217259837 None] Acquiring lock "cinder-quobyte-dc0f442e-1825-42ae-b546-bec64d63bebe" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:29:13 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-c710fb62-b594-434d-ad69-e3f98f8af1dd tempest-VolumesSnapshotTestJSON-217259837 None] Lock "cinder-quobyte-dc0f442e-1825-42ae-b546-bec64d63bebe" acquired by "delete_volume" :: waited 0.026s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:29:13 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc4e387-9c53-4d11-a1fb-3ce3b03ffc50]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:29:13 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c710fb62-b594-434d-ad69-e3f98f8af1dd tempest-VolumesSnapshotTestJSON-217259837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-dc0f442e-1825-42ae-b546-bec64d63bebe {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:29:13 devstack sudo[96624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-dc0f442e-1825-42ae-b546-bec64d63bebe Sep 28 09:29:13 devstack sudo[96624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:29:13 devstack sudo[96620]: pam_unix(sudo:session): session closed for user root Sep 28 09:29:13 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-aa28ee8c-870c-42bc-937a-44c86c4c4b39 tempest-AttachVolumeTestJSON-612710564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-2b21496f-2e2c-480a-bcfe-1b740d400627 1073741824" returned: 0 in 0.639s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:29:13 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-aa28ee8c-870c-42bc-937a-44c86c4c4b39 tempest-AttachVolumeTestJSON-612710564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-2b21496f-2e2c-480a-bcfe-1b740d400627 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:29:13 devstack sudo[96628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-2b21496f-2e2c-480a-bcfe-1b740d400627 Sep 28 09:29:13 devstack sudo[96628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:29:13 devstack sudo[96624]: pam_unix(sudo:session): session closed for user root Sep 28 09:29:13 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c710fb62-b594-434d-ad69-e3f98f8af1dd tempest-VolumesSnapshotTestJSON-217259837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-dc0f442e-1825-42ae-b546-bec64d63bebe" returned: 0 in 0.676s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:29:13 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c710fb62-b594-434d-ad69-e3f98f8af1dd tempest-VolumesSnapshotTestJSON-217259837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-dc0f442e-1825-42ae-b546-bec64d63bebe {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:29:13 devstack sudo[96633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-dc0f442e-1825-42ae-b546-bec64d63bebe Sep 28 09:29:13 devstack sudo[96633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:29:14 devstack sudo[96628]: pam_unix(sudo:session): session closed for user root Sep 28 09:29:14 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-aa28ee8c-870c-42bc-937a-44c86c4c4b39 tempest-AttachVolumeTestJSON-612710564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-2b21496f-2e2c-480a-bcfe-1b740d400627" returned: 0 in 0.570s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:29:14 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-aa28ee8c-870c-42bc-937a-44c86c4c4b39 tempest-AttachVolumeTestJSON-612710564 None] <== create_volume: return (1282ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:29:14 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-aa28ee8c-870c-42bc-937a-44c86c4c4b39 tempest-AttachVolumeTestJSON-612710564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.289s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:29:14 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-aa28ee8c-870c-42bc-937a-44c86c4c4b39 tempest-AttachVolumeTestJSON-612710564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a319d98-d670-4b6d-82df-69b7e3f742ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b21496f-2e2c-480a-bcfe-1b740d400627', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:29:14 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-aa28ee8c-870c-42bc-937a-44c86c4c4b39 tempest-AttachVolumeTestJSON-612710564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3590abfa-0c3a-4727-940c-1e49dd2106cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:29:14 devstack sudo[96633]: pam_unix(sudo:session): session closed for user root Sep 28 09:29:14 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c710fb62-b594-434d-ad69-e3f98f8af1dd tempest-VolumesSnapshotTestJSON-217259837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-dc0f442e-1825-42ae-b546-bec64d63bebe" returned: 0 in 0.386s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:29:14 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-aa28ee8c-870c-42bc-937a-44c86c4c4b39 tempest-AttachVolumeTestJSON-612710564 None] Volume volume-2b21496f-2e2c-480a-bcfe-1b740d400627 (2b21496f-2e2c-480a-bcfe-1b740d400627): created successfully Sep 28 09:29:14 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-aa28ee8c-870c-42bc-937a-44c86c4c4b39 tempest-AttachVolumeTestJSON-612710564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3590abfa-0c3a-4727-940c-1e49dd2106cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:29:14 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-aa28ee8c-870c-42bc-937a-44c86c4c4b39 tempest-AttachVolumeTestJSON-612710564 None] Flow 'volume_create_manager' (64817a0a-93b6-4d6e-99f0-8d9a7f0f17d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:29:14 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-c710fb62-b594-434d-ad69-e3f98f8af1dd tempest-VolumesSnapshotTestJSON-217259837 None] Lock "cinder-quobyte-dc0f442e-1825-42ae-b546-bec64d63bebe" released by "delete_volume" :: held 1.207s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:29:14 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-aa28ee8c-870c-42bc-937a-44c86c4c4b39 tempest-AttachVolumeTestJSON-612710564 None] Created volume successfully. Sep 28 09:29:14 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-c710fb62-b594-434d-ad69-e3f98f8af1dd tempest-VolumesSnapshotTestJSON-217259837 None] Created reservations ['56d25966-3913-43be-a3af-d34a1b22bd0a', '50a873d7-703f-4699-b383-1e433fb4dd77', 'ca8d06bf-7371-438a-ae74-c9c99faea99c', '5cb9b233-1998-496b-8610-8f212017f012'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:29:14 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-c710fb62-b594-434d-ad69-e3f98f8af1dd tempest-VolumesSnapshotTestJSON-217259837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:29:14 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-c710fb62-b594-434d-ad69-e3f98f8af1dd tempest-VolumesSnapshotTestJSON-217259837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:29:14 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-c710fb62-b594-434d-ad69-e3f98f8af1dd tempest-VolumesSnapshotTestJSON-217259837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:29:14 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-c710fb62-b594-434d-ad69-e3f98f8af1dd tempest-VolumesSnapshotTestJSON-217259837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:29:14 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-c710fb62-b594-434d-ad69-e3f98f8af1dd tempest-VolumesSnapshotTestJSON-217259837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:29:14 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c710fb62-b594-434d-ad69-e3f98f8af1dd tempest-VolumesSnapshotTestJSON-217259837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:29:14 devstack sudo[96671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:29:14 devstack sudo[96671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:29:15 devstack sudo[96671]: pam_unix(sudo:session): session closed for user root Sep 28 09:29:15 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c710fb62-b594-434d-ad69-e3f98f8af1dd tempest-VolumesSnapshotTestJSON-217259837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.373s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:29:15 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-c710fb62-b594-434d-ad69-e3f98f8af1dd tempest-VolumesSnapshotTestJSON-217259837 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:29:15 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-c710fb62-b594-434d-ad69-e3f98f8af1dd tempest-VolumesSnapshotTestJSON-217259837 None] Deleted volume successfully. Sep 28 09:29:15 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-c710fb62-b594-434d-ad69-e3f98f8af1dd tempest-VolumesSnapshotTestJSON-217259837 None] Lock "cinder-dc0f442e-1825-42ae-b546-bec64d63bebe-delete_volume" released by "delete_volume" :: held 2.133s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:29:16 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb82abe9-182d-4cf4-bcb5-b6cdf7c82aa6 tempest-VolumesSnapshotTestJSON-217259837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:29:16 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-cb82abe9-182d-4cf4-bcb5-b6cdf7c82aa6 tempest-VolumesSnapshotTestJSON-217259837 None] Flow 'volume_create_manager' (2d0130d2-2f07-4ce9-9e03-76d958c1ca67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:29:16 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-cb82abe9-182d-4cf4-bcb5-b6cdf7c82aa6 tempest-VolumesSnapshotTestJSON-217259837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (771ef872-a4c7-4ea1-8f87-52bc40f35c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:29:16 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-cb82abe9-182d-4cf4-bcb5-b6cdf7c82aa6 tempest-VolumesSnapshotTestJSON-217259837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (771ef872-a4c7-4ea1-8f87-52bc40f35c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:29:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1620725200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ee24eab-2437-42a1-8ad9-59e1696119f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bbcf34b7f064aea995bcb5be8a2c1d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:29:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:29:16Z,use_quota=True,user_id='cc1d0bb36b3f4787bb419c14842829ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:29:16 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-cb82abe9-182d-4cf4-bcb5-b6cdf7c82aa6 tempest-VolumesSnapshotTestJSON-217259837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f8ba241-51fb-441e-9fb2-5ea9cc2da631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:29:16 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-cb82abe9-182d-4cf4-bcb5-b6cdf7c82aa6 tempest-VolumesSnapshotTestJSON-217259837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f8ba241-51fb-441e-9fb2-5ea9cc2da631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:29:16 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-cb82abe9-182d-4cf4-bcb5-b6cdf7c82aa6 tempest-VolumesSnapshotTestJSON-217259837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37e2d775-2ae7-4f91-a524-5088ac057433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:29:16 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-cb82abe9-182d-4cf4-bcb5-b6cdf7c82aa6 tempest-VolumesSnapshotTestJSON-217259837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37e2d775-2ae7-4f91-a524-5088ac057433) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ee24eab-2437-42a1-8ad9-59e1696119f3', 'volume_name': 'volume-6ee24eab-2437-42a1-8ad9-59e1696119f3', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:29:16 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-cb82abe9-182d-4cf4-bcb5-b6cdf7c82aa6 tempest-VolumesSnapshotTestJSON-217259837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e988b3a8-4772-44d5-9b9b-425c61a205d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:29:16 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-cb82abe9-182d-4cf4-bcb5-b6cdf7c82aa6 tempest-VolumesSnapshotTestJSON-217259837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e988b3a8-4772-44d5-9b9b-425c61a205d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:29:16 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-cb82abe9-182d-4cf4-bcb5-b6cdf7c82aa6 tempest-VolumesSnapshotTestJSON-217259837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1211226-f0e5-494a-913f-cb2ed61cbd77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:29:16 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-cb82abe9-182d-4cf4-bcb5-b6cdf7c82aa6 tempest-VolumesSnapshotTestJSON-217259837 None] Volume 6ee24eab-2437-42a1-8ad9-59e1696119f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ee24eab-2437-42a1-8ad9-59e1696119f3', 'volume_size': 1} Sep 28 09:29:16 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-cb82abe9-182d-4cf4-bcb5-b6cdf7c82aa6 tempest-VolumesSnapshotTestJSON-217259837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:29:16 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-cb82abe9-182d-4cf4-bcb5-b6cdf7c82aa6 tempest-VolumesSnapshotTestJSON-217259837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:29:16 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-cb82abe9-182d-4cf4-bcb5-b6cdf7c82aa6 tempest-VolumesSnapshotTestJSON-217259837 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:29:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1620725200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ee24eab-2437-42a1-8ad9-59e1696119f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bbcf34b7f064aea995bcb5be8a2c1d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:29:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:29:16Z,use_quota=True,user_id='cc1d0bb36b3f4787bb419c14842829ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:29:16 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-cb82abe9-182d-4cf4-bcb5-b6cdf7c82aa6 tempest-VolumesSnapshotTestJSON-217259837 None] Creating volume 6ee24eab-2437-42a1-8ad9-59e1696119f3 {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:29:16 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-cb82abe9-182d-4cf4-bcb5-b6cdf7c82aa6 tempest-VolumesSnapshotTestJSON-217259837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:29:16 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-cb82abe9-182d-4cf4-bcb5-b6cdf7c82aa6 tempest-VolumesSnapshotTestJSON-217259837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:29:16 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-cb82abe9-182d-4cf4-bcb5-b6cdf7c82aa6 tempest-VolumesSnapshotTestJSON-217259837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:29:16 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-cb82abe9-182d-4cf4-bcb5-b6cdf7c82aa6 tempest-VolumesSnapshotTestJSON-217259837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:29:16 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-cb82abe9-182d-4cf4-bcb5-b6cdf7c82aa6 tempest-VolumesSnapshotTestJSON-217259837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:29:16 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-cb82abe9-182d-4cf4-bcb5-b6cdf7c82aa6 tempest-VolumesSnapshotTestJSON-217259837 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:29:16 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-cb82abe9-182d-4cf4-bcb5-b6cdf7c82aa6 tempest-VolumesSnapshotTestJSON-217259837 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:29:16 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-cb82abe9-182d-4cf4-bcb5-b6cdf7c82aa6 tempest-VolumesSnapshotTestJSON-217259837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6ee24eab-2437-42a1-8ad9-59e1696119f3 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:29:16 devstack sudo[96689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6ee24eab-2437-42a1-8ad9-59e1696119f3 1073741824 Sep 28 09:29:16 devstack sudo[96689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:29:16 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-4db70918-b82c-4f50-8934-da489aa7a820 req-844d8644-fe1f-484d-86e7-e8fa063d4a66 tempest-AttachVolumeTestJSON-612710564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:29:17 devstack sudo[96689]: pam_unix(sudo:session): session closed for user root Sep 28 09:29:17 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-cb82abe9-182d-4cf4-bcb5-b6cdf7c82aa6 tempest-VolumesSnapshotTestJSON-217259837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6ee24eab-2437-42a1-8ad9-59e1696119f3 1073741824" returned: 0 in 0.470s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:29:17 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-cb82abe9-182d-4cf4-bcb5-b6cdf7c82aa6 tempest-VolumesSnapshotTestJSON-217259837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6ee24eab-2437-42a1-8ad9-59e1696119f3 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:29:17 devstack sudo[96695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6ee24eab-2437-42a1-8ad9-59e1696119f3 Sep 28 09:29:17 devstack sudo[96695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:29:17 devstack sudo[96695]: pam_unix(sudo:session): session closed for user root Sep 28 09:29:17 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-cb82abe9-182d-4cf4-bcb5-b6cdf7c82aa6 tempest-VolumesSnapshotTestJSON-217259837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6ee24eab-2437-42a1-8ad9-59e1696119f3" returned: 0 in 0.255s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:29:17 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-cb82abe9-182d-4cf4-bcb5-b6cdf7c82aa6 tempest-VolumesSnapshotTestJSON-217259837 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:29:17 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-cb82abe9-182d-4cf4-bcb5-b6cdf7c82aa6 tempest-VolumesSnapshotTestJSON-217259837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:29:17 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-4db70918-b82c-4f50-8934-da489aa7a820 req-844d8644-fe1f-484d-86e7-e8fa063d4a66 tempest-AttachVolumeTestJSON-612710564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.704s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:29:17 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-4db70918-b82c-4f50-8934-da489aa7a820 req-844d8644-fe1f-484d-86e7-e8fa063d4a66 tempest-AttachVolumeTestJSON-612710564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:29:17 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-cb82abe9-182d-4cf4-bcb5-b6cdf7c82aa6 tempest-VolumesSnapshotTestJSON-217259837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1211226-f0e5-494a-913f-cb2ed61cbd77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ee24eab-2437-42a1-8ad9-59e1696119f3', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:29:17 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-cb82abe9-182d-4cf4-bcb5-b6cdf7c82aa6 tempest-VolumesSnapshotTestJSON-217259837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a29738de-226e-4546-8f0a-d1ffaa400fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:29:17 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-cb82abe9-182d-4cf4-bcb5-b6cdf7c82aa6 tempest-VolumesSnapshotTestJSON-217259837 None] Volume volume-6ee24eab-2437-42a1-8ad9-59e1696119f3 (6ee24eab-2437-42a1-8ad9-59e1696119f3): created successfully Sep 28 09:29:17 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-cb82abe9-182d-4cf4-bcb5-b6cdf7c82aa6 tempest-VolumesSnapshotTestJSON-217259837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a29738de-226e-4546-8f0a-d1ffaa400fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:29:17 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-cb82abe9-182d-4cf4-bcb5-b6cdf7c82aa6 tempest-VolumesSnapshotTestJSON-217259837 None] Flow 'volume_create_manager' (2d0130d2-2f07-4ce9-9e03-76d958c1ca67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:29:17 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-cb82abe9-182d-4cf4-bcb5-b6cdf7c82aa6 tempest-VolumesSnapshotTestJSON-217259837 None] Created volume successfully. Sep 28 09:29:17 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [req-4db70918-b82c-4f50-8934-da489aa7a820 req-844d8644-fe1f-484d-86e7-e8fa063d4a66 tempest-AttachVolumeTestJSON-612710564 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d', 'name': 'volume-2b21496f-2e2c-480a-bcfe-1b740d400627', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '844dbca1-e31d-4cdf-a005-1f14612d8e06', 'enforce_multipath': True} {{(pid=86553) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 09:29:17 devstack cinder-volume[86553]: INFO cinder.volume.manager [req-4db70918-b82c-4f50-8934-da489aa7a820 req-844d8644-fe1f-484d-86e7-e8fa063d4a66 tempest-AttachVolumeTestJSON-612710564 None] attachment_update completed successfully. Sep 28 09:29:18 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-6c75eae8-057b-4a5a-9eb9-f26a98bb93b2 tempest-VolumesSnapshotTestJSON-217259837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:29:18 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-6c75eae8-057b-4a5a-9eb9-f26a98bb93b2 tempest-VolumesSnapshotTestJSON-217259837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:29:18 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-6c75eae8-057b-4a5a-9eb9-f26a98bb93b2 tempest-VolumesSnapshotTestJSON-217259837 None] Creating offline snapshot e3c619b2-e097-4c53-94da-16b9a46e64dd of volume 6ee24eab-2437-42a1-8ad9-59e1696119f3 {{(pid=86553) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 09:29:18 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[63efe29b-00de-4b30-a431-e8d784d435e6]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:29:18 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-6c75eae8-057b-4a5a-9eb9-f26a98bb93b2 tempest-VolumesSnapshotTestJSON-217259837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6ee24eab-2437-42a1-8ad9-59e1696119f3 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:29:18 devstack sudo[96704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6ee24eab-2437-42a1-8ad9-59e1696119f3 Sep 28 09:29:18 devstack sudo[96704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:29:19 devstack sudo[96704]: pam_unix(sudo:session): session closed for user root Sep 28 09:29:19 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-6c75eae8-057b-4a5a-9eb9-f26a98bb93b2 tempest-VolumesSnapshotTestJSON-217259837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6ee24eab-2437-42a1-8ad9-59e1696119f3" returned: 0 in 0.385s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:29:19 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-6c75eae8-057b-4a5a-9eb9-f26a98bb93b2 tempest-VolumesSnapshotTestJSON-217259837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6ee24eab-2437-42a1-8ad9-59e1696119f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6ee24eab-2437-42a1-8ad9-59e1696119f3.e3c619b2-e097-4c53-94da-16b9a46e64dd 1G {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:29:19 devstack sudo[96710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6ee24eab-2437-42a1-8ad9-59e1696119f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6ee24eab-2437-42a1-8ad9-59e1696119f3.e3c619b2-e097-4c53-94da-16b9a46e64dd 1G Sep 28 09:29:19 devstack sudo[96710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:29:19 devstack sudo[96710]: pam_unix(sudo:session): session closed for user root Sep 28 09:29:19 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-6c75eae8-057b-4a5a-9eb9-f26a98bb93b2 tempest-VolumesSnapshotTestJSON-217259837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6ee24eab-2437-42a1-8ad9-59e1696119f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6ee24eab-2437-42a1-8ad9-59e1696119f3.e3c619b2-e097-4c53-94da-16b9a46e64dd 1G" returned: 0 in 0.483s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:29:19 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-6c75eae8-057b-4a5a-9eb9-f26a98bb93b2 tempest-VolumesSnapshotTestJSON-217259837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ee24eab-2437-42a1-8ad9-59e1696119f3 -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6ee24eab-2437-42a1-8ad9-59e1696119f3.e3c619b2-e097-4c53-94da-16b9a46e64dd {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:29:19 devstack sudo[96717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ee24eab-2437-42a1-8ad9-59e1696119f3 -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6ee24eab-2437-42a1-8ad9-59e1696119f3.e3c619b2-e097-4c53-94da-16b9a46e64dd Sep 28 09:29:19 devstack sudo[96717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:29:20 devstack sudo[96717]: pam_unix(sudo:session): session closed for user root Sep 28 09:29:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-6c75eae8-057b-4a5a-9eb9-f26a98bb93b2 tempest-VolumesSnapshotTestJSON-217259837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ee24eab-2437-42a1-8ad9-59e1696119f3 -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6ee24eab-2437-42a1-8ad9-59e1696119f3.e3c619b2-e097-4c53-94da-16b9a46e64dd" returned: 0 in 0.539s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:29:20 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-6c75eae8-057b-4a5a-9eb9-f26a98bb93b2 tempest-VolumesSnapshotTestJSON-217259837 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6ee24eab-2437-42a1-8ad9-59e1696119f3.e3c619b2-e097-4c53-94da-16b9a46e64dd is being set with open permissions: ugo+rw Sep 28 09:29:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-6c75eae8-057b-4a5a-9eb9-f26a98bb93b2 tempest-VolumesSnapshotTestJSON-217259837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6ee24eab-2437-42a1-8ad9-59e1696119f3.e3c619b2-e097-4c53-94da-16b9a46e64dd {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:29:20 devstack sudo[96727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6ee24eab-2437-42a1-8ad9-59e1696119f3.e3c619b2-e097-4c53-94da-16b9a46e64dd Sep 28 09:29:20 devstack sudo[96727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:29:20 devstack sudo[96727]: pam_unix(sudo:session): session closed for user root Sep 28 09:29:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-6c75eae8-057b-4a5a-9eb9-f26a98bb93b2 tempest-VolumesSnapshotTestJSON-217259837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6ee24eab-2437-42a1-8ad9-59e1696119f3.e3c619b2-e097-4c53-94da-16b9a46e64dd" returned: 0 in 0.482s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:29:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-6c75eae8-057b-4a5a-9eb9-f26a98bb93b2 tempest-VolumesSnapshotTestJSON-217259837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6ee24eab-2437-42a1-8ad9-59e1696119f3.info {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:29:20 devstack sudo[96752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6ee24eab-2437-42a1-8ad9-59e1696119f3.info Sep 28 09:29:20 devstack sudo[96752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:29:21 devstack sudo[96752]: pam_unix(sudo:session): session closed for user root Sep 28 09:29:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-6c75eae8-057b-4a5a-9eb9-f26a98bb93b2 tempest-VolumesSnapshotTestJSON-217259837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6ee24eab-2437-42a1-8ad9-59e1696119f3.info" returned: 0 in 0.472s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:29:21 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-6c75eae8-057b-4a5a-9eb9-f26a98bb93b2 tempest-VolumesSnapshotTestJSON-217259837 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6ee24eab-2437-42a1-8ad9-59e1696119f3.info is being set with open permissions: ugo+rw Sep 28 09:29:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-6c75eae8-057b-4a5a-9eb9-f26a98bb93b2 tempest-VolumesSnapshotTestJSON-217259837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6ee24eab-2437-42a1-8ad9-59e1696119f3.info {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:29:21 devstack sudo[96766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6ee24eab-2437-42a1-8ad9-59e1696119f3.info Sep 28 09:29:21 devstack sudo[96766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:29:21 devstack cinder-volume[86553]: INFO cinder.volume.manager [req-e33282a1-ca3c-4d1b-8d79-f39166039738 req-ecd9cb64-8d64-4b62-81e3-6065c0e9f7b7 tempest-AttachVolumeTestJSON-612710564 None] Terminate volume connection completed successfully. Sep 28 09:29:21 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [req-e33282a1-ca3c-4d1b-8d79-f39166039738 req-ecd9cb64-8d64-4b62-81e3-6065c0e9f7b7 tempest-AttachVolumeTestJSON-612710564 None] Deleting attachment 4ea7b03e-8cfe-4127-a76b-d78ec99a39d1. {{(pid=86553) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 09:29:21 devstack sudo[96766]: pam_unix(sudo:session): session closed for user root Sep 28 09:29:21 devstack cinder-volume[86553]: DEBUG oslo_service.periodic_task [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86553) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 09:29:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:29:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:29:21 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:29:21 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:29:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:29:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:29:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-6c75eae8-057b-4a5a-9eb9-f26a98bb93b2 tempest-VolumesSnapshotTestJSON-217259837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6ee24eab-2437-42a1-8ad9-59e1696119f3.info" returned: 0 in 0.371s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:29:21 devstack sudo[96773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:29:21 devstack sudo[96773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:29:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-6c75eae8-057b-4a5a-9eb9-f26a98bb93b2 tempest-VolumesSnapshotTestJSON-217259837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.890s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:29:21 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-6c75eae8-057b-4a5a-9eb9-f26a98bb93b2 tempest-VolumesSnapshotTestJSON-217259837 None] Create snapshot completed successfully Sep 28 09:29:21 devstack sudo[96773]: pam_unix(sudo:session): session closed for user root Sep 28 09:29:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.401s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:29:21 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:29:21 devstack cinder-volume[86553]: DEBUG oslo_service.periodic_task [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Running periodic task VolumeManager._thread_info {{(pid=86553) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 09:29:21 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] thread count: 28 {{(pid=86553) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 09:29:21 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] thread info: [<_MainThread(MainThread, started 134684877779072)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86553) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 09:29:22 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-aedd9598-8006-4885-a261-ebfe35eb0824 tempest-VolumesSnapshotTestJSON-217259837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:29:22 devstack cinder-volume[86553]: INFO cinder.volume.manager [req-e06cd79f-a512-4087-97dd-13376d52e89f req-fede72c3-2009-4165-b60c-4445bb20a0ff tempest-AttachVolumeTestJSON-612710564 None] Terminate volume connection completed successfully. Sep 28 09:29:22 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [req-e06cd79f-a512-4087-97dd-13376d52e89f req-fede72c3-2009-4165-b60c-4445bb20a0ff tempest-AttachVolumeTestJSON-612710564 None] Deleting attachment 844dbca1-e31d-4cdf-a005-1f14612d8e06. {{(pid=86553) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 09:29:22 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-aedd9598-8006-4885-a261-ebfe35eb0824 tempest-VolumesSnapshotTestJSON-217259837 None] Flow 'volume_create_manager' (934db8d5-4612-45e5-a0bf-efc9a7bac23f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:29:22 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-aedd9598-8006-4885-a261-ebfe35eb0824 tempest-VolumesSnapshotTestJSON-217259837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4e864d9-2526-4408-a2e3-bcace0785649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:29:22 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-aedd9598-8006-4885-a261-ebfe35eb0824 tempest-VolumesSnapshotTestJSON-217259837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4e864d9-2526-4408-a2e3-bcace0785649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:29:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1352668474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02e3058f-441c-4816-835c-b703dbb26ec4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bbcf34b7f064aea995bcb5be8a2c1d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:29:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e3c619b2-e097-4c53-94da-16b9a46e64dd,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:29:23Z,use_quota=True,user_id='cc1d0bb36b3f4787bb419c14842829ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:29:22 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-aedd9598-8006-4885-a261-ebfe35eb0824 tempest-VolumesSnapshotTestJSON-217259837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ead2818-0007-4f19-b5b7-c50b14cfbcda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:29:22 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-aedd9598-8006-4885-a261-ebfe35eb0824 tempest-VolumesSnapshotTestJSON-217259837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ead2818-0007-4f19-b5b7-c50b14cfbcda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:29:22 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-aedd9598-8006-4885-a261-ebfe35eb0824 tempest-VolumesSnapshotTestJSON-217259837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfc7bf6e-00da-4aed-a7ac-492bf60a0c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:29:22 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-aedd9598-8006-4885-a261-ebfe35eb0824 tempest-VolumesSnapshotTestJSON-217259837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfc7bf6e-00da-4aed-a7ac-492bf60a0c25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '02e3058f-441c-4816-835c-b703dbb26ec4', 'volume_name': 'volume-02e3058f-441c-4816-835c-b703dbb26ec4', 'volume_size': 1, 'snapshot_id': 'e3c619b2-e097-4c53-94da-16b9a46e64dd'}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:29:22 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-aedd9598-8006-4885-a261-ebfe35eb0824 tempest-VolumesSnapshotTestJSON-217259837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d4cdcae-8aeb-43fc-8d1c-f721d7f7e080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:29:22 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-aedd9598-8006-4885-a261-ebfe35eb0824 tempest-VolumesSnapshotTestJSON-217259837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d4cdcae-8aeb-43fc-8d1c-f721d7f7e080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:29:22 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-aedd9598-8006-4885-a261-ebfe35eb0824 tempest-VolumesSnapshotTestJSON-217259837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (504dd7dc-1b07-4c3a-95f5-05c89a696a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:29:22 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-aedd9598-8006-4885-a261-ebfe35eb0824 tempest-VolumesSnapshotTestJSON-217259837 None] Volume 02e3058f-441c-4816-835c-b703dbb26ec4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-02e3058f-441c-4816-835c-b703dbb26ec4', 'volume_size': 1, 'snapshot_id': 'e3c619b2-e097-4c53-94da-16b9a46e64dd'} Sep 28 09:29:22 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-aedd9598-8006-4885-a261-ebfe35eb0824 tempest-VolumesSnapshotTestJSON-217259837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:29:22 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-aedd9598-8006-4885-a261-ebfe35eb0824 tempest-VolumesSnapshotTestJSON-217259837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:29:22 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-aedd9598-8006-4885-a261-ebfe35eb0824 tempest-VolumesSnapshotTestJSON-217259837 None] Acquiring lock "cinder-quobyte-e3c619b2-e097-4c53-94da-16b9a46e64dd-02e3058f-441c-4816-835c-b703dbb26ec4" by "_create_volume_from_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:29:22 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-aedd9598-8006-4885-a261-ebfe35eb0824 tempest-VolumesSnapshotTestJSON-217259837 None] Lock "cinder-quobyte-e3c619b2-e097-4c53-94da-16b9a46e64dd-02e3058f-441c-4816-835c-b703dbb26ec4" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:29:22 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-aedd9598-8006-4885-a261-ebfe35eb0824 tempest-VolumesSnapshotTestJSON-217259837 None] Creating volume 02e3058f-441c-4816-835c-b703dbb26ec4 from snapshot e3c619b2-e097-4c53-94da-16b9a46e64dd {{(pid=86553) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 09:29:22 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-aedd9598-8006-4885-a261-ebfe35eb0824 tempest-VolumesSnapshotTestJSON-217259837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:29:22 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-aedd9598-8006-4885-a261-ebfe35eb0824 tempest-VolumesSnapshotTestJSON-217259837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:29:22 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-aedd9598-8006-4885-a261-ebfe35eb0824 tempest-VolumesSnapshotTestJSON-217259837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:29:22 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-aedd9598-8006-4885-a261-ebfe35eb0824 tempest-VolumesSnapshotTestJSON-217259837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:29:22 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-aedd9598-8006-4885-a261-ebfe35eb0824 tempest-VolumesSnapshotTestJSON-217259837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:29:22 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-aedd9598-8006-4885-a261-ebfe35eb0824 tempest-VolumesSnapshotTestJSON-217259837 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:29:22 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-aedd9598-8006-4885-a261-ebfe35eb0824 tempest-VolumesSnapshotTestJSON-217259837 None] Acquiring lock "cinder-quobyte-02e3058f-441c-4816-835c-b703dbb26ec4" by "_copy_volume_from_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:29:22 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-aedd9598-8006-4885-a261-ebfe35eb0824 tempest-VolumesSnapshotTestJSON-217259837 None] Lock "cinder-quobyte-02e3058f-441c-4816-835c-b703dbb26ec4" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:29:22 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-aedd9598-8006-4885-a261-ebfe35eb0824 tempest-VolumesSnapshotTestJSON-217259837 None] snapshot: e3c619b2-e097-4c53-94da-16b9a46e64dd, volume: 02e3058f-441c-4816-835c-b703dbb26ec4, {{(pid=86553) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 09:29:22 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-aedd9598-8006-4885-a261-ebfe35eb0824 tempest-VolumesSnapshotTestJSON-217259837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:29:22 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-aedd9598-8006-4885-a261-ebfe35eb0824 tempest-VolumesSnapshotTestJSON-217259837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:29:22 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-aedd9598-8006-4885-a261-ebfe35eb0824 tempest-VolumesSnapshotTestJSON-217259837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:29:22 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-aedd9598-8006-4885-a261-ebfe35eb0824 tempest-VolumesSnapshotTestJSON-217259837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:29:22 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-aedd9598-8006-4885-a261-ebfe35eb0824 tempest-VolumesSnapshotTestJSON-217259837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:29:22 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb6b85a9-c4ba-4620-a550-d75e1666f7e6]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:29:22 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-aedd9598-8006-4885-a261-ebfe35eb0824 tempest-VolumesSnapshotTestJSON-217259837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6ee24eab-2437-42a1-8ad9-59e1696119f3.e3c619b2-e097-4c53-94da-16b9a46e64dd {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:29:23 devstack sudo[96806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6ee24eab-2437-42a1-8ad9-59e1696119f3.e3c619b2-e097-4c53-94da-16b9a46e64dd Sep 28 09:29:23 devstack sudo[96806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:29:23 devstack sudo[96806]: pam_unix(sudo:session): session closed for user root Sep 28 09:29:23 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-aedd9598-8006-4885-a261-ebfe35eb0824 tempest-VolumesSnapshotTestJSON-217259837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6ee24eab-2437-42a1-8ad9-59e1696119f3.e3c619b2-e097-4c53-94da-16b9a46e64dd" returned: 0 in 0.396s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:29:23 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-aedd9598-8006-4885-a261-ebfe35eb0824 tempest-VolumesSnapshotTestJSON-217259837 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ee24eab-2437-42a1-8ad9-59e1696119f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86553) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 09:29:23 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[95145790-62ce-425d-a17b-1ff910d56549]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:29:23 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-aedd9598-8006-4885-a261-ebfe35eb0824 tempest-VolumesSnapshotTestJSON-217259837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6ee24eab-2437-42a1-8ad9-59e1696119f3 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:29:23 devstack sudo[96811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6ee24eab-2437-42a1-8ad9-59e1696119f3 Sep 28 09:29:23 devstack sudo[96811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:29:23 devstack sudo[96811]: pam_unix(sudo:session): session closed for user root Sep 28 09:29:23 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-aedd9598-8006-4885-a261-ebfe35eb0824 tempest-VolumesSnapshotTestJSON-217259837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6ee24eab-2437-42a1-8ad9-59e1696119f3" returned: 0 in 0.506s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:29:23 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-aedd9598-8006-4885-a261-ebfe35eb0824 tempest-VolumesSnapshotTestJSON-217259837 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6ee24eab-2437-42a1-8ad9-59e1696119f3 {{(pid=86553) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 09:29:23 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-aedd9598-8006-4885-a261-ebfe35eb0824 tempest-VolumesSnapshotTestJSON-217259837 None] Creating direct copy from snapshot {{(pid=86553) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 09:29:23 devstack cinder-volume[86553]: DEBUG cinder.utils [None req-aedd9598-8006-4885-a261-ebfe35eb0824 tempest-VolumesSnapshotTestJSON-217259837 None] Path /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-02e3058f-441c-4816-835c-b703dbb26ec4 not found in is_blk_device check {{(pid=86553) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 09:29:23 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-aedd9598-8006-4885-a261-ebfe35eb0824 tempest-VolumesSnapshotTestJSON-217259837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6ee24eab-2437-42a1-8ad9-59e1696119f3 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-02e3058f-441c-4816-835c-b703dbb26ec4 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:29:23 devstack sudo[96817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6ee24eab-2437-42a1-8ad9-59e1696119f3 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-02e3058f-441c-4816-835c-b703dbb26ec4 Sep 28 09:29:23 devstack sudo[96817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:29:30 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-440699ce-c404-49bb-913e-b74348ce83ca tempest-AttachVolumeTestJSON-612710564 None] Acquiring lock "cinder-2b21496f-2e2c-480a-bcfe-1b740d400627-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:29:30 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-440699ce-c404-49bb-913e-b74348ce83ca tempest-AttachVolumeTestJSON-612710564 None] Lock "cinder-2b21496f-2e2c-480a-bcfe-1b740d400627-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:29:30 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-440699ce-c404-49bb-913e-b74348ce83ca tempest-AttachVolumeTestJSON-612710564 None] Acquiring lock "cinder-quobyte-2b21496f-2e2c-480a-bcfe-1b740d400627" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:29:30 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-440699ce-c404-49bb-913e-b74348ce83ca tempest-AttachVolumeTestJSON-612710564 None] Lock "cinder-quobyte-2b21496f-2e2c-480a-bcfe-1b740d400627" acquired by "delete_volume" :: waited 0.037s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:29:30 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9204615-236c-4f43-8ec1-daaf7065ead4]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:29:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-440699ce-c404-49bb-913e-b74348ce83ca tempest-AttachVolumeTestJSON-612710564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-2b21496f-2e2c-480a-bcfe-1b740d400627 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:29:30 devstack sudo[96881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-2b21496f-2e2c-480a-bcfe-1b740d400627 Sep 28 09:29:30 devstack sudo[96881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:29:31 devstack sudo[96881]: pam_unix(sudo:session): session closed for user root Sep 28 09:29:31 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-440699ce-c404-49bb-913e-b74348ce83ca tempest-AttachVolumeTestJSON-612710564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-2b21496f-2e2c-480a-bcfe-1b740d400627" returned: 0 in 0.811s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:29:31 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-440699ce-c404-49bb-913e-b74348ce83ca tempest-AttachVolumeTestJSON-612710564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-2b21496f-2e2c-480a-bcfe-1b740d400627 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:29:31 devstack sudo[96901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-2b21496f-2e2c-480a-bcfe-1b740d400627 Sep 28 09:29:31 devstack sudo[96901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:29:32 devstack sudo[96901]: pam_unix(sudo:session): session closed for user root Sep 28 09:29:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-440699ce-c404-49bb-913e-b74348ce83ca tempest-AttachVolumeTestJSON-612710564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-2b21496f-2e2c-480a-bcfe-1b740d400627" returned: 0 in 0.893s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:29:32 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-440699ce-c404-49bb-913e-b74348ce83ca tempest-AttachVolumeTestJSON-612710564 None] Lock "cinder-quobyte-2b21496f-2e2c-480a-bcfe-1b740d400627" released by "delete_volume" :: held 1.808s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:29:32 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-440699ce-c404-49bb-913e-b74348ce83ca tempest-AttachVolumeTestJSON-612710564 None] Created reservations ['adf370b8-c290-4af5-8432-2c3a759e080d', '26f69e60-001a-4fd6-89f2-12c8d396d4ed', '7e558ef6-b5e1-4124-ad64-f9aabc6b7a07', '6ff9edd9-78e6-4e9a-82e1-41a22405de6e'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:29:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-440699ce-c404-49bb-913e-b74348ce83ca tempest-AttachVolumeTestJSON-612710564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:29:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-440699ce-c404-49bb-913e-b74348ce83ca tempest-AttachVolumeTestJSON-612710564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:29:32 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-440699ce-c404-49bb-913e-b74348ce83ca tempest-AttachVolumeTestJSON-612710564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:29:32 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-440699ce-c404-49bb-913e-b74348ce83ca tempest-AttachVolumeTestJSON-612710564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:29:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-440699ce-c404-49bb-913e-b74348ce83ca tempest-AttachVolumeTestJSON-612710564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:29:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-440699ce-c404-49bb-913e-b74348ce83ca tempest-AttachVolumeTestJSON-612710564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:29:32 devstack sudo[96920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:29:32 devstack sudo[96920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:29:32 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-bf073599-2da1-461b-aa13-9f7b4a2f4208 tempest-AttachVolumeTestJSON-612710564 None] Acquiring lock "cinder-8c761e4c-eed8-4468-8770-ed1dc47b49e5-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:29:32 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-bf073599-2da1-461b-aa13-9f7b4a2f4208 tempest-AttachVolumeTestJSON-612710564 None] Lock "cinder-8c761e4c-eed8-4468-8770-ed1dc47b49e5-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:29:33 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-bf073599-2da1-461b-aa13-9f7b4a2f4208 tempest-AttachVolumeTestJSON-612710564 None] Acquiring lock "cinder-quobyte-8c761e4c-eed8-4468-8770-ed1dc47b49e5" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:29:33 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-bf073599-2da1-461b-aa13-9f7b4a2f4208 tempest-AttachVolumeTestJSON-612710564 None] Lock "cinder-quobyte-8c761e4c-eed8-4468-8770-ed1dc47b49e5" acquired by "delete_volume" :: waited 0.083s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:29:33 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d34007-7993-41c3-a0a8-9a9ae4ade100]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:29:33 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-bf073599-2da1-461b-aa13-9f7b4a2f4208 tempest-AttachVolumeTestJSON-612710564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-8c761e4c-eed8-4468-8770-ed1dc47b49e5 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:29:33 devstack sudo[96920]: pam_unix(sudo:session): session closed for user root Sep 28 09:29:33 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-440699ce-c404-49bb-913e-b74348ce83ca tempest-AttachVolumeTestJSON-612710564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 1.054s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:29:33 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-440699ce-c404-49bb-913e-b74348ce83ca tempest-AttachVolumeTestJSON-612710564 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:29:33 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-440699ce-c404-49bb-913e-b74348ce83ca tempest-AttachVolumeTestJSON-612710564 None] Deleted volume successfully. Sep 28 09:29:33 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-440699ce-c404-49bb-913e-b74348ce83ca tempest-AttachVolumeTestJSON-612710564 None] Lock "cinder-2b21496f-2e2c-480a-bcfe-1b740d400627-delete_volume" released by "delete_volume" :: held 3.442s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:29:33 devstack sudo[96922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-8c761e4c-eed8-4468-8770-ed1dc47b49e5 Sep 28 09:29:33 devstack sudo[96922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:29:33 devstack sudo[96817]: pam_unix(sudo:session): session closed for user root Sep 28 09:29:33 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-aedd9598-8006-4885-a261-ebfe35eb0824 tempest-VolumesSnapshotTestJSON-217259837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6ee24eab-2437-42a1-8ad9-59e1696119f3 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-02e3058f-441c-4816-835c-b703dbb26ec4" returned: 0 in 10.074s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:29:33 devstack cinder-volume[86553]: DEBUG cinder.image.image_utils [None req-aedd9598-8006-4885-a261-ebfe35eb0824 tempest-VolumesSnapshotTestJSON-217259837 None] Image conversion details: src /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6ee24eab-2437-42a1-8ad9-59e1696119f3, size 1024.00 MB, duration 10.08 sec, destination /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-02e3058f-441c-4816-835c-b703dbb26ec4 {{(pid=86553) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 09:29:33 devstack cinder-volume[86553]: INFO cinder.image.image_utils [None req-aedd9598-8006-4885-a261-ebfe35eb0824 tempest-VolumesSnapshotTestJSON-217259837 None] Converted 1024.00 MB image at 101.62 MB/s Sep 28 09:29:33 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-aedd9598-8006-4885-a261-ebfe35eb0824 tempest-VolumesSnapshotTestJSON-217259837 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-02e3058f-441c-4816-835c-b703dbb26ec4 is being set with open permissions: ugo+rw Sep 28 09:29:33 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-aedd9598-8006-4885-a261-ebfe35eb0824 tempest-VolumesSnapshotTestJSON-217259837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-02e3058f-441c-4816-835c-b703dbb26ec4 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:29:33 devstack sudo[96928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-02e3058f-441c-4816-835c-b703dbb26ec4 Sep 28 09:29:33 devstack sudo[96928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:29:33 devstack sudo[96922]: pam_unix(sudo:session): session closed for user root Sep 28 09:29:33 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-bf073599-2da1-461b-aa13-9f7b4a2f4208 tempest-AttachVolumeTestJSON-612710564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-8c761e4c-eed8-4468-8770-ed1dc47b49e5" returned: 0 in 0.706s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:29:33 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-bf073599-2da1-461b-aa13-9f7b4a2f4208 tempest-AttachVolumeTestJSON-612710564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-8c761e4c-eed8-4468-8770-ed1dc47b49e5 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:29:34 devstack sudo[96932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-8c761e4c-eed8-4468-8770-ed1dc47b49e5 Sep 28 09:29:34 devstack sudo[96932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:29:34 devstack sudo[96928]: pam_unix(sudo:session): session closed for user root Sep 28 09:29:34 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-aedd9598-8006-4885-a261-ebfe35eb0824 tempest-VolumesSnapshotTestJSON-217259837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-02e3058f-441c-4816-835c-b703dbb26ec4" returned: 0 in 0.262s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:29:34 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-aedd9598-8006-4885-a261-ebfe35eb0824 tempest-VolumesSnapshotTestJSON-217259837 None] Lock "cinder-quobyte-02e3058f-441c-4816-835c-b703dbb26ec4" released by "_copy_volume_from_snapshot" :: held 11.389s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:29:34 devstack cinder-volume[86553]: DEBUG dbcounter [-] [86553] Writing DB stats cinder:UPDATE=63,cinder:SELECT=93,cinder:INSERT=18,cinder:DELETE=7 {{(pid=86553) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 09:29:34 devstack cinder-volume[86553]: DEBUG dbcounter [-] [86553] Writing DB stats cinder:SELECT=82,cinder:UPDATE=78,cinder:INSERT=13,cinder:DELETE=7 {{(pid=86553) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 09:29:34 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-aedd9598-8006-4885-a261-ebfe35eb0824 tempest-VolumesSnapshotTestJSON-217259837 None] Lock "cinder-quobyte-e3c619b2-e097-4c53-94da-16b9a46e64dd-02e3058f-441c-4816-835c-b703dbb26ec4" released by "_create_volume_from_snapshot" :: held 11.480s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:29:34 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-aedd9598-8006-4885-a261-ebfe35eb0824 tempest-VolumesSnapshotTestJSON-217259837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.498s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:29:34 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-aedd9598-8006-4885-a261-ebfe35eb0824 tempest-VolumesSnapshotTestJSON-217259837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (504dd7dc-1b07-4c3a-95f5-05c89a696a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02e3058f-441c-4816-835c-b703dbb26ec4', 'volume_size': 1, 'snapshot_id': 'e3c619b2-e097-4c53-94da-16b9a46e64dd'}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:29:34 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-aedd9598-8006-4885-a261-ebfe35eb0824 tempest-VolumesSnapshotTestJSON-217259837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cef1fbdf-4794-438c-9e58-71255d2e21cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:29:34 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-aedd9598-8006-4885-a261-ebfe35eb0824 tempest-VolumesSnapshotTestJSON-217259837 None] Volume volume-02e3058f-441c-4816-835c-b703dbb26ec4 (02e3058f-441c-4816-835c-b703dbb26ec4): created successfully Sep 28 09:29:34 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-aedd9598-8006-4885-a261-ebfe35eb0824 tempest-VolumesSnapshotTestJSON-217259837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cef1fbdf-4794-438c-9e58-71255d2e21cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:29:34 devstack sudo[96932]: pam_unix(sudo:session): session closed for user root Sep 28 09:29:34 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-aedd9598-8006-4885-a261-ebfe35eb0824 tempest-VolumesSnapshotTestJSON-217259837 None] Flow 'volume_create_manager' (934db8d5-4612-45e5-a0bf-efc9a7bac23f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:29:34 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-bf073599-2da1-461b-aa13-9f7b4a2f4208 tempest-AttachVolumeTestJSON-612710564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-8c761e4c-eed8-4468-8770-ed1dc47b49e5" returned: 0 in 0.302s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:29:34 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-bf073599-2da1-461b-aa13-9f7b4a2f4208 tempest-AttachVolumeTestJSON-612710564 None] Lock "cinder-quobyte-8c761e4c-eed8-4468-8770-ed1dc47b49e5" released by "delete_volume" :: held 1.160s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:29:34 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-aedd9598-8006-4885-a261-ebfe35eb0824 tempest-VolumesSnapshotTestJSON-217259837 None] Created volume successfully. Sep 28 09:29:34 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-bf073599-2da1-461b-aa13-9f7b4a2f4208 tempest-AttachVolumeTestJSON-612710564 None] Created reservations ['3e2d6e75-8d9a-4680-b791-28c79743a8b9', '3237e77e-06ce-45fc-8e22-2edb811e6127', '4d8094e9-850c-4c28-8b6d-d51a10272223', 'ba1f569d-6abe-4909-bdfb-53dea53382b6'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:29:34 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-bf073599-2da1-461b-aa13-9f7b4a2f4208 tempest-AttachVolumeTestJSON-612710564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:29:34 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-bf073599-2da1-461b-aa13-9f7b4a2f4208 tempest-AttachVolumeTestJSON-612710564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:29:34 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-bf073599-2da1-461b-aa13-9f7b4a2f4208 tempest-AttachVolumeTestJSON-612710564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:29:34 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-bf073599-2da1-461b-aa13-9f7b4a2f4208 tempest-AttachVolumeTestJSON-612710564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:29:34 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-bf073599-2da1-461b-aa13-9f7b4a2f4208 tempest-AttachVolumeTestJSON-612710564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:29:34 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-bf073599-2da1-461b-aa13-9f7b4a2f4208 tempest-AttachVolumeTestJSON-612710564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:29:34 devstack sudo[96936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:29:34 devstack sudo[96936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:29:34 devstack sudo[96936]: pam_unix(sudo:session): session closed for user root Sep 28 09:29:34 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-bf073599-2da1-461b-aa13-9f7b4a2f4208 tempest-AttachVolumeTestJSON-612710564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.256s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:29:34 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-bf073599-2da1-461b-aa13-9f7b4a2f4208 tempest-AttachVolumeTestJSON-612710564 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:29:34 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-bf073599-2da1-461b-aa13-9f7b4a2f4208 tempest-AttachVolumeTestJSON-612710564 None] Deleted volume successfully. Sep 28 09:29:34 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-bf073599-2da1-461b-aa13-9f7b4a2f4208 tempest-AttachVolumeTestJSON-612710564 None] Lock "cinder-8c761e4c-eed8-4468-8770-ed1dc47b49e5-delete_volume" released by "delete_volume" :: held 1.842s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:29:35 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-f65387d7-66bb-4771-b17f-2bb48c41306f tempest-VolumesSnapshotTestJSON-217259837 None] Acquiring lock "cinder-02e3058f-441c-4816-835c-b703dbb26ec4-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:29:35 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-f65387d7-66bb-4771-b17f-2bb48c41306f tempest-VolumesSnapshotTestJSON-217259837 None] Lock "cinder-02e3058f-441c-4816-835c-b703dbb26ec4-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:29:35 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-f65387d7-66bb-4771-b17f-2bb48c41306f tempest-VolumesSnapshotTestJSON-217259837 None] Acquiring lock "cinder-quobyte-02e3058f-441c-4816-835c-b703dbb26ec4" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:29:35 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-f65387d7-66bb-4771-b17f-2bb48c41306f tempest-VolumesSnapshotTestJSON-217259837 None] Lock "cinder-quobyte-02e3058f-441c-4816-835c-b703dbb26ec4" acquired by "delete_volume" :: waited 0.019s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:29:35 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac16024-4d4a-49f6-8454-652002039ac8]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:29:35 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f65387d7-66bb-4771-b17f-2bb48c41306f tempest-VolumesSnapshotTestJSON-217259837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-02e3058f-441c-4816-835c-b703dbb26ec4 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:29:35 devstack sudo[96940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-02e3058f-441c-4816-835c-b703dbb26ec4 Sep 28 09:29:35 devstack sudo[96940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:29:35 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-e26e653c-af95-419e-aae5-a979f14e2d6b tempest-AttachVolumeTestJSON-612710564 None] Acquiring lock "cinder-08c84622-bed2-4bb3-bca9-9510553de117-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:29:35 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-e26e653c-af95-419e-aae5-a979f14e2d6b tempest-AttachVolumeTestJSON-612710564 None] Lock "cinder-08c84622-bed2-4bb3-bca9-9510553de117-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:29:35 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-e26e653c-af95-419e-aae5-a979f14e2d6b tempest-AttachVolumeTestJSON-612710564 None] Acquiring lock "cinder-quobyte-08c84622-bed2-4bb3-bca9-9510553de117" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:29:35 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-e26e653c-af95-419e-aae5-a979f14e2d6b tempest-AttachVolumeTestJSON-612710564 None] Lock "cinder-quobyte-08c84622-bed2-4bb3-bca9-9510553de117" acquired by "delete_volume" :: waited 0.030s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:29:35 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac37742d-6d58-495b-9e7d-cd5baac01d99]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:29:35 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e26e653c-af95-419e-aae5-a979f14e2d6b tempest-AttachVolumeTestJSON-612710564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-08c84622-bed2-4bb3-bca9-9510553de117 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:29:35 devstack sudo[96942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-08c84622-bed2-4bb3-bca9-9510553de117 Sep 28 09:29:35 devstack sudo[96942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:29:35 devstack sudo[96940]: pam_unix(sudo:session): session closed for user root Sep 28 09:29:35 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f65387d7-66bb-4771-b17f-2bb48c41306f tempest-VolumesSnapshotTestJSON-217259837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-02e3058f-441c-4816-835c-b703dbb26ec4" returned: 0 in 0.543s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:29:35 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f65387d7-66bb-4771-b17f-2bb48c41306f tempest-VolumesSnapshotTestJSON-217259837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-02e3058f-441c-4816-835c-b703dbb26ec4 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:29:35 devstack sudo[96949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-02e3058f-441c-4816-835c-b703dbb26ec4 Sep 28 09:29:35 devstack sudo[96949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:29:36 devstack sudo[96942]: pam_unix(sudo:session): session closed for user root Sep 28 09:29:36 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e26e653c-af95-419e-aae5-a979f14e2d6b tempest-AttachVolumeTestJSON-612710564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-08c84622-bed2-4bb3-bca9-9510553de117" returned: 0 in 0.549s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:29:36 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e26e653c-af95-419e-aae5-a979f14e2d6b tempest-AttachVolumeTestJSON-612710564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-08c84622-bed2-4bb3-bca9-9510553de117 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:29:36 devstack sudo[96955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-08c84622-bed2-4bb3-bca9-9510553de117 Sep 28 09:29:36 devstack sudo[96955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:29:36 devstack sudo[96949]: pam_unix(sudo:session): session closed for user root Sep 28 09:29:36 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f65387d7-66bb-4771-b17f-2bb48c41306f tempest-VolumesSnapshotTestJSON-217259837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-02e3058f-441c-4816-835c-b703dbb26ec4" returned: 0 in 0.343s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:29:36 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-f65387d7-66bb-4771-b17f-2bb48c41306f tempest-VolumesSnapshotTestJSON-217259837 None] Lock "cinder-quobyte-02e3058f-441c-4816-835c-b703dbb26ec4" released by "delete_volume" :: held 0.968s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:29:36 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-f65387d7-66bb-4771-b17f-2bb48c41306f tempest-VolumesSnapshotTestJSON-217259837 None] Created reservations ['21a5e21d-4d73-4866-8be7-0d0dae62f4af', 'a47644fd-6d61-43fa-ba83-83877e8acc79', '00ebf2ca-48f7-44a9-a5ab-5101812cd02d', '3a75983c-759e-4586-8187-86fd1a88dd03'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:29:36 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-f65387d7-66bb-4771-b17f-2bb48c41306f tempest-VolumesSnapshotTestJSON-217259837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:29:36 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-f65387d7-66bb-4771-b17f-2bb48c41306f tempest-VolumesSnapshotTestJSON-217259837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:29:36 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-f65387d7-66bb-4771-b17f-2bb48c41306f tempest-VolumesSnapshotTestJSON-217259837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:29:36 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-f65387d7-66bb-4771-b17f-2bb48c41306f tempest-VolumesSnapshotTestJSON-217259837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:29:36 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-f65387d7-66bb-4771-b17f-2bb48c41306f tempest-VolumesSnapshotTestJSON-217259837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:29:36 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f65387d7-66bb-4771-b17f-2bb48c41306f tempest-VolumesSnapshotTestJSON-217259837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:29:36 devstack sudo[96955]: pam_unix(sudo:session): session closed for user root Sep 28 09:29:36 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e26e653c-af95-419e-aae5-a979f14e2d6b tempest-AttachVolumeTestJSON-612710564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-08c84622-bed2-4bb3-bca9-9510553de117" returned: 0 in 0.346s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:29:36 devstack sudo[96958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:29:36 devstack sudo[96958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:29:36 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-e26e653c-af95-419e-aae5-a979f14e2d6b tempest-AttachVolumeTestJSON-612710564 None] Lock "cinder-quobyte-08c84622-bed2-4bb3-bca9-9510553de117" released by "delete_volume" :: held 0.965s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:29:36 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-e26e653c-af95-419e-aae5-a979f14e2d6b tempest-AttachVolumeTestJSON-612710564 None] Created reservations ['ff4923ed-0dd4-4427-a8f0-28c118db7f51', '35e617bd-3d71-408e-b0a6-5d0644f692c1', '1169e5ec-49c0-4053-a669-70e7d7bfbee3', 'eccfd294-79bc-4fce-a33f-9b67e0e5fe7f'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:29:36 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-afe6166d-e6cb-4316-b03b-84304426d1c4 tempest-AttachVolumeNegativeTest-1957606009 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:29:36 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-afe6166d-e6cb-4316-b03b-84304426d1c4 tempest-AttachVolumeNegativeTest-1957606009 None] Flow 'volume_create_manager' (892db661-44f1-4488-b899-ea247cd65d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:29:36 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-afe6166d-e6cb-4316-b03b-84304426d1c4 tempest-AttachVolumeNegativeTest-1957606009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91ea692a-683d-4484-b864-dfab0235a5b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:29:36 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-afe6166d-e6cb-4316-b03b-84304426d1c4 tempest-AttachVolumeNegativeTest-1957606009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91ea692a-683d-4484-b864-dfab0235a5b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:29:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-316823511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cf15566-7c57-4964-a4cd-3dcfb97b1c5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae977ce2e750463c958ccb0bd085f517',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:29:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:29:37Z,use_quota=True,user_id='1ce42b207b3f42c3b1ea2429c628a473',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:29:36 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-afe6166d-e6cb-4316-b03b-84304426d1c4 tempest-AttachVolumeNegativeTest-1957606009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b245f164-0547-4346-84d5-0e0b28818a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:29:36 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-afe6166d-e6cb-4316-b03b-84304426d1c4 tempest-AttachVolumeNegativeTest-1957606009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b245f164-0547-4346-84d5-0e0b28818a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:29:36 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-afe6166d-e6cb-4316-b03b-84304426d1c4 tempest-AttachVolumeNegativeTest-1957606009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbec7f43-db3b-44ec-90e3-faa2e826b000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:29:36 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-afe6166d-e6cb-4316-b03b-84304426d1c4 tempest-AttachVolumeNegativeTest-1957606009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbec7f43-db3b-44ec-90e3-faa2e826b000) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8cf15566-7c57-4964-a4cd-3dcfb97b1c5e', 'volume_name': 'volume-8cf15566-7c57-4964-a4cd-3dcfb97b1c5e', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:29:36 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-afe6166d-e6cb-4316-b03b-84304426d1c4 tempest-AttachVolumeNegativeTest-1957606009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9981dcf5-7c48-49fe-b20b-2174eb22ea32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:29:36 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-afe6166d-e6cb-4316-b03b-84304426d1c4 tempest-AttachVolumeNegativeTest-1957606009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9981dcf5-7c48-49fe-b20b-2174eb22ea32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:29:36 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-afe6166d-e6cb-4316-b03b-84304426d1c4 tempest-AttachVolumeNegativeTest-1957606009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cefb00b8-7494-4ee7-8765-db21ee5652d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:29:36 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-afe6166d-e6cb-4316-b03b-84304426d1c4 tempest-AttachVolumeNegativeTest-1957606009 None] Volume 8cf15566-7c57-4964-a4cd-3dcfb97b1c5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8cf15566-7c57-4964-a4cd-3dcfb97b1c5e', 'volume_size': 1} Sep 28 09:29:36 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-afe6166d-e6cb-4316-b03b-84304426d1c4 tempest-AttachVolumeNegativeTest-1957606009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:29:36 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-afe6166d-e6cb-4316-b03b-84304426d1c4 tempest-AttachVolumeNegativeTest-1957606009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:29:36 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-afe6166d-e6cb-4316-b03b-84304426d1c4 tempest-AttachVolumeNegativeTest-1957606009 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:29:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-316823511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cf15566-7c57-4964-a4cd-3dcfb97b1c5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae977ce2e750463c958ccb0bd085f517',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:29:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:29:37Z,use_quota=True,user_id='1ce42b207b3f42c3b1ea2429c628a473',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:29:36 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-afe6166d-e6cb-4316-b03b-84304426d1c4 tempest-AttachVolumeNegativeTest-1957606009 None] Creating volume 8cf15566-7c57-4964-a4cd-3dcfb97b1c5e {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:29:36 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-afe6166d-e6cb-4316-b03b-84304426d1c4 tempest-AttachVolumeNegativeTest-1957606009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:29:36 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-afe6166d-e6cb-4316-b03b-84304426d1c4 tempest-AttachVolumeNegativeTest-1957606009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:29:36 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-afe6166d-e6cb-4316-b03b-84304426d1c4 tempest-AttachVolumeNegativeTest-1957606009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:29:36 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-afe6166d-e6cb-4316-b03b-84304426d1c4 tempest-AttachVolumeNegativeTest-1957606009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:29:36 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-afe6166d-e6cb-4316-b03b-84304426d1c4 tempest-AttachVolumeNegativeTest-1957606009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:29:36 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-afe6166d-e6cb-4316-b03b-84304426d1c4 tempest-AttachVolumeNegativeTest-1957606009 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:29:36 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-afe6166d-e6cb-4316-b03b-84304426d1c4 tempest-AttachVolumeNegativeTest-1957606009 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:29:36 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-afe6166d-e6cb-4316-b03b-84304426d1c4 tempest-AttachVolumeNegativeTest-1957606009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-8cf15566-7c57-4964-a4cd-3dcfb97b1c5e 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:29:36 devstack sudo[96958]: pam_unix(sudo:session): session closed for user root Sep 28 09:29:36 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f65387d7-66bb-4771-b17f-2bb48c41306f tempest-VolumesSnapshotTestJSON-217259837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.324s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:29:36 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-f65387d7-66bb-4771-b17f-2bb48c41306f tempest-VolumesSnapshotTestJSON-217259837 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:29:36 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-f65387d7-66bb-4771-b17f-2bb48c41306f tempest-VolumesSnapshotTestJSON-217259837 None] Deleted volume successfully. Sep 28 09:29:36 devstack sudo[96961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-8cf15566-7c57-4964-a4cd-3dcfb97b1c5e 1073741824 Sep 28 09:29:36 devstack sudo[96961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:29:36 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-e26e653c-af95-419e-aae5-a979f14e2d6b tempest-AttachVolumeTestJSON-612710564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:29:36 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-e26e653c-af95-419e-aae5-a979f14e2d6b tempest-AttachVolumeTestJSON-612710564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:29:36 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-e26e653c-af95-419e-aae5-a979f14e2d6b tempest-AttachVolumeTestJSON-612710564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:29:36 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-e26e653c-af95-419e-aae5-a979f14e2d6b tempest-AttachVolumeTestJSON-612710564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:29:36 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-e26e653c-af95-419e-aae5-a979f14e2d6b tempest-AttachVolumeTestJSON-612710564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:29:36 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e26e653c-af95-419e-aae5-a979f14e2d6b tempest-AttachVolumeTestJSON-612710564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:29:36 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-f65387d7-66bb-4771-b17f-2bb48c41306f tempest-VolumesSnapshotTestJSON-217259837 None] Lock "cinder-02e3058f-441c-4816-835c-b703dbb26ec4-delete_volume" released by "delete_volume" :: held 1.694s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:29:36 devstack sudo[96963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:29:36 devstack sudo[96963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:29:37 devstack sudo[96963]: pam_unix(sudo:session): session closed for user root Sep 28 09:29:37 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e26e653c-af95-419e-aae5-a979f14e2d6b tempest-AttachVolumeTestJSON-612710564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.327s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:29:37 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-e26e653c-af95-419e-aae5-a979f14e2d6b tempest-AttachVolumeTestJSON-612710564 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:29:37 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-e26e653c-af95-419e-aae5-a979f14e2d6b tempest-AttachVolumeTestJSON-612710564 None] Deleted volume successfully. Sep 28 09:29:37 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-e26e653c-af95-419e-aae5-a979f14e2d6b tempest-AttachVolumeTestJSON-612710564 None] Lock "cinder-08c84622-bed2-4bb3-bca9-9510553de117-delete_volume" released by "delete_volume" :: held 1.769s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:29:37 devstack sudo[96961]: pam_unix(sudo:session): session closed for user root Sep 28 09:29:37 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-afe6166d-e6cb-4316-b03b-84304426d1c4 tempest-AttachVolumeNegativeTest-1957606009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-8cf15566-7c57-4964-a4cd-3dcfb97b1c5e 1073741824" returned: 0 in 0.615s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:29:37 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-afe6166d-e6cb-4316-b03b-84304426d1c4 tempest-AttachVolumeNegativeTest-1957606009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-8cf15566-7c57-4964-a4cd-3dcfb97b1c5e {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:29:37 devstack sudo[96971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-8cf15566-7c57-4964-a4cd-3dcfb97b1c5e Sep 28 09:29:37 devstack sudo[96971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:29:37 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-3bcd5ca6-7a80-4e18-8d86-a9359dcca17b tempest-VolumesSnapshotTestJSON-217259837 None] Acquiring lock "cinder-e3c619b2-e097-4c53-94da-16b9a46e64dd-delete_snapshot" by "delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:29:37 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-3bcd5ca6-7a80-4e18-8d86-a9359dcca17b tempest-VolumesSnapshotTestJSON-217259837 None] Lock "cinder-e3c619b2-e097-4c53-94da-16b9a46e64dd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:29:37 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-3bcd5ca6-7a80-4e18-8d86-a9359dcca17b tempest-VolumesSnapshotTestJSON-217259837 None] Acquiring lock "cinder-quobyte-6ee24eab-2437-42a1-8ad9-59e1696119f3" by "delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:29:37 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-3bcd5ca6-7a80-4e18-8d86-a9359dcca17b tempest-VolumesSnapshotTestJSON-217259837 None] Lock "cinder-quobyte-6ee24eab-2437-42a1-8ad9-59e1696119f3" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:29:37 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-3bcd5ca6-7a80-4e18-8d86-a9359dcca17b tempest-VolumesSnapshotTestJSON-217259837 None] Acquiring lock "cinder-quobyte-e3c619b2-e097-4c53-94da-16b9a46e64dd" by "_delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:29:37 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-3bcd5ca6-7a80-4e18-8d86-a9359dcca17b tempest-VolumesSnapshotTestJSON-217259837 None] Lock "cinder-quobyte-e3c619b2-e097-4c53-94da-16b9a46e64dd" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:29:37 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-3bcd5ca6-7a80-4e18-8d86-a9359dcca17b tempest-VolumesSnapshotTestJSON-217259837 None] Deleting offline snapshot e3c619b2-e097-4c53-94da-16b9a46e64dd of volume 6ee24eab-2437-42a1-8ad9-59e1696119f3 {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 09:29:37 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-3bcd5ca6-7a80-4e18-8d86-a9359dcca17b tempest-VolumesSnapshotTestJSON-217259837 None] snapshot_file for this snap is: volume-6ee24eab-2437-42a1-8ad9-59e1696119f3.e3c619b2-e097-4c53-94da-16b9a46e64dd {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 09:29:37 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[c19bfc72-80df-4587-b643-1cb2e040e430]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:29:37 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3bcd5ca6-7a80-4e18-8d86-a9359dcca17b tempest-VolumesSnapshotTestJSON-217259837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6ee24eab-2437-42a1-8ad9-59e1696119f3.e3c619b2-e097-4c53-94da-16b9a46e64dd {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:29:37 devstack sudo[96971]: pam_unix(sudo:session): session closed for user root Sep 28 09:29:37 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-afe6166d-e6cb-4316-b03b-84304426d1c4 tempest-AttachVolumeNegativeTest-1957606009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-8cf15566-7c57-4964-a4cd-3dcfb97b1c5e" returned: 0 in 0.372s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:29:37 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-afe6166d-e6cb-4316-b03b-84304426d1c4 tempest-AttachVolumeNegativeTest-1957606009 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:29:37 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-afe6166d-e6cb-4316-b03b-84304426d1c4 tempest-AttachVolumeNegativeTest-1957606009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:29:37 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-afe6166d-e6cb-4316-b03b-84304426d1c4 tempest-AttachVolumeNegativeTest-1957606009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cefb00b8-7494-4ee7-8765-db21ee5652d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8cf15566-7c57-4964-a4cd-3dcfb97b1c5e', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:29:37 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-afe6166d-e6cb-4316-b03b-84304426d1c4 tempest-AttachVolumeNegativeTest-1957606009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60cf5fe3-2502-4473-b0b8-f5cb98c5eb04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:29:37 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-afe6166d-e6cb-4316-b03b-84304426d1c4 tempest-AttachVolumeNegativeTest-1957606009 None] Volume volume-8cf15566-7c57-4964-a4cd-3dcfb97b1c5e (8cf15566-7c57-4964-a4cd-3dcfb97b1c5e): created successfully Sep 28 09:29:37 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-afe6166d-e6cb-4316-b03b-84304426d1c4 tempest-AttachVolumeNegativeTest-1957606009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60cf5fe3-2502-4473-b0b8-f5cb98c5eb04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:29:37 devstack sudo[96974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6ee24eab-2437-42a1-8ad9-59e1696119f3.e3c619b2-e097-4c53-94da-16b9a46e64dd Sep 28 09:29:37 devstack sudo[96974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:29:37 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-afe6166d-e6cb-4316-b03b-84304426d1c4 tempest-AttachVolumeNegativeTest-1957606009 None] Flow 'volume_create_manager' (892db661-44f1-4488-b899-ea247cd65d40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:29:37 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-afe6166d-e6cb-4316-b03b-84304426d1c4 tempest-AttachVolumeNegativeTest-1957606009 None] Created volume successfully. Sep 28 09:29:38 devstack sudo[96974]: pam_unix(sudo:session): session closed for user root Sep 28 09:29:38 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3bcd5ca6-7a80-4e18-8d86-a9359dcca17b tempest-VolumesSnapshotTestJSON-217259837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6ee24eab-2437-42a1-8ad9-59e1696119f3.e3c619b2-e097-4c53-94da-16b9a46e64dd" returned: 0 in 0.463s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:29:38 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-3bcd5ca6-7a80-4e18-8d86-a9359dcca17b tempest-VolumesSnapshotTestJSON-217259837 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ee24eab-2437-42a1-8ad9-59e1696119f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86553) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 09:29:38 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf33044-6f62-4585-9622-b7ef9bf8a9a4]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:29:38 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3bcd5ca6-7a80-4e18-8d86-a9359dcca17b tempest-VolumesSnapshotTestJSON-217259837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6ee24eab-2437-42a1-8ad9-59e1696119f3 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:29:38 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-cebcca22-a1b7-4b65-b10f-01328ebbcca8 tempest-AttachVolumeShelveTestJSON-491900363 None] Acquiring lock "cinder-93ceb9b1-d5a7-44ce-93ab-99221a55226b-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:29:38 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-cebcca22-a1b7-4b65-b10f-01328ebbcca8 tempest-AttachVolumeShelveTestJSON-491900363 None] Lock "cinder-93ceb9b1-d5a7-44ce-93ab-99221a55226b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:29:38 devstack sudo[96979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6ee24eab-2437-42a1-8ad9-59e1696119f3 Sep 28 09:29:38 devstack sudo[96979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:29:38 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-cebcca22-a1b7-4b65-b10f-01328ebbcca8 tempest-AttachVolumeShelveTestJSON-491900363 None] Acquiring lock "cinder-quobyte-93ceb9b1-d5a7-44ce-93ab-99221a55226b" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:29:38 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-cebcca22-a1b7-4b65-b10f-01328ebbcca8 tempest-AttachVolumeShelveTestJSON-491900363 None] Lock "cinder-quobyte-93ceb9b1-d5a7-44ce-93ab-99221a55226b" acquired by "delete_volume" :: waited 0.024s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:29:38 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[8afb82ca-4de9-415b-bb10-721b6e7d2563]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:29:38 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-cebcca22-a1b7-4b65-b10f-01328ebbcca8 tempest-AttachVolumeShelveTestJSON-491900363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-93ceb9b1-d5a7-44ce-93ab-99221a55226b {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:29:38 devstack sudo[96981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-93ceb9b1-d5a7-44ce-93ab-99221a55226b Sep 28 09:29:38 devstack sudo[96981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:29:39 devstack sudo[96979]: pam_unix(sudo:session): session closed for user root Sep 28 09:29:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3bcd5ca6-7a80-4e18-8d86-a9359dcca17b tempest-VolumesSnapshotTestJSON-217259837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6ee24eab-2437-42a1-8ad9-59e1696119f3" returned: 0 in 0.893s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:29:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3bcd5ca6-7a80-4e18-8d86-a9359dcca17b tempest-VolumesSnapshotTestJSON-217259837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6ee24eab-2437-42a1-8ad9-59e1696119f3.e3c619b2-e097-4c53-94da-16b9a46e64dd {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:29:39 devstack sudo[96992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6ee24eab-2437-42a1-8ad9-59e1696119f3.e3c619b2-e097-4c53-94da-16b9a46e64dd Sep 28 09:29:39 devstack sudo[96992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:29:39 devstack sudo[96981]: pam_unix(sudo:session): session closed for user root Sep 28 09:29:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-cebcca22-a1b7-4b65-b10f-01328ebbcca8 tempest-AttachVolumeShelveTestJSON-491900363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-93ceb9b1-d5a7-44ce-93ab-99221a55226b" returned: 0 in 0.687s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:29:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-cebcca22-a1b7-4b65-b10f-01328ebbcca8 tempest-AttachVolumeShelveTestJSON-491900363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-93ceb9b1-d5a7-44ce-93ab-99221a55226b {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:29:39 devstack sudo[96994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-93ceb9b1-d5a7-44ce-93ab-99221a55226b Sep 28 09:29:39 devstack sudo[96994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:29:39 devstack sudo[96994]: pam_unix(sudo:session): session closed for user root Sep 28 09:29:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-cebcca22-a1b7-4b65-b10f-01328ebbcca8 tempest-AttachVolumeShelveTestJSON-491900363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-93ceb9b1-d5a7-44ce-93ab-99221a55226b" returned: 0 in 0.428s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:29:39 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-cebcca22-a1b7-4b65-b10f-01328ebbcca8 tempest-AttachVolumeShelveTestJSON-491900363 None] Lock "cinder-quobyte-93ceb9b1-d5a7-44ce-93ab-99221a55226b" released by "delete_volume" :: held 1.198s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:29:39 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-cebcca22-a1b7-4b65-b10f-01328ebbcca8 tempest-AttachVolumeShelveTestJSON-491900363 None] Created reservations ['962da386-e9ef-434a-9b43-f47304536ee3', '35ab4bb5-932b-4ca0-8e99-43dcf960418a', '73e4ac06-c18e-49e9-9de2-998334667a5d', '4667d6ba-f523-43da-9a97-0b9d11f4d8a8'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:29:39 devstack sudo[96992]: pam_unix(sudo:session): session closed for user root Sep 28 09:29:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-8a6db497-4c35-4a28-b6b0-ca72850221db req-d44698eb-bc86-4c0a-b6c9-2f51a5377402 tempest-AttachVolumeNegativeTest-1957606009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:29:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-8a6db497-4c35-4a28-b6b0-ca72850221db req-d44698eb-bc86-4c0a-b6c9-2f51a5377402 tempest-AttachVolumeNegativeTest-1957606009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:29:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3bcd5ca6-7a80-4e18-8d86-a9359dcca17b tempest-VolumesSnapshotTestJSON-217259837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6ee24eab-2437-42a1-8ad9-59e1696119f3.e3c619b2-e097-4c53-94da-16b9a46e64dd" returned: 0 in 0.655s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:29:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3bcd5ca6-7a80-4e18-8d86-a9359dcca17b tempest-VolumesSnapshotTestJSON-217259837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6ee24eab-2437-42a1-8ad9-59e1696119f3.e3c619b2-e097-4c53-94da-16b9a46e64dd {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:29:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-8a6db497-4c35-4a28-b6b0-ca72850221db req-d44698eb-bc86-4c0a-b6c9-2f51a5377402 tempest-AttachVolumeNegativeTest-1957606009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.038s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:29:39 devstack sudo[97008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6ee24eab-2437-42a1-8ad9-59e1696119f3.e3c619b2-e097-4c53-94da-16b9a46e64dd Sep 28 09:29:39 devstack sudo[97008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:29:39 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [req-8a6db497-4c35-4a28-b6b0-ca72850221db req-d44698eb-bc86-4c0a-b6c9-2f51a5377402 tempest-AttachVolumeNegativeTest-1957606009 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d', 'name': 'volume-8cf15566-7c57-4964-a4cd-3dcfb97b1c5e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b04e9e19-a6de-4f54-97f7-d3c3d043f115', 'enforce_multipath': True} {{(pid=86553) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 09:29:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-cebcca22-a1b7-4b65-b10f-01328ebbcca8 tempest-AttachVolumeShelveTestJSON-491900363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:29:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-cebcca22-a1b7-4b65-b10f-01328ebbcca8 tempest-AttachVolumeShelveTestJSON-491900363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:29:39 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-cebcca22-a1b7-4b65-b10f-01328ebbcca8 tempest-AttachVolumeShelveTestJSON-491900363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:29:39 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-cebcca22-a1b7-4b65-b10f-01328ebbcca8 tempest-AttachVolumeShelveTestJSON-491900363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:29:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-cebcca22-a1b7-4b65-b10f-01328ebbcca8 tempest-AttachVolumeShelveTestJSON-491900363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:29:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-cebcca22-a1b7-4b65-b10f-01328ebbcca8 tempest-AttachVolumeShelveTestJSON-491900363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:29:39 devstack sudo[97010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:29:39 devstack sudo[97010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:29:39 devstack cinder-volume[86553]: INFO cinder.volume.manager [req-8a6db497-4c35-4a28-b6b0-ca72850221db req-d44698eb-bc86-4c0a-b6c9-2f51a5377402 tempest-AttachVolumeNegativeTest-1957606009 None] attachment_update completed successfully. Sep 28 09:29:40 devstack sudo[97008]: pam_unix(sudo:session): session closed for user root Sep 28 09:29:40 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3bcd5ca6-7a80-4e18-8d86-a9359dcca17b tempest-VolumesSnapshotTestJSON-217259837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6ee24eab-2437-42a1-8ad9-59e1696119f3.e3c619b2-e097-4c53-94da-16b9a46e64dd" returned: 0 in 0.330s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:29:40 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-3bcd5ca6-7a80-4e18-8d86-a9359dcca17b tempest-VolumesSnapshotTestJSON-217259837 None] Lock "cinder-quobyte-e3c619b2-e097-4c53-94da-16b9a46e64dd" released by "_delete_snapshot" :: held 2.521s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:29:40 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-3bcd5ca6-7a80-4e18-8d86-a9359dcca17b tempest-VolumesSnapshotTestJSON-217259837 None] Lock "cinder-quobyte-6ee24eab-2437-42a1-8ad9-59e1696119f3" released by "delete_snapshot" :: held 2.565s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:29:40 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-3bcd5ca6-7a80-4e18-8d86-a9359dcca17b tempest-VolumesSnapshotTestJSON-217259837 None] Created reservations ['b26605e2-0652-476a-88d6-5701f1b18884', 'd314e13a-7d73-4770-955d-4d989792aa91', '7c733ff3-74df-4096-8d03-c4d4c2998603', '022d3f64-6b67-4606-9a0c-fcfe226bdd88'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:29:40 devstack sudo[97010]: pam_unix(sudo:session): session closed for user root Sep 28 09:29:40 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-cebcca22-a1b7-4b65-b10f-01328ebbcca8 tempest-AttachVolumeShelveTestJSON-491900363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.419s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:29:40 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-cebcca22-a1b7-4b65-b10f-01328ebbcca8 tempest-AttachVolumeShelveTestJSON-491900363 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:29:40 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-cebcca22-a1b7-4b65-b10f-01328ebbcca8 tempest-AttachVolumeShelveTestJSON-491900363 None] Deleted volume successfully. Sep 28 09:29:40 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-cebcca22-a1b7-4b65-b10f-01328ebbcca8 tempest-AttachVolumeShelveTestJSON-491900363 None] Lock "cinder-93ceb9b1-d5a7-44ce-93ab-99221a55226b-delete_volume" released by "delete_volume" :: held 1.989s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:29:40 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-3bcd5ca6-7a80-4e18-8d86-a9359dcca17b tempest-VolumesSnapshotTestJSON-217259837 None] Delete snapshot completed successfully. Sep 28 09:29:40 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-3bcd5ca6-7a80-4e18-8d86-a9359dcca17b tempest-VolumesSnapshotTestJSON-217259837 None] Lock "cinder-e3c619b2-e097-4c53-94da-16b9a46e64dd-delete_snapshot" released by "delete_snapshot" :: held 2.783s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:29:40 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-c30a1333-c874-4206-8757-9c6905080d6f tempest-VolumesSnapshotTestJSON-217259837 None] Acquiring lock "cinder-6ee24eab-2437-42a1-8ad9-59e1696119f3-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:29:40 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-c30a1333-c874-4206-8757-9c6905080d6f tempest-VolumesSnapshotTestJSON-217259837 None] Lock "cinder-6ee24eab-2437-42a1-8ad9-59e1696119f3-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:29:41 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-c30a1333-c874-4206-8757-9c6905080d6f tempest-VolumesSnapshotTestJSON-217259837 None] Acquiring lock "cinder-quobyte-6ee24eab-2437-42a1-8ad9-59e1696119f3" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:29:41 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-c30a1333-c874-4206-8757-9c6905080d6f tempest-VolumesSnapshotTestJSON-217259837 None] Lock "cinder-quobyte-6ee24eab-2437-42a1-8ad9-59e1696119f3" acquired by "delete_volume" :: waited 0.025s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:29:41 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[07572e33-82e2-4155-b0be-cbfded6d25c5]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:29:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c30a1333-c874-4206-8757-9c6905080d6f tempest-VolumesSnapshotTestJSON-217259837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6ee24eab-2437-42a1-8ad9-59e1696119f3 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:29:41 devstack sudo[97430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6ee24eab-2437-42a1-8ad9-59e1696119f3 Sep 28 09:29:41 devstack sudo[97430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:29:41 devstack sudo[97430]: pam_unix(sudo:session): session closed for user root Sep 28 09:29:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c30a1333-c874-4206-8757-9c6905080d6f tempest-VolumesSnapshotTestJSON-217259837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6ee24eab-2437-42a1-8ad9-59e1696119f3" returned: 0 in 0.474s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:29:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c30a1333-c874-4206-8757-9c6905080d6f tempest-VolumesSnapshotTestJSON-217259837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6ee24eab-2437-42a1-8ad9-59e1696119f3 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:29:41 devstack sudo[97435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6ee24eab-2437-42a1-8ad9-59e1696119f3 Sep 28 09:29:41 devstack sudo[97435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:29:41 devstack sudo[97435]: pam_unix(sudo:session): session closed for user root Sep 28 09:29:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c30a1333-c874-4206-8757-9c6905080d6f tempest-VolumesSnapshotTestJSON-217259837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6ee24eab-2437-42a1-8ad9-59e1696119f3" returned: 0 in 0.336s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:29:41 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-c30a1333-c874-4206-8757-9c6905080d6f tempest-VolumesSnapshotTestJSON-217259837 None] Lock "cinder-quobyte-6ee24eab-2437-42a1-8ad9-59e1696119f3" released by "delete_volume" :: held 0.906s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:29:42 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-c30a1333-c874-4206-8757-9c6905080d6f tempest-VolumesSnapshotTestJSON-217259837 None] Created reservations ['78f1a078-5660-47b0-ae22-1a2c81d44328', '79939ec8-255e-4426-89c5-227572d68af3', '7a8a8421-377b-4a05-9484-889747e776d8', '3e434377-2aba-456e-81e8-d63363490c4a'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:29:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-c30a1333-c874-4206-8757-9c6905080d6f tempest-VolumesSnapshotTestJSON-217259837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:29:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-c30a1333-c874-4206-8757-9c6905080d6f tempest-VolumesSnapshotTestJSON-217259837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:29:42 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-c30a1333-c874-4206-8757-9c6905080d6f tempest-VolumesSnapshotTestJSON-217259837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:29:42 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-c30a1333-c874-4206-8757-9c6905080d6f tempest-VolumesSnapshotTestJSON-217259837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:29:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-c30a1333-c874-4206-8757-9c6905080d6f tempest-VolumesSnapshotTestJSON-217259837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:29:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c30a1333-c874-4206-8757-9c6905080d6f tempest-VolumesSnapshotTestJSON-217259837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:29:42 devstack sudo[97438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:29:42 devstack sudo[97438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:29:42 devstack sudo[97438]: pam_unix(sudo:session): session closed for user root Sep 28 09:29:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c30a1333-c874-4206-8757-9c6905080d6f tempest-VolumesSnapshotTestJSON-217259837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.338s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:29:42 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-c30a1333-c874-4206-8757-9c6905080d6f tempest-VolumesSnapshotTestJSON-217259837 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:29:42 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-c30a1333-c874-4206-8757-9c6905080d6f tempest-VolumesSnapshotTestJSON-217259837 None] Deleted volume successfully. Sep 28 09:29:42 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-c30a1333-c874-4206-8757-9c6905080d6f tempest-VolumesSnapshotTestJSON-217259837 None] Lock "cinder-6ee24eab-2437-42a1-8ad9-59e1696119f3-delete_volume" released by "delete_volume" :: held 1.541s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:29:42 devstack cinder-volume[86553]: INFO cinder.volume.manager [req-d5409803-2b23-419c-a83c-36a7fde8bdda req-ec16c460-57a4-4d27-915d-5ce01f383156 tempest-AttachVolumeNegativeTest-1957606009 None] Terminate volume connection completed successfully. Sep 28 09:29:42 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [req-d5409803-2b23-419c-a83c-36a7fde8bdda req-ec16c460-57a4-4d27-915d-5ce01f383156 tempest-AttachVolumeNegativeTest-1957606009 None] Deleting attachment b04e9e19-a6de-4f54-97f7-d3c3d043f115. {{(pid=86553) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 09:29:43 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-91f19a06-90ce-4889-81ed-6cc157e8bedc tempest-VolumesSnapshotTestJSON-217259837 None] Acquiring lock "cinder-9b864794-072a-4a95-84de-b09e4ea5fb37-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:29:43 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-91f19a06-90ce-4889-81ed-6cc157e8bedc tempest-VolumesSnapshotTestJSON-217259837 None] Lock "cinder-9b864794-072a-4a95-84de-b09e4ea5fb37-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:29:43 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-91f19a06-90ce-4889-81ed-6cc157e8bedc tempest-VolumesSnapshotTestJSON-217259837 None] Acquiring lock "cinder-quobyte-9b864794-072a-4a95-84de-b09e4ea5fb37" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:29:43 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-91f19a06-90ce-4889-81ed-6cc157e8bedc tempest-VolumesSnapshotTestJSON-217259837 None] Lock "cinder-quobyte-9b864794-072a-4a95-84de-b09e4ea5fb37" acquired by "delete_volume" :: waited 0.025s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:29:43 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[2face1c2-5bb9-4f97-b71b-6c40ce3c84fb]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:29:43 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-91f19a06-90ce-4889-81ed-6cc157e8bedc tempest-VolumesSnapshotTestJSON-217259837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9b864794-072a-4a95-84de-b09e4ea5fb37 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:29:43 devstack sudo[97472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9b864794-072a-4a95-84de-b09e4ea5fb37 Sep 28 09:29:43 devstack sudo[97472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:29:44 devstack sudo[97472]: pam_unix(sudo:session): session closed for user root Sep 28 09:29:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-91f19a06-90ce-4889-81ed-6cc157e8bedc tempest-VolumesSnapshotTestJSON-217259837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9b864794-072a-4a95-84de-b09e4ea5fb37" returned: 0 in 0.546s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:29:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-91f19a06-90ce-4889-81ed-6cc157e8bedc tempest-VolumesSnapshotTestJSON-217259837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9b864794-072a-4a95-84de-b09e4ea5fb37 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:29:44 devstack sudo[97477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9b864794-072a-4a95-84de-b09e4ea5fb37 Sep 28 09:29:44 devstack sudo[97477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:29:44 devstack sudo[97477]: pam_unix(sudo:session): session closed for user root Sep 28 09:29:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-91f19a06-90ce-4889-81ed-6cc157e8bedc tempest-VolumesSnapshotTestJSON-217259837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9b864794-072a-4a95-84de-b09e4ea5fb37" returned: 0 in 0.321s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:29:44 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-91f19a06-90ce-4889-81ed-6cc157e8bedc tempest-VolumesSnapshotTestJSON-217259837 None] Lock "cinder-quobyte-9b864794-072a-4a95-84de-b09e4ea5fb37" released by "delete_volume" :: held 1.018s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:29:44 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-91f19a06-90ce-4889-81ed-6cc157e8bedc tempest-VolumesSnapshotTestJSON-217259837 None] Created reservations ['60845309-71b0-44a7-ae6a-1ad04cfb63aa', 'a599f23d-624a-49c0-ab5c-a9b9a97ea868', 'b7dbd400-dc54-48fc-a4ea-46b3757eedd3', '924488aa-696f-4cd7-9a02-693525d12711'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:29:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-91f19a06-90ce-4889-81ed-6cc157e8bedc tempest-VolumesSnapshotTestJSON-217259837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:29:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-91f19a06-90ce-4889-81ed-6cc157e8bedc tempest-VolumesSnapshotTestJSON-217259837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:29:44 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-91f19a06-90ce-4889-81ed-6cc157e8bedc tempest-VolumesSnapshotTestJSON-217259837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:29:44 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-91f19a06-90ce-4889-81ed-6cc157e8bedc tempest-VolumesSnapshotTestJSON-217259837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:29:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-91f19a06-90ce-4889-81ed-6cc157e8bedc tempest-VolumesSnapshotTestJSON-217259837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:29:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-91f19a06-90ce-4889-81ed-6cc157e8bedc tempest-VolumesSnapshotTestJSON-217259837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:29:44 devstack sudo[97503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:29:44 devstack sudo[97503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:29:44 devstack sudo[97503]: pam_unix(sudo:session): session closed for user root Sep 28 09:29:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-91f19a06-90ce-4889-81ed-6cc157e8bedc tempest-VolumesSnapshotTestJSON-217259837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.253s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:29:44 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-91f19a06-90ce-4889-81ed-6cc157e8bedc tempest-VolumesSnapshotTestJSON-217259837 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:29:44 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-91f19a06-90ce-4889-81ed-6cc157e8bedc tempest-VolumesSnapshotTestJSON-217259837 None] Deleted volume successfully. Sep 28 09:29:44 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-91f19a06-90ce-4889-81ed-6cc157e8bedc tempest-VolumesSnapshotTestJSON-217259837 None] Lock "cinder-9b864794-072a-4a95-84de-b09e4ea5fb37-delete_volume" released by "delete_volume" :: held 1.640s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:29:48 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [req-cf724501-9ac6-48b6-9878-77cec6167d40 req-3aca8808-a046-4e82-bcf8-7b275b141dc9 tempest-VolumesSnapshotsTestJSON-1998005768 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:29:48 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [req-cf724501-9ac6-48b6-9878-77cec6167d40 req-3aca8808-a046-4e82-bcf8-7b275b141dc9 tempest-VolumesSnapshotsTestJSON-1998005768 None] Flow 'volume_create_manager' (27a52ac2-2bc9-45bd-ba97-4df0cc9e4759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:29:48 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [req-cf724501-9ac6-48b6-9878-77cec6167d40 req-3aca8808-a046-4e82-bcf8-7b275b141dc9 tempest-VolumesSnapshotsTestJSON-1998005768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3c85a23-1abd-418d-ba83-fb233b3b3d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:29:48 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [req-cf724501-9ac6-48b6-9878-77cec6167d40 req-3aca8808-a046-4e82-bcf8-7b275b141dc9 tempest-VolumesSnapshotsTestJSON-1998005768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3c85a23-1abd-418d-ba83-fb233b3b3d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:29:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1797487056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49d13f35-dd03-426a-93a5-236761c46999,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11c7dab0cce748b6a50ce5dd775906c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:29:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:29:48Z,use_quota=True,user_id='92774b30360f418cb284efeec9c76af8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:29:48 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [req-cf724501-9ac6-48b6-9878-77cec6167d40 req-3aca8808-a046-4e82-bcf8-7b275b141dc9 tempest-VolumesSnapshotsTestJSON-1998005768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af8b2ca5-8dbd-4cad-bf44-f5823d130d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:29:48 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [req-cf724501-9ac6-48b6-9878-77cec6167d40 req-3aca8808-a046-4e82-bcf8-7b275b141dc9 tempest-VolumesSnapshotsTestJSON-1998005768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af8b2ca5-8dbd-4cad-bf44-f5823d130d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:29:48 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [req-cf724501-9ac6-48b6-9878-77cec6167d40 req-3aca8808-a046-4e82-bcf8-7b275b141dc9 tempest-VolumesSnapshotsTestJSON-1998005768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b90ab48f-93f4-4bc9-93e4-7bdd0807ffaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:29:48 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [req-cf724501-9ac6-48b6-9878-77cec6167d40 req-3aca8808-a046-4e82-bcf8-7b275b141dc9 tempest-VolumesSnapshotsTestJSON-1998005768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b90ab48f-93f4-4bc9-93e4-7bdd0807ffaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49d13f35-dd03-426a-93a5-236761c46999', 'volume_name': 'volume-49d13f35-dd03-426a-93a5-236761c46999', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:29:48 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [req-cf724501-9ac6-48b6-9878-77cec6167d40 req-3aca8808-a046-4e82-bcf8-7b275b141dc9 tempest-VolumesSnapshotsTestJSON-1998005768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f9200d9-ca04-43c4-b179-95edc786863e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:29:48 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [req-cf724501-9ac6-48b6-9878-77cec6167d40 req-3aca8808-a046-4e82-bcf8-7b275b141dc9 tempest-VolumesSnapshotsTestJSON-1998005768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f9200d9-ca04-43c4-b179-95edc786863e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:29:48 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [req-cf724501-9ac6-48b6-9878-77cec6167d40 req-3aca8808-a046-4e82-bcf8-7b275b141dc9 tempest-VolumesSnapshotsTestJSON-1998005768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc9563ff-1c2f-44ab-af31-832c973b2893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:29:48 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [req-cf724501-9ac6-48b6-9878-77cec6167d40 req-3aca8808-a046-4e82-bcf8-7b275b141dc9 tempest-VolumesSnapshotsTestJSON-1998005768 None] Volume 49d13f35-dd03-426a-93a5-236761c46999: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49d13f35-dd03-426a-93a5-236761c46999', 'volume_size': 1} Sep 28 09:29:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-cf724501-9ac6-48b6-9878-77cec6167d40 req-3aca8808-a046-4e82-bcf8-7b275b141dc9 tempest-VolumesSnapshotsTestJSON-1998005768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:29:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-cf724501-9ac6-48b6-9878-77cec6167d40 req-3aca8808-a046-4e82-bcf8-7b275b141dc9 tempest-VolumesSnapshotsTestJSON-1998005768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:29:48 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [req-cf724501-9ac6-48b6-9878-77cec6167d40 req-3aca8808-a046-4e82-bcf8-7b275b141dc9 tempest-VolumesSnapshotsTestJSON-1998005768 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:29:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1797487056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49d13f35-dd03-426a-93a5-236761c46999,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11c7dab0cce748b6a50ce5dd775906c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:29:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:29:48Z,use_quota=True,user_id='92774b30360f418cb284efeec9c76af8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:29:48 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [req-cf724501-9ac6-48b6-9878-77cec6167d40 req-3aca8808-a046-4e82-bcf8-7b275b141dc9 tempest-VolumesSnapshotsTestJSON-1998005768 None] Creating volume 49d13f35-dd03-426a-93a5-236761c46999 {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:29:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-cf724501-9ac6-48b6-9878-77cec6167d40 req-3aca8808-a046-4e82-bcf8-7b275b141dc9 tempest-VolumesSnapshotsTestJSON-1998005768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:29:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-cf724501-9ac6-48b6-9878-77cec6167d40 req-3aca8808-a046-4e82-bcf8-7b275b141dc9 tempest-VolumesSnapshotsTestJSON-1998005768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:29:48 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [req-cf724501-9ac6-48b6-9878-77cec6167d40 req-3aca8808-a046-4e82-bcf8-7b275b141dc9 tempest-VolumesSnapshotsTestJSON-1998005768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:29:48 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [req-cf724501-9ac6-48b6-9878-77cec6167d40 req-3aca8808-a046-4e82-bcf8-7b275b141dc9 tempest-VolumesSnapshotsTestJSON-1998005768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:29:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-cf724501-9ac6-48b6-9878-77cec6167d40 req-3aca8808-a046-4e82-bcf8-7b275b141dc9 tempest-VolumesSnapshotsTestJSON-1998005768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:29:48 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [req-cf724501-9ac6-48b6-9878-77cec6167d40 req-3aca8808-a046-4e82-bcf8-7b275b141dc9 tempest-VolumesSnapshotsTestJSON-1998005768 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:29:48 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [req-cf724501-9ac6-48b6-9878-77cec6167d40 req-3aca8808-a046-4e82-bcf8-7b275b141dc9 tempest-VolumesSnapshotsTestJSON-1998005768 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:29:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [req-cf724501-9ac6-48b6-9878-77cec6167d40 req-3aca8808-a046-4e82-bcf8-7b275b141dc9 tempest-VolumesSnapshotsTestJSON-1998005768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-49d13f35-dd03-426a-93a5-236761c46999 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:29:48 devstack sudo[97513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-49d13f35-dd03-426a-93a5-236761c46999 1073741824 Sep 28 09:29:48 devstack sudo[97513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:29:48 devstack sudo[97513]: pam_unix(sudo:session): session closed for user root Sep 28 09:29:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [req-cf724501-9ac6-48b6-9878-77cec6167d40 req-3aca8808-a046-4e82-bcf8-7b275b141dc9 tempest-VolumesSnapshotsTestJSON-1998005768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-49d13f35-dd03-426a-93a5-236761c46999 1073741824" returned: 0 in 0.542s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:29:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [req-cf724501-9ac6-48b6-9878-77cec6167d40 req-3aca8808-a046-4e82-bcf8-7b275b141dc9 tempest-VolumesSnapshotsTestJSON-1998005768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-49d13f35-dd03-426a-93a5-236761c46999 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:29:49 devstack sudo[97519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-49d13f35-dd03-426a-93a5-236761c46999 Sep 28 09:29:49 devstack sudo[97519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:29:49 devstack sudo[97519]: pam_unix(sudo:session): session closed for user root Sep 28 09:29:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [req-cf724501-9ac6-48b6-9878-77cec6167d40 req-3aca8808-a046-4e82-bcf8-7b275b141dc9 tempest-VolumesSnapshotsTestJSON-1998005768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-49d13f35-dd03-426a-93a5-236761c46999" returned: 0 in 0.357s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:29:49 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [req-cf724501-9ac6-48b6-9878-77cec6167d40 req-3aca8808-a046-4e82-bcf8-7b275b141dc9 tempest-VolumesSnapshotsTestJSON-1998005768 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:29:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-cf724501-9ac6-48b6-9878-77cec6167d40 req-3aca8808-a046-4e82-bcf8-7b275b141dc9 tempest-VolumesSnapshotsTestJSON-1998005768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:29:49 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [req-cf724501-9ac6-48b6-9878-77cec6167d40 req-3aca8808-a046-4e82-bcf8-7b275b141dc9 tempest-VolumesSnapshotsTestJSON-1998005768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc9563ff-1c2f-44ab-af31-832c973b2893) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49d13f35-dd03-426a-93a5-236761c46999', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:29:49 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [req-cf724501-9ac6-48b6-9878-77cec6167d40 req-3aca8808-a046-4e82-bcf8-7b275b141dc9 tempest-VolumesSnapshotsTestJSON-1998005768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1223acd-666f-4d00-9f43-19d7d2a4ef73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:29:49 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [req-cf724501-9ac6-48b6-9878-77cec6167d40 req-3aca8808-a046-4e82-bcf8-7b275b141dc9 tempest-VolumesSnapshotsTestJSON-1998005768 None] Volume volume-49d13f35-dd03-426a-93a5-236761c46999 (49d13f35-dd03-426a-93a5-236761c46999): created successfully Sep 28 09:29:49 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [req-cf724501-9ac6-48b6-9878-77cec6167d40 req-3aca8808-a046-4e82-bcf8-7b275b141dc9 tempest-VolumesSnapshotsTestJSON-1998005768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1223acd-666f-4d00-9f43-19d7d2a4ef73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:29:49 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [req-cf724501-9ac6-48b6-9878-77cec6167d40 req-3aca8808-a046-4e82-bcf8-7b275b141dc9 tempest-VolumesSnapshotsTestJSON-1998005768 None] Flow 'volume_create_manager' (27a52ac2-2bc9-45bd-ba97-4df0cc9e4759) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:29:49 devstack cinder-volume[86553]: INFO cinder.volume.manager [req-cf724501-9ac6-48b6-9878-77cec6167d40 req-3aca8808-a046-4e82-bcf8-7b275b141dc9 tempest-VolumesSnapshotsTestJSON-1998005768 None] Created volume successfully. Sep 28 09:29:49 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-2a72d0ab-b67d-401a-9a78-cd2e8c462264 tempest-AttachVolumeNegativeTest-1957606009 None] Acquiring lock "cinder-8cf15566-7c57-4964-a4cd-3dcfb97b1c5e-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:29:49 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-2a72d0ab-b67d-401a-9a78-cd2e8c462264 tempest-AttachVolumeNegativeTest-1957606009 None] Lock "cinder-8cf15566-7c57-4964-a4cd-3dcfb97b1c5e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:29:49 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-2a72d0ab-b67d-401a-9a78-cd2e8c462264 tempest-AttachVolumeNegativeTest-1957606009 None] Acquiring lock "cinder-quobyte-8cf15566-7c57-4964-a4cd-3dcfb97b1c5e" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:29:49 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-2a72d0ab-b67d-401a-9a78-cd2e8c462264 tempest-AttachVolumeNegativeTest-1957606009 None] Lock "cinder-quobyte-8cf15566-7c57-4964-a4cd-3dcfb97b1c5e" acquired by "delete_volume" :: waited 0.023s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:29:49 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f3c4df-6ba9-41ac-96ad-3fcaa67f0387]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:29:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2a72d0ab-b67d-401a-9a78-cd2e8c462264 tempest-AttachVolumeNegativeTest-1957606009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-8cf15566-7c57-4964-a4cd-3dcfb97b1c5e {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:29:50 devstack sudo[97522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-8cf15566-7c57-4964-a4cd-3dcfb97b1c5e Sep 28 09:29:50 devstack sudo[97522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:29:50 devstack sudo[97522]: pam_unix(sudo:session): session closed for user root Sep 28 09:29:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2a72d0ab-b67d-401a-9a78-cd2e8c462264 tempest-AttachVolumeNegativeTest-1957606009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-8cf15566-7c57-4964-a4cd-3dcfb97b1c5e" returned: 0 in 0.390s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:29:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2a72d0ab-b67d-401a-9a78-cd2e8c462264 tempest-AttachVolumeNegativeTest-1957606009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-8cf15566-7c57-4964-a4cd-3dcfb97b1c5e {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:29:50 devstack sudo[97527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-8cf15566-7c57-4964-a4cd-3dcfb97b1c5e Sep 28 09:29:50 devstack sudo[97527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:29:50 devstack sudo[97527]: pam_unix(sudo:session): session closed for user root Sep 28 09:29:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2a72d0ab-b67d-401a-9a78-cd2e8c462264 tempest-AttachVolumeNegativeTest-1957606009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-8cf15566-7c57-4964-a4cd-3dcfb97b1c5e" returned: 0 in 0.295s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:29:50 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-2a72d0ab-b67d-401a-9a78-cd2e8c462264 tempest-AttachVolumeNegativeTest-1957606009 None] Lock "cinder-quobyte-8cf15566-7c57-4964-a4cd-3dcfb97b1c5e" released by "delete_volume" :: held 0.745s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:29:50 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-2a72d0ab-b67d-401a-9a78-cd2e8c462264 tempest-AttachVolumeNegativeTest-1957606009 None] Created reservations ['94b5a5f3-6c49-47ab-a973-d9176f25914e', '55f5c5b7-a8df-42ea-a5a7-7e75da3b0be9', 'f79ead7c-7e6c-4e85-b344-6d9f2c415200', '52a5d45f-923c-412b-af48-f2ced37eefdb'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:29:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-8553ec61-b43e-406d-b34e-71eee44d33ca req-acb4905c-98d5-4299-b96f-598881f4e835 tempest-VolumesSnapshotsTestJSON-1998005768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:29:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-8553ec61-b43e-406d-b34e-71eee44d33ca req-acb4905c-98d5-4299-b96f-598881f4e835 tempest-VolumesSnapshotsTestJSON-1998005768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:29:50 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [req-8553ec61-b43e-406d-b34e-71eee44d33ca req-acb4905c-98d5-4299-b96f-598881f4e835 tempest-VolumesSnapshotsTestJSON-1998005768 None] Creating offline snapshot e4b6a7af-79e8-4cc0-8df6-fe261705a663 of volume 49d13f35-dd03-426a-93a5-236761c46999 {{(pid=86553) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 09:29:50 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[14474e5f-73ab-483a-b8e7-b60a7afd78fe]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:29:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [req-8553ec61-b43e-406d-b34e-71eee44d33ca req-acb4905c-98d5-4299-b96f-598881f4e835 tempest-VolumesSnapshotsTestJSON-1998005768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-49d13f35-dd03-426a-93a5-236761c46999 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:29:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-2a72d0ab-b67d-401a-9a78-cd2e8c462264 tempest-AttachVolumeNegativeTest-1957606009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:29:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-2a72d0ab-b67d-401a-9a78-cd2e8c462264 tempest-AttachVolumeNegativeTest-1957606009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:29:50 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-2a72d0ab-b67d-401a-9a78-cd2e8c462264 tempest-AttachVolumeNegativeTest-1957606009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:29:50 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-2a72d0ab-b67d-401a-9a78-cd2e8c462264 tempest-AttachVolumeNegativeTest-1957606009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:29:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-2a72d0ab-b67d-401a-9a78-cd2e8c462264 tempest-AttachVolumeNegativeTest-1957606009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:29:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2a72d0ab-b67d-401a-9a78-cd2e8c462264 tempest-AttachVolumeNegativeTest-1957606009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:29:50 devstack sudo[97531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:29:50 devstack sudo[97531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:29:51 devstack sudo[97530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-49d13f35-dd03-426a-93a5-236761c46999 Sep 28 09:29:51 devstack sudo[97530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:29:51 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-92f6a0c8-5082-4b7e-8d6b-66f0d6075fdd tempest-AttachVolumeNegativeTest-1957606009 None] Acquiring lock "cinder-f38a184e-5427-40e2-a344-c19b2976ba15-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:29:51 devstack sudo[97531]: pam_unix(sudo:session): session closed for user root Sep 28 09:29:51 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2a72d0ab-b67d-401a-9a78-cd2e8c462264 tempest-AttachVolumeNegativeTest-1957606009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.342s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:29:51 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-2a72d0ab-b67d-401a-9a78-cd2e8c462264 tempest-AttachVolumeNegativeTest-1957606009 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:29:51 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-92f6a0c8-5082-4b7e-8d6b-66f0d6075fdd tempest-AttachVolumeNegativeTest-1957606009 None] Lock "cinder-f38a184e-5427-40e2-a344-c19b2976ba15-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:29:51 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-2a72d0ab-b67d-401a-9a78-cd2e8c462264 tempest-AttachVolumeNegativeTest-1957606009 None] Deleted volume successfully. Sep 28 09:29:51 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-2a72d0ab-b67d-401a-9a78-cd2e8c462264 tempest-AttachVolumeNegativeTest-1957606009 None] Lock "cinder-8cf15566-7c57-4964-a4cd-3dcfb97b1c5e-delete_volume" released by "delete_volume" :: held 1.523s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:29:51 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-92f6a0c8-5082-4b7e-8d6b-66f0d6075fdd tempest-AttachVolumeNegativeTest-1957606009 None] Acquiring lock "cinder-quobyte-f38a184e-5427-40e2-a344-c19b2976ba15" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:29:51 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-92f6a0c8-5082-4b7e-8d6b-66f0d6075fdd tempest-AttachVolumeNegativeTest-1957606009 None] Lock "cinder-quobyte-f38a184e-5427-40e2-a344-c19b2976ba15" acquired by "delete_volume" :: waited 0.022s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:29:51 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[795c39e0-1e58-406e-8c5f-b41a2cac4923]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:29:51 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-92f6a0c8-5082-4b7e-8d6b-66f0d6075fdd tempest-AttachVolumeNegativeTest-1957606009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f38a184e-5427-40e2-a344-c19b2976ba15 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:29:51 devstack sudo[97530]: pam_unix(sudo:session): session closed for user root Sep 28 09:29:51 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [req-8553ec61-b43e-406d-b34e-71eee44d33ca req-acb4905c-98d5-4299-b96f-598881f4e835 tempest-VolumesSnapshotsTestJSON-1998005768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-49d13f35-dd03-426a-93a5-236761c46999" returned: 0 in 0.677s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:29:51 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [req-8553ec61-b43e-406d-b34e-71eee44d33ca req-acb4905c-98d5-4299-b96f-598881f4e835 tempest-VolumesSnapshotsTestJSON-1998005768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-49d13f35-dd03-426a-93a5-236761c46999,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-49d13f35-dd03-426a-93a5-236761c46999.e4b6a7af-79e8-4cc0-8df6-fe261705a663 1G {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:29:51 devstack sudo[97536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f38a184e-5427-40e2-a344-c19b2976ba15 Sep 28 09:29:51 devstack sudo[97536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:29:51 devstack sudo[97539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-49d13f35-dd03-426a-93a5-236761c46999,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-49d13f35-dd03-426a-93a5-236761c46999.e4b6a7af-79e8-4cc0-8df6-fe261705a663 1G Sep 28 09:29:51 devstack sudo[97539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:29:51 devstack sudo[97536]: pam_unix(sudo:session): session closed for user root Sep 28 09:29:51 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-92f6a0c8-5082-4b7e-8d6b-66f0d6075fdd tempest-AttachVolumeNegativeTest-1957606009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f38a184e-5427-40e2-a344-c19b2976ba15" returned: 0 in 0.598s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:29:51 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-92f6a0c8-5082-4b7e-8d6b-66f0d6075fdd tempest-AttachVolumeNegativeTest-1957606009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f38a184e-5427-40e2-a344-c19b2976ba15 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:29:52 devstack sudo[97549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f38a184e-5427-40e2-a344-c19b2976ba15 Sep 28 09:29:52 devstack sudo[97549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:29:52 devstack sudo[97539]: pam_unix(sudo:session): session closed for user root Sep 28 09:29:52 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [req-8553ec61-b43e-406d-b34e-71eee44d33ca req-acb4905c-98d5-4299-b96f-598881f4e835 tempest-VolumesSnapshotsTestJSON-1998005768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-49d13f35-dd03-426a-93a5-236761c46999,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-49d13f35-dd03-426a-93a5-236761c46999.e4b6a7af-79e8-4cc0-8df6-fe261705a663 1G" returned: 0 in 0.570s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:29:52 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [req-8553ec61-b43e-406d-b34e-71eee44d33ca req-acb4905c-98d5-4299-b96f-598881f4e835 tempest-VolumesSnapshotsTestJSON-1998005768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49d13f35-dd03-426a-93a5-236761c46999 -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-49d13f35-dd03-426a-93a5-236761c46999.e4b6a7af-79e8-4cc0-8df6-fe261705a663 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:29:52 devstack sudo[97552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49d13f35-dd03-426a-93a5-236761c46999 -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-49d13f35-dd03-426a-93a5-236761c46999.e4b6a7af-79e8-4cc0-8df6-fe261705a663 Sep 28 09:29:52 devstack sudo[97552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:29:52 devstack sudo[97549]: pam_unix(sudo:session): session closed for user root Sep 28 09:29:52 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-92f6a0c8-5082-4b7e-8d6b-66f0d6075fdd tempest-AttachVolumeNegativeTest-1957606009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f38a184e-5427-40e2-a344-c19b2976ba15" returned: 0 in 0.343s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:29:52 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-92f6a0c8-5082-4b7e-8d6b-66f0d6075fdd tempest-AttachVolumeNegativeTest-1957606009 None] Lock "cinder-quobyte-f38a184e-5427-40e2-a344-c19b2976ba15" released by "delete_volume" :: held 1.009s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:29:52 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-92f6a0c8-5082-4b7e-8d6b-66f0d6075fdd tempest-AttachVolumeNegativeTest-1957606009 None] Created reservations ['b1fde526-3ff0-49cb-a700-771e2238378f', 'cd7ecde7-4604-4108-9033-96c1b6b95f04', '0b1c91ad-bff1-4355-a459-20fc41968d46', '7d47a7d2-e70b-44f3-833a-8b676ddd43a9'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:29:52 devstack sudo[97552]: pam_unix(sudo:session): session closed for user root Sep 28 09:29:52 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [req-8553ec61-b43e-406d-b34e-71eee44d33ca req-acb4905c-98d5-4299-b96f-598881f4e835 tempest-VolumesSnapshotsTestJSON-1998005768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49d13f35-dd03-426a-93a5-236761c46999 -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-49d13f35-dd03-426a-93a5-236761c46999.e4b6a7af-79e8-4cc0-8df6-fe261705a663" returned: 0 in 0.383s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:29:52 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [req-8553ec61-b43e-406d-b34e-71eee44d33ca req-acb4905c-98d5-4299-b96f-598881f4e835 tempest-VolumesSnapshotsTestJSON-1998005768 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-49d13f35-dd03-426a-93a5-236761c46999.e4b6a7af-79e8-4cc0-8df6-fe261705a663 is being set with open permissions: ugo+rw Sep 28 09:29:52 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [req-8553ec61-b43e-406d-b34e-71eee44d33ca req-acb4905c-98d5-4299-b96f-598881f4e835 tempest-VolumesSnapshotsTestJSON-1998005768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-49d13f35-dd03-426a-93a5-236761c46999.e4b6a7af-79e8-4cc0-8df6-fe261705a663 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:29:52 devstack sudo[97559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-49d13f35-dd03-426a-93a5-236761c46999.e4b6a7af-79e8-4cc0-8df6-fe261705a663 Sep 28 09:29:52 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-92f6a0c8-5082-4b7e-8d6b-66f0d6075fdd tempest-AttachVolumeNegativeTest-1957606009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:29:52 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-92f6a0c8-5082-4b7e-8d6b-66f0d6075fdd tempest-AttachVolumeNegativeTest-1957606009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:29:52 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-92f6a0c8-5082-4b7e-8d6b-66f0d6075fdd tempest-AttachVolumeNegativeTest-1957606009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:29:52 devstack sudo[97559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:29:52 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-92f6a0c8-5082-4b7e-8d6b-66f0d6075fdd tempest-AttachVolumeNegativeTest-1957606009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:29:52 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-92f6a0c8-5082-4b7e-8d6b-66f0d6075fdd tempest-AttachVolumeNegativeTest-1957606009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:29:52 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-92f6a0c8-5082-4b7e-8d6b-66f0d6075fdd tempest-AttachVolumeNegativeTest-1957606009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:29:52 devstack sudo[97561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:29:52 devstack sudo[97561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:29:52 devstack sudo[97559]: pam_unix(sudo:session): session closed for user root Sep 28 09:29:52 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [req-8553ec61-b43e-406d-b34e-71eee44d33ca req-acb4905c-98d5-4299-b96f-598881f4e835 tempest-VolumesSnapshotsTestJSON-1998005768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-49d13f35-dd03-426a-93a5-236761c46999.e4b6a7af-79e8-4cc0-8df6-fe261705a663" returned: 0 in 0.401s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:29:52 devstack sudo[97561]: pam_unix(sudo:session): session closed for user root Sep 28 09:29:52 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-92f6a0c8-5082-4b7e-8d6b-66f0d6075fdd tempest-AttachVolumeNegativeTest-1957606009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.358s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:29:52 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-92f6a0c8-5082-4b7e-8d6b-66f0d6075fdd tempest-AttachVolumeNegativeTest-1957606009 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:29:52 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-92f6a0c8-5082-4b7e-8d6b-66f0d6075fdd tempest-AttachVolumeNegativeTest-1957606009 None] Deleted volume successfully. Sep 28 09:29:52 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-92f6a0c8-5082-4b7e-8d6b-66f0d6075fdd tempest-AttachVolumeNegativeTest-1957606009 None] Lock "cinder-f38a184e-5427-40e2-a344-c19b2976ba15-delete_volume" released by "delete_volume" :: held 1.693s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:29:52 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [req-8553ec61-b43e-406d-b34e-71eee44d33ca req-acb4905c-98d5-4299-b96f-598881f4e835 tempest-VolumesSnapshotsTestJSON-1998005768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-49d13f35-dd03-426a-93a5-236761c46999.info {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:29:52 devstack sudo[97565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-49d13f35-dd03-426a-93a5-236761c46999.info Sep 28 09:29:52 devstack sudo[97565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:29:53 devstack sudo[97565]: pam_unix(sudo:session): session closed for user root Sep 28 09:29:53 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [req-8553ec61-b43e-406d-b34e-71eee44d33ca req-acb4905c-98d5-4299-b96f-598881f4e835 tempest-VolumesSnapshotsTestJSON-1998005768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-49d13f35-dd03-426a-93a5-236761c46999.info" returned: 0 in 0.274s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:29:53 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [req-8553ec61-b43e-406d-b34e-71eee44d33ca req-acb4905c-98d5-4299-b96f-598881f4e835 tempest-VolumesSnapshotsTestJSON-1998005768 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-49d13f35-dd03-426a-93a5-236761c46999.info is being set with open permissions: ugo+rw Sep 28 09:29:53 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [req-8553ec61-b43e-406d-b34e-71eee44d33ca req-acb4905c-98d5-4299-b96f-598881f4e835 tempest-VolumesSnapshotsTestJSON-1998005768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-49d13f35-dd03-426a-93a5-236761c46999.info {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:29:53 devstack sudo[97568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-49d13f35-dd03-426a-93a5-236761c46999.info Sep 28 09:29:53 devstack sudo[97568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:29:53 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-016f9650-470d-4571-a55c-75ecda243ee2 tempest-GroupSnapshotsTest-66536182 None] Group tempest-GroupSnapshotsTest-Group-1156690909: creating Sep 28 09:29:53 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-016f9650-470d-4571-a55c-75ecda243ee2 tempest-GroupSnapshotsTest-66536182 None] Group tempest-GroupSnapshotsTest-Group-1156690909: created successfully Sep 28 09:29:53 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-016f9650-470d-4571-a55c-75ecda243ee2 tempest-GroupSnapshotsTest-66536182 None] Create group completed successfully. Sep 28 09:29:53 devstack sudo[97568]: pam_unix(sudo:session): session closed for user root Sep 28 09:29:53 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [req-8553ec61-b43e-406d-b34e-71eee44d33ca req-acb4905c-98d5-4299-b96f-598881f4e835 tempest-VolumesSnapshotsTestJSON-1998005768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-49d13f35-dd03-426a-93a5-236761c46999.info" returned: 0 in 0.325s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:29:53 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-8553ec61-b43e-406d-b34e-71eee44d33ca req-acb4905c-98d5-4299-b96f-598881f4e835 tempest-VolumesSnapshotsTestJSON-1998005768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.770s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:29:53 devstack cinder-volume[86553]: INFO cinder.volume.manager [req-8553ec61-b43e-406d-b34e-71eee44d33ca req-acb4905c-98d5-4299-b96f-598881f4e835 tempest-VolumesSnapshotsTestJSON-1998005768 None] Create snapshot completed successfully Sep 28 09:29:53 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-7d8d3a77-8b49-4ccb-9319-1fbb226f9033 tempest-AttachVolumeNegativeTest-1957606009 None] Acquiring lock "cinder-60f61781-9f97-4d66-99bc-0b097e7f349f-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:29:53 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-7d8d3a77-8b49-4ccb-9319-1fbb226f9033 tempest-AttachVolumeNegativeTest-1957606009 None] Lock "cinder-60f61781-9f97-4d66-99bc-0b097e7f349f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:29:53 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-7d8d3a77-8b49-4ccb-9319-1fbb226f9033 tempest-AttachVolumeNegativeTest-1957606009 None] Acquiring lock "cinder-quobyte-60f61781-9f97-4d66-99bc-0b097e7f349f" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:29:53 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-7d8d3a77-8b49-4ccb-9319-1fbb226f9033 tempest-AttachVolumeNegativeTest-1957606009 None] Lock "cinder-quobyte-60f61781-9f97-4d66-99bc-0b097e7f349f" acquired by "delete_volume" :: waited 0.021s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:29:53 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe78d7e7-d20c-447c-89b3-2b3e7c024b20]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:29:53 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-7d8d3a77-8b49-4ccb-9319-1fbb226f9033 tempest-AttachVolumeNegativeTest-1957606009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-60f61781-9f97-4d66-99bc-0b097e7f349f {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:29:53 devstack cinder-volume[86553]: DEBUG cinder.coordination [req-a13c2a4c-7904-417b-8668-a5e3c257ffa9 req-66512b0b-a9ad-492f-a0d3-0bb9e8b0408e tempest-VolumesSnapshotsTestJSON-1998005768 None] Acquiring lock "cinder-e4b6a7af-79e8-4cc0-8df6-fe261705a663-delete_snapshot" by "delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:29:53 devstack cinder-volume[86553]: DEBUG cinder.coordination [req-a13c2a4c-7904-417b-8668-a5e3c257ffa9 req-66512b0b-a9ad-492f-a0d3-0bb9e8b0408e tempest-VolumesSnapshotsTestJSON-1998005768 None] Lock "cinder-e4b6a7af-79e8-4cc0-8df6-fe261705a663-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:29:53 devstack cinder-volume[86553]: DEBUG cinder.coordination [req-a13c2a4c-7904-417b-8668-a5e3c257ffa9 req-66512b0b-a9ad-492f-a0d3-0bb9e8b0408e tempest-VolumesSnapshotsTestJSON-1998005768 None] Acquiring lock "cinder-quobyte-49d13f35-dd03-426a-93a5-236761c46999" by "delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:29:53 devstack sudo[97571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-60f61781-9f97-4d66-99bc-0b097e7f349f Sep 28 09:29:53 devstack sudo[97571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:29:53 devstack cinder-volume[86553]: DEBUG cinder.coordination [req-a13c2a4c-7904-417b-8668-a5e3c257ffa9 req-66512b0b-a9ad-492f-a0d3-0bb9e8b0408e tempest-VolumesSnapshotsTestJSON-1998005768 None] Lock "cinder-quobyte-49d13f35-dd03-426a-93a5-236761c46999" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:29:53 devstack cinder-volume[86553]: DEBUG cinder.coordination [req-a13c2a4c-7904-417b-8668-a5e3c257ffa9 req-66512b0b-a9ad-492f-a0d3-0bb9e8b0408e tempest-VolumesSnapshotsTestJSON-1998005768 None] Acquiring lock "cinder-quobyte-e4b6a7af-79e8-4cc0-8df6-fe261705a663" by "_delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:29:53 devstack cinder-volume[86553]: DEBUG cinder.coordination [req-a13c2a4c-7904-417b-8668-a5e3c257ffa9 req-66512b0b-a9ad-492f-a0d3-0bb9e8b0408e tempest-VolumesSnapshotsTestJSON-1998005768 None] Lock "cinder-quobyte-e4b6a7af-79e8-4cc0-8df6-fe261705a663" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:29:53 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [req-a13c2a4c-7904-417b-8668-a5e3c257ffa9 req-66512b0b-a9ad-492f-a0d3-0bb9e8b0408e tempest-VolumesSnapshotsTestJSON-1998005768 None] Deleting offline snapshot e4b6a7af-79e8-4cc0-8df6-fe261705a663 of volume 49d13f35-dd03-426a-93a5-236761c46999 {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 09:29:54 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [req-a13c2a4c-7904-417b-8668-a5e3c257ffa9 req-66512b0b-a9ad-492f-a0d3-0bb9e8b0408e tempest-VolumesSnapshotsTestJSON-1998005768 None] snapshot_file for this snap is: volume-49d13f35-dd03-426a-93a5-236761c46999.e4b6a7af-79e8-4cc0-8df6-fe261705a663 {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 09:29:54 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[af206cb7-6808-4277-b465-a0893a6cc119]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:29:54 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [req-a13c2a4c-7904-417b-8668-a5e3c257ffa9 req-66512b0b-a9ad-492f-a0d3-0bb9e8b0408e tempest-VolumesSnapshotsTestJSON-1998005768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-49d13f35-dd03-426a-93a5-236761c46999.e4b6a7af-79e8-4cc0-8df6-fe261705a663 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:29:54 devstack sudo[97573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-49d13f35-dd03-426a-93a5-236761c46999.e4b6a7af-79e8-4cc0-8df6-fe261705a663 Sep 28 09:29:54 devstack sudo[97573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:29:54 devstack sudo[97571]: pam_unix(sudo:session): session closed for user root Sep 28 09:29:54 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-7d8d3a77-8b49-4ccb-9319-1fbb226f9033 tempest-AttachVolumeNegativeTest-1957606009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-60f61781-9f97-4d66-99bc-0b097e7f349f" returned: 0 in 0.379s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:29:54 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-7d8d3a77-8b49-4ccb-9319-1fbb226f9033 tempest-AttachVolumeNegativeTest-1957606009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-60f61781-9f97-4d66-99bc-0b097e7f349f {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:29:54 devstack sudo[97579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-60f61781-9f97-4d66-99bc-0b097e7f349f Sep 28 09:29:54 devstack sudo[97579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:29:54 devstack sudo[97573]: pam_unix(sudo:session): session closed for user root Sep 28 09:29:54 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [req-a13c2a4c-7904-417b-8668-a5e3c257ffa9 req-66512b0b-a9ad-492f-a0d3-0bb9e8b0408e tempest-VolumesSnapshotsTestJSON-1998005768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-49d13f35-dd03-426a-93a5-236761c46999.e4b6a7af-79e8-4cc0-8df6-fe261705a663" returned: 0 in 0.393s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:29:54 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [req-a13c2a4c-7904-417b-8668-a5e3c257ffa9 req-66512b0b-a9ad-492f-a0d3-0bb9e8b0408e tempest-VolumesSnapshotsTestJSON-1998005768 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-49d13f35-dd03-426a-93a5-236761c46999(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86553) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 09:29:54 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[70fae4f2-889e-4b56-9b69-0b29c8f7a2e8]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:29:54 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [req-a13c2a4c-7904-417b-8668-a5e3c257ffa9 req-66512b0b-a9ad-492f-a0d3-0bb9e8b0408e tempest-VolumesSnapshotsTestJSON-1998005768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-49d13f35-dd03-426a-93a5-236761c46999 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:29:54 devstack sudo[97579]: pam_unix(sudo:session): session closed for user root Sep 28 09:29:54 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-7d8d3a77-8b49-4ccb-9319-1fbb226f9033 tempest-AttachVolumeNegativeTest-1957606009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-60f61781-9f97-4d66-99bc-0b097e7f349f" returned: 0 in 0.301s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:29:54 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-7d8d3a77-8b49-4ccb-9319-1fbb226f9033 tempest-AttachVolumeNegativeTest-1957606009 None] Lock "cinder-quobyte-60f61781-9f97-4d66-99bc-0b097e7f349f" released by "delete_volume" :: held 0.732s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:29:54 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-7d8d3a77-8b49-4ccb-9319-1fbb226f9033 tempest-AttachVolumeNegativeTest-1957606009 None] Created reservations ['89b66f72-0902-437d-b4f1-a00a47f4733d', '8dabe100-4da5-45a3-ac90-5b3d6b305bde', '33b418d9-1124-4059-a6d1-817b6536db5c', 'af1a9a4b-c930-4a99-955b-5c1083f98eb0'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:29:54 devstack sudo[97585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-49d13f35-dd03-426a-93a5-236761c46999 Sep 28 09:29:54 devstack sudo[97585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:29:54 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-7d8d3a77-8b49-4ccb-9319-1fbb226f9033 tempest-AttachVolumeNegativeTest-1957606009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:29:54 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-7d8d3a77-8b49-4ccb-9319-1fbb226f9033 tempest-AttachVolumeNegativeTest-1957606009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:29:54 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-7d8d3a77-8b49-4ccb-9319-1fbb226f9033 tempest-AttachVolumeNegativeTest-1957606009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:29:54 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-7d8d3a77-8b49-4ccb-9319-1fbb226f9033 tempest-AttachVolumeNegativeTest-1957606009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:29:54 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-7d8d3a77-8b49-4ccb-9319-1fbb226f9033 tempest-AttachVolumeNegativeTest-1957606009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:29:54 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-7d8d3a77-8b49-4ccb-9319-1fbb226f9033 tempest-AttachVolumeNegativeTest-1957606009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:29:54 devstack sudo[97587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:29:54 devstack sudo[97587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:29:54 devstack sudo[97585]: pam_unix(sudo:session): session closed for user root Sep 28 09:29:54 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [req-a13c2a4c-7904-417b-8668-a5e3c257ffa9 req-66512b0b-a9ad-492f-a0d3-0bb9e8b0408e tempest-VolumesSnapshotsTestJSON-1998005768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-49d13f35-dd03-426a-93a5-236761c46999" returned: 0 in 0.499s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:29:54 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [req-a13c2a4c-7904-417b-8668-a5e3c257ffa9 req-66512b0b-a9ad-492f-a0d3-0bb9e8b0408e tempest-VolumesSnapshotsTestJSON-1998005768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-49d13f35-dd03-426a-93a5-236761c46999.e4b6a7af-79e8-4cc0-8df6-fe261705a663 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:29:55 devstack sudo[97593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-49d13f35-dd03-426a-93a5-236761c46999.e4b6a7af-79e8-4cc0-8df6-fe261705a663 Sep 28 09:29:55 devstack sudo[97593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:29:55 devstack sudo[97587]: pam_unix(sudo:session): session closed for user root Sep 28 09:29:55 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-7d8d3a77-8b49-4ccb-9319-1fbb226f9033 tempest-AttachVolumeNegativeTest-1957606009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.350s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:29:55 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-7d8d3a77-8b49-4ccb-9319-1fbb226f9033 tempest-AttachVolumeNegativeTest-1957606009 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:29:55 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-7d8d3a77-8b49-4ccb-9319-1fbb226f9033 tempest-AttachVolumeNegativeTest-1957606009 None] Deleted volume successfully. Sep 28 09:29:55 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-7d8d3a77-8b49-4ccb-9319-1fbb226f9033 tempest-AttachVolumeNegativeTest-1957606009 None] Lock "cinder-60f61781-9f97-4d66-99bc-0b097e7f349f-delete_volume" released by "delete_volume" :: held 1.373s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:29:55 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-0baa4b53-1761-4da5-90e5-6e6c31ed76ff tempest-GroupSnapshotsTest-66536182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:29:55 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0baa4b53-1761-4da5-90e5-6e6c31ed76ff tempest-GroupSnapshotsTest-66536182 None] Flow 'volume_create_manager' (c0ce6e07-58be-4454-913c-e2b7f51f7ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:29:55 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0baa4b53-1761-4da5-90e5-6e6c31ed76ff tempest-GroupSnapshotsTest-66536182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a234b286-7943-47ff-afd3-7e3206d808f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:29:55 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0baa4b53-1761-4da5-90e5-6e6c31ed76ff tempest-GroupSnapshotsTest-66536182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a234b286-7943-47ff-afd3-7e3206d808f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:29:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1051704688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fd9017a9-54f7-4e64-a775-5d21a6a43269,host='devstack@QuobyteHD#QuobyteHD',id=3d167427-800f-4ea9-a81b-2413a90f56ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='964f6f31e07341aeb603b37fc019071c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:29:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:29:55Z,use_quota=True,user_id='51bf61d870194f83b9e7a4290b47b9cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a724be54-dd10-4caa-90f0-55052bc7043d),volume_type_id=a724be54-dd10-4caa-90f0-55052bc7043d)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:29:55 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0baa4b53-1761-4da5-90e5-6e6c31ed76ff tempest-GroupSnapshotsTest-66536182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4f1ddd5-682c-4b14-9e81-1dded58600a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:29:55 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0baa4b53-1761-4da5-90e5-6e6c31ed76ff tempest-GroupSnapshotsTest-66536182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4f1ddd5-682c-4b14-9e81-1dded58600a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:29:55 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0baa4b53-1761-4da5-90e5-6e6c31ed76ff tempest-GroupSnapshotsTest-66536182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7797151-d1b6-46db-bd6e-03e660ee44b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:29:55 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0baa4b53-1761-4da5-90e5-6e6c31ed76ff tempest-GroupSnapshotsTest-66536182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7797151-d1b6-46db-bd6e-03e660ee44b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d167427-800f-4ea9-a81b-2413a90f56ae', 'volume_name': 'volume-3d167427-800f-4ea9-a81b-2413a90f56ae', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:29:55 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0baa4b53-1761-4da5-90e5-6e6c31ed76ff tempest-GroupSnapshotsTest-66536182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40eada66-e82f-4cb4-8ebf-81f094e6452e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:29:55 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0baa4b53-1761-4da5-90e5-6e6c31ed76ff tempest-GroupSnapshotsTest-66536182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40eada66-e82f-4cb4-8ebf-81f094e6452e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:29:55 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0baa4b53-1761-4da5-90e5-6e6c31ed76ff tempest-GroupSnapshotsTest-66536182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d85dc0dd-4dd3-4df9-a2ff-fbc5c3cc8dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:29:55 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-0baa4b53-1761-4da5-90e5-6e6c31ed76ff tempest-GroupSnapshotsTest-66536182 None] Volume 3d167427-800f-4ea9-a81b-2413a90f56ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d167427-800f-4ea9-a81b-2413a90f56ae', 'volume_size': 1} Sep 28 09:29:55 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-0baa4b53-1761-4da5-90e5-6e6c31ed76ff tempest-GroupSnapshotsTest-66536182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:29:55 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-0baa4b53-1761-4da5-90e5-6e6c31ed76ff tempest-GroupSnapshotsTest-66536182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:29:55 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-0baa4b53-1761-4da5-90e5-6e6c31ed76ff tempest-GroupSnapshotsTest-66536182 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=fd9017a9-54f7-4e64-a775-5d21a6a43269,created_at=2026-09-28T07:29:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1051704688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fd9017a9-54f7-4e64-a775-5d21a6a43269,host='devstack@QuobyteHD#QuobyteHD',id=3d167427-800f-4ea9-a81b-2413a90f56ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='964f6f31e07341aeb603b37fc019071c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:29:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:29:55Z,use_quota=True,user_id='51bf61d870194f83b9e7a4290b47b9cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a724be54-dd10-4caa-90f0-55052bc7043d),volume_type_id=a724be54-dd10-4caa-90f0-55052bc7043d)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:29:55 devstack sudo[97593]: pam_unix(sudo:session): session closed for user root Sep 28 09:29:55 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-0baa4b53-1761-4da5-90e5-6e6c31ed76ff tempest-GroupSnapshotsTest-66536182 None] Creating volume 3d167427-800f-4ea9-a81b-2413a90f56ae {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:29:55 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-0baa4b53-1761-4da5-90e5-6e6c31ed76ff tempest-GroupSnapshotsTest-66536182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:29:55 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-0baa4b53-1761-4da5-90e5-6e6c31ed76ff tempest-GroupSnapshotsTest-66536182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:29:55 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-0baa4b53-1761-4da5-90e5-6e6c31ed76ff tempest-GroupSnapshotsTest-66536182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:29:55 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-0baa4b53-1761-4da5-90e5-6e6c31ed76ff tempest-GroupSnapshotsTest-66536182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:29:55 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-0baa4b53-1761-4da5-90e5-6e6c31ed76ff tempest-GroupSnapshotsTest-66536182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:29:55 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-0baa4b53-1761-4da5-90e5-6e6c31ed76ff tempest-GroupSnapshotsTest-66536182 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:29:55 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-0baa4b53-1761-4da5-90e5-6e6c31ed76ff tempest-GroupSnapshotsTest-66536182 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:29:55 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0baa4b53-1761-4da5-90e5-6e6c31ed76ff tempest-GroupSnapshotsTest-66536182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3d167427-800f-4ea9-a81b-2413a90f56ae 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:29:55 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [req-a13c2a4c-7904-417b-8668-a5e3c257ffa9 req-66512b0b-a9ad-492f-a0d3-0bb9e8b0408e tempest-VolumesSnapshotsTestJSON-1998005768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-49d13f35-dd03-426a-93a5-236761c46999.e4b6a7af-79e8-4cc0-8df6-fe261705a663" returned: 0 in 0.480s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:29:55 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [req-a13c2a4c-7904-417b-8668-a5e3c257ffa9 req-66512b0b-a9ad-492f-a0d3-0bb9e8b0408e tempest-VolumesSnapshotsTestJSON-1998005768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-49d13f35-dd03-426a-93a5-236761c46999.e4b6a7af-79e8-4cc0-8df6-fe261705a663 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:29:55 devstack sudo[97598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3d167427-800f-4ea9-a81b-2413a90f56ae 1073741824 Sep 28 09:29:55 devstack sudo[97598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:29:55 devstack sudo[97599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-49d13f35-dd03-426a-93a5-236761c46999.e4b6a7af-79e8-4cc0-8df6-fe261705a663 Sep 28 09:29:55 devstack sudo[97599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:29:55 devstack sudo[97599]: pam_unix(sudo:session): session closed for user root Sep 28 09:29:55 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [req-a13c2a4c-7904-417b-8668-a5e3c257ffa9 req-66512b0b-a9ad-492f-a0d3-0bb9e8b0408e tempest-VolumesSnapshotsTestJSON-1998005768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-49d13f35-dd03-426a-93a5-236761c46999.e4b6a7af-79e8-4cc0-8df6-fe261705a663" returned: 0 in 0.323s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:29:55 devstack cinder-volume[86553]: DEBUG cinder.coordination [req-a13c2a4c-7904-417b-8668-a5e3c257ffa9 req-66512b0b-a9ad-492f-a0d3-0bb9e8b0408e tempest-VolumesSnapshotsTestJSON-1998005768 None] Lock "cinder-quobyte-e4b6a7af-79e8-4cc0-8df6-fe261705a663" released by "_delete_snapshot" :: held 1.884s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:29:55 devstack cinder-volume[86553]: DEBUG cinder.coordination [req-a13c2a4c-7904-417b-8668-a5e3c257ffa9 req-66512b0b-a9ad-492f-a0d3-0bb9e8b0408e tempest-VolumesSnapshotsTestJSON-1998005768 None] Lock "cinder-quobyte-49d13f35-dd03-426a-93a5-236761c46999" released by "delete_snapshot" :: held 1.916s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:29:55 devstack cinder-volume[86553]: DEBUG cinder.quota [req-a13c2a4c-7904-417b-8668-a5e3c257ffa9 req-66512b0b-a9ad-492f-a0d3-0bb9e8b0408e tempest-VolumesSnapshotsTestJSON-1998005768 None] Created reservations ['a859cc80-8baf-4994-ac76-65d14c3e6802', '0d8c2c36-f4f3-4a35-b906-4994eae80276', '74b241bd-3a22-4b93-85dd-6041e7cf1dee', 'ce21f335-4a2d-477b-b241-c2bfef370b01'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:29:56 devstack cinder-volume[86553]: INFO cinder.volume.manager [req-a13c2a4c-7904-417b-8668-a5e3c257ffa9 req-66512b0b-a9ad-492f-a0d3-0bb9e8b0408e tempest-VolumesSnapshotsTestJSON-1998005768 None] Delete snapshot completed successfully. Sep 28 09:29:56 devstack cinder-volume[86553]: DEBUG cinder.coordination [req-a13c2a4c-7904-417b-8668-a5e3c257ffa9 req-66512b0b-a9ad-492f-a0d3-0bb9e8b0408e tempest-VolumesSnapshotsTestJSON-1998005768 None] Lock "cinder-e4b6a7af-79e8-4cc0-8df6-fe261705a663-delete_snapshot" released by "delete_snapshot" :: held 2.084s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:29:56 devstack sudo[97598]: pam_unix(sudo:session): session closed for user root Sep 28 09:29:56 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0baa4b53-1761-4da5-90e5-6e6c31ed76ff tempest-GroupSnapshotsTest-66536182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3d167427-800f-4ea9-a81b-2413a90f56ae 1073741824" returned: 0 in 0.629s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:29:56 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0baa4b53-1761-4da5-90e5-6e6c31ed76ff tempest-GroupSnapshotsTest-66536182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3d167427-800f-4ea9-a81b-2413a90f56ae {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:29:56 devstack sudo[97608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3d167427-800f-4ea9-a81b-2413a90f56ae Sep 28 09:29:56 devstack sudo[97608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:29:56 devstack cinder-volume[86553]: DEBUG cinder.coordination [req-ebae0111-4704-47b8-9da6-b51ba0c3370f req-83f064cd-d449-4edb-825c-a28ded02e09f tempest-VolumesSnapshotsTestJSON-1998005768 None] Acquiring lock "cinder-49d13f35-dd03-426a-93a5-236761c46999-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:29:56 devstack cinder-volume[86553]: DEBUG cinder.coordination [req-ebae0111-4704-47b8-9da6-b51ba0c3370f req-83f064cd-d449-4edb-825c-a28ded02e09f tempest-VolumesSnapshotsTestJSON-1998005768 None] Lock "cinder-49d13f35-dd03-426a-93a5-236761c46999-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:29:56 devstack sudo[97608]: pam_unix(sudo:session): session closed for user root Sep 28 09:29:56 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0baa4b53-1761-4da5-90e5-6e6c31ed76ff tempest-GroupSnapshotsTest-66536182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3d167427-800f-4ea9-a81b-2413a90f56ae" returned: 0 in 0.330s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:29:56 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-0baa4b53-1761-4da5-90e5-6e6c31ed76ff tempest-GroupSnapshotsTest-66536182 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:29:56 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-0baa4b53-1761-4da5-90e5-6e6c31ed76ff tempest-GroupSnapshotsTest-66536182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:29:56 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0baa4b53-1761-4da5-90e5-6e6c31ed76ff tempest-GroupSnapshotsTest-66536182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d85dc0dd-4dd3-4df9-a2ff-fbc5c3cc8dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d167427-800f-4ea9-a81b-2413a90f56ae', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:29:56 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0baa4b53-1761-4da5-90e5-6e6c31ed76ff tempest-GroupSnapshotsTest-66536182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bee383a-ca9b-41cd-bc3d-8101952be999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:29:56 devstack cinder-volume[86553]: DEBUG cinder.coordination [req-ebae0111-4704-47b8-9da6-b51ba0c3370f req-83f064cd-d449-4edb-825c-a28ded02e09f tempest-VolumesSnapshotsTestJSON-1998005768 None] Acquiring lock "cinder-quobyte-49d13f35-dd03-426a-93a5-236761c46999" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:29:56 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-0baa4b53-1761-4da5-90e5-6e6c31ed76ff tempest-GroupSnapshotsTest-66536182 None] Volume volume-3d167427-800f-4ea9-a81b-2413a90f56ae (3d167427-800f-4ea9-a81b-2413a90f56ae): created successfully Sep 28 09:29:56 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0baa4b53-1761-4da5-90e5-6e6c31ed76ff tempest-GroupSnapshotsTest-66536182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bee383a-ca9b-41cd-bc3d-8101952be999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:29:56 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0baa4b53-1761-4da5-90e5-6e6c31ed76ff tempest-GroupSnapshotsTest-66536182 None] Flow 'volume_create_manager' (c0ce6e07-58be-4454-913c-e2b7f51f7ace) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:29:56 devstack cinder-volume[86553]: DEBUG cinder.coordination [req-ebae0111-4704-47b8-9da6-b51ba0c3370f req-83f064cd-d449-4edb-825c-a28ded02e09f tempest-VolumesSnapshotsTestJSON-1998005768 None] Lock "cinder-quobyte-49d13f35-dd03-426a-93a5-236761c46999" acquired by "delete_volume" :: waited 0.047s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:29:56 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-0baa4b53-1761-4da5-90e5-6e6c31ed76ff tempest-GroupSnapshotsTest-66536182 None] Created volume successfully. Sep 28 09:29:56 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e0139af-179f-4a41-b9dc-7a9e09b5556e]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:29:56 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [req-ebae0111-4704-47b8-9da6-b51ba0c3370f req-83f064cd-d449-4edb-825c-a28ded02e09f tempest-VolumesSnapshotsTestJSON-1998005768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-49d13f35-dd03-426a-93a5-236761c46999 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:29:56 devstack sudo[97611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-49d13f35-dd03-426a-93a5-236761c46999 Sep 28 09:29:56 devstack sudo[97611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:29:57 devstack sudo[97611]: pam_unix(sudo:session): session closed for user root Sep 28 09:29:57 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [req-ebae0111-4704-47b8-9da6-b51ba0c3370f req-83f064cd-d449-4edb-825c-a28ded02e09f tempest-VolumesSnapshotsTestJSON-1998005768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-49d13f35-dd03-426a-93a5-236761c46999" returned: 0 in 0.411s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:29:57 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [req-ebae0111-4704-47b8-9da6-b51ba0c3370f req-83f064cd-d449-4edb-825c-a28ded02e09f tempest-VolumesSnapshotsTestJSON-1998005768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-49d13f35-dd03-426a-93a5-236761c46999 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:29:57 devstack sudo[97617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-49d13f35-dd03-426a-93a5-236761c46999 Sep 28 09:29:57 devstack sudo[97617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:29:57 devstack sudo[97617]: pam_unix(sudo:session): session closed for user root Sep 28 09:29:57 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [req-ebae0111-4704-47b8-9da6-b51ba0c3370f req-83f064cd-d449-4edb-825c-a28ded02e09f tempest-VolumesSnapshotsTestJSON-1998005768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-49d13f35-dd03-426a-93a5-236761c46999" returned: 0 in 0.292s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:29:57 devstack cinder-volume[86553]: DEBUG cinder.coordination [req-ebae0111-4704-47b8-9da6-b51ba0c3370f req-83f064cd-d449-4edb-825c-a28ded02e09f tempest-VolumesSnapshotsTestJSON-1998005768 None] Lock "cinder-quobyte-49d13f35-dd03-426a-93a5-236761c46999" released by "delete_volume" :: held 0.803s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:29:57 devstack cinder-volume[86553]: DEBUG cinder.quota [req-ebae0111-4704-47b8-9da6-b51ba0c3370f req-83f064cd-d449-4edb-825c-a28ded02e09f tempest-VolumesSnapshotsTestJSON-1998005768 None] Created reservations ['d0cdfd2c-164b-43b6-acaf-8ca8afbd76d6', '937e8b69-c5c9-4b0a-b037-75c0bc6a5557', 'd0034d8c-503e-4416-88f9-867de86ce217', '45f8ee4e-b368-4a0e-ad61-cde02ece40b6'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:29:57 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-ebae0111-4704-47b8-9da6-b51ba0c3370f req-83f064cd-d449-4edb-825c-a28ded02e09f tempest-VolumesSnapshotsTestJSON-1998005768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:29:57 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-ebae0111-4704-47b8-9da6-b51ba0c3370f req-83f064cd-d449-4edb-825c-a28ded02e09f tempest-VolumesSnapshotsTestJSON-1998005768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:29:57 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [req-ebae0111-4704-47b8-9da6-b51ba0c3370f req-83f064cd-d449-4edb-825c-a28ded02e09f tempest-VolumesSnapshotsTestJSON-1998005768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:29:57 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [req-ebae0111-4704-47b8-9da6-b51ba0c3370f req-83f064cd-d449-4edb-825c-a28ded02e09f tempest-VolumesSnapshotsTestJSON-1998005768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:29:57 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-ebae0111-4704-47b8-9da6-b51ba0c3370f req-83f064cd-d449-4edb-825c-a28ded02e09f tempest-VolumesSnapshotsTestJSON-1998005768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:29:57 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [req-ebae0111-4704-47b8-9da6-b51ba0c3370f req-83f064cd-d449-4edb-825c-a28ded02e09f tempest-VolumesSnapshotsTestJSON-1998005768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:29:57 devstack sudo[97621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:29:57 devstack sudo[97621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:29:57 devstack sudo[97621]: pam_unix(sudo:session): session closed for user root Sep 28 09:29:57 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [req-ebae0111-4704-47b8-9da6-b51ba0c3370f req-83f064cd-d449-4edb-825c-a28ded02e09f tempest-VolumesSnapshotsTestJSON-1998005768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.385s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:29:57 devstack cinder-volume[86553]: DEBUG cinder.manager [req-ebae0111-4704-47b8-9da6-b51ba0c3370f req-83f064cd-d449-4edb-825c-a28ded02e09f tempest-VolumesSnapshotsTestJSON-1998005768 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:29:57 devstack cinder-volume[86553]: INFO cinder.volume.manager [req-ebae0111-4704-47b8-9da6-b51ba0c3370f req-83f064cd-d449-4edb-825c-a28ded02e09f tempest-VolumesSnapshotsTestJSON-1998005768 None] Deleted volume successfully. Sep 28 09:29:57 devstack cinder-volume[86553]: DEBUG cinder.coordination [req-ebae0111-4704-47b8-9da6-b51ba0c3370f req-83f064cd-d449-4edb-825c-a28ded02e09f tempest-VolumesSnapshotsTestJSON-1998005768 None] Lock "cinder-49d13f35-dd03-426a-93a5-236761c46999-delete_volume" released by "delete_volume" :: held 1.551s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:29:58 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-9f5ff580-0616-4639-8c7b-53e758e32d72 tempest-GroupSnapshotsTest-66536182 None] GroupSnapshot c2a0e1b3-93bb-4f48-9923-294ee76d4312: creating. Sep 28 09:29:58 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-9f5ff580-0616-4639-8c7b-53e758e32d72 tempest-GroupSnapshotsTest-66536182 None] Group snapshot c2a0e1b3-93bb-4f48-9923-294ee76d4312: creating. {{(pid=86553) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 09:29:58 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-9f5ff580-0616-4639-8c7b-53e758e32d72 tempest-GroupSnapshotsTest-66536182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:29:58 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-9f5ff580-0616-4639-8c7b-53e758e32d72 tempest-GroupSnapshotsTest-66536182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:29:58 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-9f5ff580-0616-4639-8c7b-53e758e32d72 tempest-GroupSnapshotsTest-66536182 None] Creating offline snapshot 7c3245c8-507d-43d9-b9b8-3aa8f11e8b8e of volume 3d167427-800f-4ea9-a81b-2413a90f56ae {{(pid=86553) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 09:29:58 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[8968d67b-39bc-4db1-9a3b-e90a1891d577]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:29:58 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-9f5ff580-0616-4639-8c7b-53e758e32d72 tempest-GroupSnapshotsTest-66536182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3d167427-800f-4ea9-a81b-2413a90f56ae {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:29:58 devstack sudo[97624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3d167427-800f-4ea9-a81b-2413a90f56ae Sep 28 09:29:58 devstack sudo[97624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:29:58 devstack sudo[97624]: pam_unix(sudo:session): session closed for user root Sep 28 09:29:58 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-9f5ff580-0616-4639-8c7b-53e758e32d72 tempest-GroupSnapshotsTest-66536182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3d167427-800f-4ea9-a81b-2413a90f56ae" returned: 0 in 0.427s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:29:58 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-9f5ff580-0616-4639-8c7b-53e758e32d72 tempest-GroupSnapshotsTest-66536182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3d167427-800f-4ea9-a81b-2413a90f56ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3d167427-800f-4ea9-a81b-2413a90f56ae.7c3245c8-507d-43d9-b9b8-3aa8f11e8b8e 1G {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:29:58 devstack sudo[97630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3d167427-800f-4ea9-a81b-2413a90f56ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3d167427-800f-4ea9-a81b-2413a90f56ae.7c3245c8-507d-43d9-b9b8-3aa8f11e8b8e 1G Sep 28 09:29:58 devstack sudo[97630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:29:59 devstack sudo[97630]: pam_unix(sudo:session): session closed for user root Sep 28 09:29:59 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-9f5ff580-0616-4639-8c7b-53e758e32d72 tempest-GroupSnapshotsTest-66536182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3d167427-800f-4ea9-a81b-2413a90f56ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3d167427-800f-4ea9-a81b-2413a90f56ae.7c3245c8-507d-43d9-b9b8-3aa8f11e8b8e 1G" returned: 0 in 0.467s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:29:59 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-9f5ff580-0616-4639-8c7b-53e758e32d72 tempest-GroupSnapshotsTest-66536182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d167427-800f-4ea9-a81b-2413a90f56ae -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3d167427-800f-4ea9-a81b-2413a90f56ae.7c3245c8-507d-43d9-b9b8-3aa8f11e8b8e {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:29:59 devstack sudo[97636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d167427-800f-4ea9-a81b-2413a90f56ae -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3d167427-800f-4ea9-a81b-2413a90f56ae.7c3245c8-507d-43d9-b9b8-3aa8f11e8b8e Sep 28 09:29:59 devstack sudo[97636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:29:59 devstack sudo[97636]: pam_unix(sudo:session): session closed for user root Sep 28 09:29:59 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-9f5ff580-0616-4639-8c7b-53e758e32d72 tempest-GroupSnapshotsTest-66536182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d167427-800f-4ea9-a81b-2413a90f56ae -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3d167427-800f-4ea9-a81b-2413a90f56ae.7c3245c8-507d-43d9-b9b8-3aa8f11e8b8e" returned: 0 in 0.386s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:29:59 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-9f5ff580-0616-4639-8c7b-53e758e32d72 tempest-GroupSnapshotsTest-66536182 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3d167427-800f-4ea9-a81b-2413a90f56ae.7c3245c8-507d-43d9-b9b8-3aa8f11e8b8e is being set with open permissions: ugo+rw: NotImplementedError Sep 28 09:29:59 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-9f5ff580-0616-4639-8c7b-53e758e32d72 tempest-GroupSnapshotsTest-66536182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3d167427-800f-4ea9-a81b-2413a90f56ae.7c3245c8-507d-43d9-b9b8-3aa8f11e8b8e {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:29:59 devstack sudo[97642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3d167427-800f-4ea9-a81b-2413a90f56ae.7c3245c8-507d-43d9-b9b8-3aa8f11e8b8e Sep 28 09:29:59 devstack sudo[97642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:29:59 devstack sudo[97642]: pam_unix(sudo:session): session closed for user root Sep 28 09:29:59 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-9f5ff580-0616-4639-8c7b-53e758e32d72 tempest-GroupSnapshotsTest-66536182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3d167427-800f-4ea9-a81b-2413a90f56ae.7c3245c8-507d-43d9-b9b8-3aa8f11e8b8e" returned: 0 in 0.277s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:29:59 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-9f5ff580-0616-4639-8c7b-53e758e32d72 tempest-GroupSnapshotsTest-66536182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3d167427-800f-4ea9-a81b-2413a90f56ae.info {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:29:59 devstack sudo[97645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3d167427-800f-4ea9-a81b-2413a90f56ae.info Sep 28 09:29:59 devstack sudo[97645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:30:00 devstack sudo[97645]: pam_unix(sudo:session): session closed for user root Sep 28 09:30:00 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-9f5ff580-0616-4639-8c7b-53e758e32d72 tempest-GroupSnapshotsTest-66536182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3d167427-800f-4ea9-a81b-2413a90f56ae.info" returned: 0 in 0.287s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:30:00 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-9f5ff580-0616-4639-8c7b-53e758e32d72 tempest-GroupSnapshotsTest-66536182 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3d167427-800f-4ea9-a81b-2413a90f56ae.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 09:30:00 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-9f5ff580-0616-4639-8c7b-53e758e32d72 tempest-GroupSnapshotsTest-66536182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3d167427-800f-4ea9-a81b-2413a90f56ae.info {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:30:00 devstack sudo[97648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3d167427-800f-4ea9-a81b-2413a90f56ae.info Sep 28 09:30:00 devstack sudo[97648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:30:00 devstack sudo[97648]: pam_unix(sudo:session): session closed for user root Sep 28 09:30:00 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-9f5ff580-0616-4639-8c7b-53e758e32d72 tempest-GroupSnapshotsTest-66536182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3d167427-800f-4ea9-a81b-2413a90f56ae.info" returned: 0 in 0.361s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:30:00 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-9f5ff580-0616-4639-8c7b-53e758e32d72 tempest-GroupSnapshotsTest-66536182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.309s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:30:00 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-9f5ff580-0616-4639-8c7b-53e758e32d72 tempest-GroupSnapshotsTest-66536182 None] group_snapshot c2a0e1b3-93bb-4f48-9923-294ee76d4312: created successfully Sep 28 09:30:02 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-bf16defe-a6e2-42a5-92c2-c1f60c2d502e tempest-GroupSnapshotsTest-66536182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:30:02 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-bf16defe-a6e2-42a5-92c2-c1f60c2d502e tempest-GroupSnapshotsTest-66536182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:30:02 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-bf16defe-a6e2-42a5-92c2-c1f60c2d502e tempest-GroupSnapshotsTest-66536182 None] Acquiring lock "cinder-quobyte-7c3245c8-507d-43d9-b9b8-3aa8f11e8b8e-aa8fbef0-4e85-43d3-ba7e-f41d355b7253" by "_create_volume_from_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:30:02 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-bf16defe-a6e2-42a5-92c2-c1f60c2d502e tempest-GroupSnapshotsTest-66536182 None] Lock "cinder-quobyte-7c3245c8-507d-43d9-b9b8-3aa8f11e8b8e-aa8fbef0-4e85-43d3-ba7e-f41d355b7253" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:30:02 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-bf16defe-a6e2-42a5-92c2-c1f60c2d502e tempest-GroupSnapshotsTest-66536182 None] Creating volume aa8fbef0-4e85-43d3-ba7e-f41d355b7253 from snapshot 7c3245c8-507d-43d9-b9b8-3aa8f11e8b8e {{(pid=86553) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 09:30:02 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-bf16defe-a6e2-42a5-92c2-c1f60c2d502e tempest-GroupSnapshotsTest-66536182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:30:02 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-bf16defe-a6e2-42a5-92c2-c1f60c2d502e tempest-GroupSnapshotsTest-66536182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:30:02 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-bf16defe-a6e2-42a5-92c2-c1f60c2d502e tempest-GroupSnapshotsTest-66536182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:30:02 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-bf16defe-a6e2-42a5-92c2-c1f60c2d502e tempest-GroupSnapshotsTest-66536182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:30:02 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-bf16defe-a6e2-42a5-92c2-c1f60c2d502e tempest-GroupSnapshotsTest-66536182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:30:02 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-bf16defe-a6e2-42a5-92c2-c1f60c2d502e tempest-GroupSnapshotsTest-66536182 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:30:02 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-bf16defe-a6e2-42a5-92c2-c1f60c2d502e tempest-GroupSnapshotsTest-66536182 None] Acquiring lock "cinder-quobyte-aa8fbef0-4e85-43d3-ba7e-f41d355b7253" by "_copy_volume_from_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:30:02 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-bf16defe-a6e2-42a5-92c2-c1f60c2d502e tempest-GroupSnapshotsTest-66536182 None] Lock "cinder-quobyte-aa8fbef0-4e85-43d3-ba7e-f41d355b7253" acquired by "_copy_volume_from_snapshot" :: waited 0.056s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:30:02 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-bf16defe-a6e2-42a5-92c2-c1f60c2d502e tempest-GroupSnapshotsTest-66536182 None] snapshot: 7c3245c8-507d-43d9-b9b8-3aa8f11e8b8e, volume: aa8fbef0-4e85-43d3-ba7e-f41d355b7253, {{(pid=86553) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 09:30:02 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-bf16defe-a6e2-42a5-92c2-c1f60c2d502e tempest-GroupSnapshotsTest-66536182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:30:02 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-bf16defe-a6e2-42a5-92c2-c1f60c2d502e tempest-GroupSnapshotsTest-66536182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:30:02 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-bf16defe-a6e2-42a5-92c2-c1f60c2d502e tempest-GroupSnapshotsTest-66536182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:30:02 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-bf16defe-a6e2-42a5-92c2-c1f60c2d502e tempest-GroupSnapshotsTest-66536182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:30:02 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-bf16defe-a6e2-42a5-92c2-c1f60c2d502e tempest-GroupSnapshotsTest-66536182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:30:02 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe2700f-9669-44ba-8646-115943c601a7]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:30:02 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-bf16defe-a6e2-42a5-92c2-c1f60c2d502e tempest-GroupSnapshotsTest-66536182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3d167427-800f-4ea9-a81b-2413a90f56ae.7c3245c8-507d-43d9-b9b8-3aa8f11e8b8e {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:30:03 devstack sudo[97654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3d167427-800f-4ea9-a81b-2413a90f56ae.7c3245c8-507d-43d9-b9b8-3aa8f11e8b8e Sep 28 09:30:03 devstack sudo[97654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:30:03 devstack sudo[97654]: pam_unix(sudo:session): session closed for user root Sep 28 09:30:03 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-bf16defe-a6e2-42a5-92c2-c1f60c2d502e tempest-GroupSnapshotsTest-66536182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3d167427-800f-4ea9-a81b-2413a90f56ae.7c3245c8-507d-43d9-b9b8-3aa8f11e8b8e" returned: 0 in 0.569s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:30:03 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-bf16defe-a6e2-42a5-92c2-c1f60c2d502e tempest-GroupSnapshotsTest-66536182 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d167427-800f-4ea9-a81b-2413a90f56ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86553) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 09:30:03 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc1d44ec-b2b6-47ba-b1be-67835f8695db]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:30:03 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-bf16defe-a6e2-42a5-92c2-c1f60c2d502e tempest-GroupSnapshotsTest-66536182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3d167427-800f-4ea9-a81b-2413a90f56ae {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:30:03 devstack sudo[97659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3d167427-800f-4ea9-a81b-2413a90f56ae Sep 28 09:30:03 devstack sudo[97659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:30:04 devstack sudo[97659]: pam_unix(sudo:session): session closed for user root Sep 28 09:30:04 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-bf16defe-a6e2-42a5-92c2-c1f60c2d502e tempest-GroupSnapshotsTest-66536182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3d167427-800f-4ea9-a81b-2413a90f56ae" returned: 0 in 0.758s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:30:04 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-bf16defe-a6e2-42a5-92c2-c1f60c2d502e tempest-GroupSnapshotsTest-66536182 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3d167427-800f-4ea9-a81b-2413a90f56ae {{(pid=86553) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 09:30:04 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-bf16defe-a6e2-42a5-92c2-c1f60c2d502e tempest-GroupSnapshotsTest-66536182 None] Creating direct copy from snapshot {{(pid=86553) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 09:30:04 devstack cinder-volume[86553]: DEBUG cinder.utils [None req-bf16defe-a6e2-42a5-92c2-c1f60c2d502e tempest-GroupSnapshotsTest-66536182 None] Path /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-aa8fbef0-4e85-43d3-ba7e-f41d355b7253 not found in is_blk_device check {{(pid=86553) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 09:30:04 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-bf16defe-a6e2-42a5-92c2-c1f60c2d502e tempest-GroupSnapshotsTest-66536182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3d167427-800f-4ea9-a81b-2413a90f56ae /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-aa8fbef0-4e85-43d3-ba7e-f41d355b7253 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:30:04 devstack sudo[97664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3d167427-800f-4ea9-a81b-2413a90f56ae /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-aa8fbef0-4e85-43d3-ba7e-f41d355b7253 Sep 28 09:30:04 devstack sudo[97664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:30:07 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec7a77e8-021d-4830-bd47-04f0d0838405 tempest-VolumesTestJSON-2121285435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:30:07 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ec7a77e8-021d-4830-bd47-04f0d0838405 tempest-VolumesTestJSON-2121285435 None] Flow 'volume_create_manager' (4ff72543-fedd-44a6-a52a-e15f98472f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:30:07 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ec7a77e8-021d-4830-bd47-04f0d0838405 tempest-VolumesTestJSON-2121285435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa9c83f9-a2a8-463b-a6dc-64add58d820b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:30:07 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ec7a77e8-021d-4830-bd47-04f0d0838405 tempest-VolumesTestJSON-2121285435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa9c83f9-a2a8-463b-a6dc-64add58d820b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:30:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-78930924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2c991bd-4195-46e0-8425-f7c4a1b7225e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1080cd625cb042c38d6329adcc59a77b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:30:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:30:08Z,use_quota=True,user_id='c7a85514632344148038e03a3c7c933c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:30:07 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ec7a77e8-021d-4830-bd47-04f0d0838405 tempest-VolumesTestJSON-2121285435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80561cac-7d1d-4932-88e8-749d7e44cf71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:30:07 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ec7a77e8-021d-4830-bd47-04f0d0838405 tempest-VolumesTestJSON-2121285435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80561cac-7d1d-4932-88e8-749d7e44cf71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:30:07 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ec7a77e8-021d-4830-bd47-04f0d0838405 tempest-VolumesTestJSON-2121285435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c9a5331-0a40-45b7-8a64-1c6022d01d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:30:07 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ec7a77e8-021d-4830-bd47-04f0d0838405 tempest-VolumesTestJSON-2121285435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c9a5331-0a40-45b7-8a64-1c6022d01d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2c991bd-4195-46e0-8425-f7c4a1b7225e', 'volume_name': 'volume-e2c991bd-4195-46e0-8425-f7c4a1b7225e', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:30:07 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ec7a77e8-021d-4830-bd47-04f0d0838405 tempest-VolumesTestJSON-2121285435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfdde763-7e36-4b36-80ef-26fae26280ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:30:07 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ec7a77e8-021d-4830-bd47-04f0d0838405 tempest-VolumesTestJSON-2121285435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfdde763-7e36-4b36-80ef-26fae26280ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:30:07 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ec7a77e8-021d-4830-bd47-04f0d0838405 tempest-VolumesTestJSON-2121285435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (900ef711-4a04-43f1-901d-ee7d1a16152a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:30:07 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-ec7a77e8-021d-4830-bd47-04f0d0838405 tempest-VolumesTestJSON-2121285435 None] Volume e2c991bd-4195-46e0-8425-f7c4a1b7225e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2c991bd-4195-46e0-8425-f7c4a1b7225e', 'volume_size': 1} Sep 28 09:30:07 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ec7a77e8-021d-4830-bd47-04f0d0838405 tempest-VolumesTestJSON-2121285435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:30:12 devstack cinder-volume[86553]: DEBUG dbcounter [-] [86553] Writing DB stats cinder:UPDATE=103,cinder:DELETE=10,cinder:SELECT=94,cinder:INSERT=28 {{(pid=86553) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 09:30:13 devstack sudo[97664]: pam_unix(sudo:session): session closed for user root Sep 28 09:30:13 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-bf16defe-a6e2-42a5-92c2-c1f60c2d502e tempest-GroupSnapshotsTest-66536182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3d167427-800f-4ea9-a81b-2413a90f56ae /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-aa8fbef0-4e85-43d3-ba7e-f41d355b7253" returned: 0 in 9.074s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:30:13 devstack cinder-volume[86553]: DEBUG cinder.image.image_utils [None req-bf16defe-a6e2-42a5-92c2-c1f60c2d502e tempest-GroupSnapshotsTest-66536182 None] Image conversion details: src /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3d167427-800f-4ea9-a81b-2413a90f56ae, size 1024.00 MB, duration 9.07 sec, destination /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-aa8fbef0-4e85-43d3-ba7e-f41d355b7253 {{(pid=86553) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 09:30:13 devstack cinder-volume[86553]: INFO cinder.image.image_utils [None req-bf16defe-a6e2-42a5-92c2-c1f60c2d502e tempest-GroupSnapshotsTest-66536182 None] Converted 1024.00 MB image at 112.84 MB/s Sep 28 09:30:13 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-bf16defe-a6e2-42a5-92c2-c1f60c2d502e tempest-GroupSnapshotsTest-66536182 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-aa8fbef0-4e85-43d3-ba7e-f41d355b7253 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 09:30:13 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-bf16defe-a6e2-42a5-92c2-c1f60c2d502e tempest-GroupSnapshotsTest-66536182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-aa8fbef0-4e85-43d3-ba7e-f41d355b7253 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:30:13 devstack sudo[97678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-aa8fbef0-4e85-43d3-ba7e-f41d355b7253 Sep 28 09:30:13 devstack sudo[97678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:30:13 devstack sudo[97678]: pam_unix(sudo:session): session closed for user root Sep 28 09:30:13 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-bf16defe-a6e2-42a5-92c2-c1f60c2d502e tempest-GroupSnapshotsTest-66536182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-aa8fbef0-4e85-43d3-ba7e-f41d355b7253" returned: 0 in 0.317s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:30:13 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-bf16defe-a6e2-42a5-92c2-c1f60c2d502e tempest-GroupSnapshotsTest-66536182 None] Lock "cinder-quobyte-aa8fbef0-4e85-43d3-ba7e-f41d355b7253" released by "_copy_volume_from_snapshot" :: held 10.894s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:30:13 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-bf16defe-a6e2-42a5-92c2-c1f60c2d502e tempest-GroupSnapshotsTest-66536182 None] Lock "cinder-quobyte-7c3245c8-507d-43d9-b9b8-3aa8f11e8b8e-aa8fbef0-4e85-43d3-ba7e-f41d355b7253" released by "_create_volume_from_snapshot" :: held 11.011s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:30:13 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-bf16defe-a6e2-42a5-92c2-c1f60c2d502e tempest-GroupSnapshotsTest-66536182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.039s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:30:13 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ec7a77e8-021d-4830-bd47-04f0d0838405 tempest-VolumesTestJSON-2121285435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.855s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:30:13 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ec7a77e8-021d-4830-bd47-04f0d0838405 tempest-VolumesTestJSON-2121285435 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:30:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-78930924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2c991bd-4195-46e0-8425-f7c4a1b7225e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1080cd625cb042c38d6329adcc59a77b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:30:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:30:08Z,use_quota=True,user_id='c7a85514632344148038e03a3c7c933c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:30:13 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-ec7a77e8-021d-4830-bd47-04f0d0838405 tempest-VolumesTestJSON-2121285435 None] Creating volume e2c991bd-4195-46e0-8425-f7c4a1b7225e {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:30:13 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ec7a77e8-021d-4830-bd47-04f0d0838405 tempest-VolumesTestJSON-2121285435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:30:13 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ec7a77e8-021d-4830-bd47-04f0d0838405 tempest-VolumesTestJSON-2121285435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:30:13 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ec7a77e8-021d-4830-bd47-04f0d0838405 tempest-VolumesTestJSON-2121285435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:30:13 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ec7a77e8-021d-4830-bd47-04f0d0838405 tempest-VolumesTestJSON-2121285435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:30:13 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ec7a77e8-021d-4830-bd47-04f0d0838405 tempest-VolumesTestJSON-2121285435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:30:13 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ec7a77e8-021d-4830-bd47-04f0d0838405 tempest-VolumesTestJSON-2121285435 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:30:13 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-ec7a77e8-021d-4830-bd47-04f0d0838405 tempest-VolumesTestJSON-2121285435 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:30:13 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ec7a77e8-021d-4830-bd47-04f0d0838405 tempest-VolumesTestJSON-2121285435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-e2c991bd-4195-46e0-8425-f7c4a1b7225e 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:30:13 devstack sudo[97681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-e2c991bd-4195-46e0-8425-f7c4a1b7225e 1073741824 Sep 28 09:30:13 devstack sudo[97681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:30:13 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-bf16defe-a6e2-42a5-92c2-c1f60c2d502e tempest-GroupSnapshotsTest-66536182 None] Create group from source-snapshot-c2a0e1b3-93bb-4f48-9923-294ee76d4312 completed successfully. Sep 28 09:30:14 devstack sudo[97681]: pam_unix(sudo:session): session closed for user root Sep 28 09:30:14 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ec7a77e8-021d-4830-bd47-04f0d0838405 tempest-VolumesTestJSON-2121285435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-e2c991bd-4195-46e0-8425-f7c4a1b7225e 1073741824" returned: 0 in 0.556s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:30:14 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ec7a77e8-021d-4830-bd47-04f0d0838405 tempest-VolumesTestJSON-2121285435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-e2c991bd-4195-46e0-8425-f7c4a1b7225e {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:30:14 devstack sudo[97687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-e2c991bd-4195-46e0-8425-f7c4a1b7225e Sep 28 09:30:14 devstack sudo[97687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:30:14 devstack sudo[97687]: pam_unix(sudo:session): session closed for user root Sep 28 09:30:14 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ec7a77e8-021d-4830-bd47-04f0d0838405 tempest-VolumesTestJSON-2121285435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-e2c991bd-4195-46e0-8425-f7c4a1b7225e" returned: 0 in 0.269s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:30:14 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ec7a77e8-021d-4830-bd47-04f0d0838405 tempest-VolumesTestJSON-2121285435 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:30:14 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ec7a77e8-021d-4830-bd47-04f0d0838405 tempest-VolumesTestJSON-2121285435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:30:14 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ec7a77e8-021d-4830-bd47-04f0d0838405 tempest-VolumesTestJSON-2121285435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (900ef711-4a04-43f1-901d-ee7d1a16152a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2c991bd-4195-46e0-8425-f7c4a1b7225e', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:30:14 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ec7a77e8-021d-4830-bd47-04f0d0838405 tempest-VolumesTestJSON-2121285435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81545d6a-1d1b-4726-b517-096316118dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:30:14 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-ec7a77e8-021d-4830-bd47-04f0d0838405 tempest-VolumesTestJSON-2121285435 None] Volume volume-e2c991bd-4195-46e0-8425-f7c4a1b7225e (e2c991bd-4195-46e0-8425-f7c4a1b7225e): created successfully Sep 28 09:30:14 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ec7a77e8-021d-4830-bd47-04f0d0838405 tempest-VolumesTestJSON-2121285435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81545d6a-1d1b-4726-b517-096316118dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:30:14 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ec7a77e8-021d-4830-bd47-04f0d0838405 tempest-VolumesTestJSON-2121285435 None] Flow 'volume_create_manager' (4ff72543-fedd-44a6-a52a-e15f98472f58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:30:14 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-ec7a77e8-021d-4830-bd47-04f0d0838405 tempest-VolumesTestJSON-2121285435 None] Created volume successfully. Sep 28 09:30:15 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-0e0f1a26-c8ab-4c3d-8411-7e82ed588959 tempest-GroupSnapshotsTest-66536182 None] Acquiring lock "cinder-quobyte-aa8fbef0-4e85-43d3-ba7e-f41d355b7253" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:30:15 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-0e0f1a26-c8ab-4c3d-8411-7e82ed588959 tempest-GroupSnapshotsTest-66536182 None] Lock "cinder-quobyte-aa8fbef0-4e85-43d3-ba7e-f41d355b7253" acquired by "delete_volume" :: waited 0.024s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:30:15 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c9f3bb-07d3-491d-855c-6c88be14e366]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:30:15 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0e0f1a26-c8ab-4c3d-8411-7e82ed588959 tempest-GroupSnapshotsTest-66536182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-aa8fbef0-4e85-43d3-ba7e-f41d355b7253 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:30:15 devstack sudo[97691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-aa8fbef0-4e85-43d3-ba7e-f41d355b7253 Sep 28 09:30:15 devstack sudo[97691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:30:16 devstack sudo[97691]: pam_unix(sudo:session): session closed for user root Sep 28 09:30:16 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0e0f1a26-c8ab-4c3d-8411-7e82ed588959 tempest-GroupSnapshotsTest-66536182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-aa8fbef0-4e85-43d3-ba7e-f41d355b7253" returned: 0 in 0.590s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:30:16 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0e0f1a26-c8ab-4c3d-8411-7e82ed588959 tempest-GroupSnapshotsTest-66536182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-aa8fbef0-4e85-43d3-ba7e-f41d355b7253 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:30:16 devstack sudo[97732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-aa8fbef0-4e85-43d3-ba7e-f41d355b7253 Sep 28 09:30:16 devstack sudo[97732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:30:16 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-04432b4b-247e-4ea6-b9b6-46953399bd88 tempest-VolumesTestJSON-2121285435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:30:16 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-04432b4b-247e-4ea6-b9b6-46953399bd88 tempest-VolumesTestJSON-2121285435 None] Flow 'volume_create_manager' (30f888e7-067e-4b9e-96fc-5b9ff6157409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:30:16 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-04432b4b-247e-4ea6-b9b6-46953399bd88 tempest-VolumesTestJSON-2121285435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e725188-0111-4c85-b7c7-c5394f4a63bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:30:16 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-04432b4b-247e-4ea6-b9b6-46953399bd88 tempest-VolumesTestJSON-2121285435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e725188-0111-4c85-b7c7-c5394f4a63bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:30:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1463610592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d17bc2a6-6df2-41fb-acbb-8979dd25148f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1080cd625cb042c38d6329adcc59a77b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:30:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:30:16Z,use_quota=True,user_id='c7a85514632344148038e03a3c7c933c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:30:16 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-04432b4b-247e-4ea6-b9b6-46953399bd88 tempest-VolumesTestJSON-2121285435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd305e43-27c8-4cc0-b4cd-80432b28c805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:30:16 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-04432b4b-247e-4ea6-b9b6-46953399bd88 tempest-VolumesTestJSON-2121285435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd305e43-27c8-4cc0-b4cd-80432b28c805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:30:16 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-04432b4b-247e-4ea6-b9b6-46953399bd88 tempest-VolumesTestJSON-2121285435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c44a728-3e3b-4ba7-a871-df3704b84cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:30:16 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-04432b4b-247e-4ea6-b9b6-46953399bd88 tempest-VolumesTestJSON-2121285435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c44a728-3e3b-4ba7-a871-df3704b84cf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd17bc2a6-6df2-41fb-acbb-8979dd25148f', 'volume_name': 'volume-d17bc2a6-6df2-41fb-acbb-8979dd25148f', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:30:16 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-04432b4b-247e-4ea6-b9b6-46953399bd88 tempest-VolumesTestJSON-2121285435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2448c426-0eab-44a1-850d-59d21141b903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:30:16 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-04432b4b-247e-4ea6-b9b6-46953399bd88 tempest-VolumesTestJSON-2121285435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2448c426-0eab-44a1-850d-59d21141b903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:30:16 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-04432b4b-247e-4ea6-b9b6-46953399bd88 tempest-VolumesTestJSON-2121285435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30e4a1ba-c719-43e4-89d7-8bc10846ad6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:30:16 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-04432b4b-247e-4ea6-b9b6-46953399bd88 tempest-VolumesTestJSON-2121285435 None] Volume d17bc2a6-6df2-41fb-acbb-8979dd25148f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d17bc2a6-6df2-41fb-acbb-8979dd25148f', 'volume_size': 1} Sep 28 09:30:16 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-04432b4b-247e-4ea6-b9b6-46953399bd88 tempest-VolumesTestJSON-2121285435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:30:16 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-04432b4b-247e-4ea6-b9b6-46953399bd88 tempest-VolumesTestJSON-2121285435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:30:16 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-04432b4b-247e-4ea6-b9b6-46953399bd88 tempest-VolumesTestJSON-2121285435 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:30:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1463610592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d17bc2a6-6df2-41fb-acbb-8979dd25148f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1080cd625cb042c38d6329adcc59a77b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:30:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:30:16Z,use_quota=True,user_id='c7a85514632344148038e03a3c7c933c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:30:16 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-04432b4b-247e-4ea6-b9b6-46953399bd88 tempest-VolumesTestJSON-2121285435 None] Creating volume d17bc2a6-6df2-41fb-acbb-8979dd25148f {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:30:16 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-04432b4b-247e-4ea6-b9b6-46953399bd88 tempest-VolumesTestJSON-2121285435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:30:16 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-04432b4b-247e-4ea6-b9b6-46953399bd88 tempest-VolumesTestJSON-2121285435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:30:16 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-04432b4b-247e-4ea6-b9b6-46953399bd88 tempest-VolumesTestJSON-2121285435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:30:16 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-04432b4b-247e-4ea6-b9b6-46953399bd88 tempest-VolumesTestJSON-2121285435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:30:16 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-04432b4b-247e-4ea6-b9b6-46953399bd88 tempest-VolumesTestJSON-2121285435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:30:16 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-04432b4b-247e-4ea6-b9b6-46953399bd88 tempest-VolumesTestJSON-2121285435 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:30:16 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-04432b4b-247e-4ea6-b9b6-46953399bd88 tempest-VolumesTestJSON-2121285435 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:30:16 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-04432b4b-247e-4ea6-b9b6-46953399bd88 tempest-VolumesTestJSON-2121285435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d17bc2a6-6df2-41fb-acbb-8979dd25148f 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:30:16 devstack sudo[97732]: pam_unix(sudo:session): session closed for user root Sep 28 09:30:16 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0e0f1a26-c8ab-4c3d-8411-7e82ed588959 tempest-GroupSnapshotsTest-66536182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-aa8fbef0-4e85-43d3-ba7e-f41d355b7253" returned: 0 in 0.382s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:30:16 devstack sudo[97735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d17bc2a6-6df2-41fb-acbb-8979dd25148f 1073741824 Sep 28 09:30:16 devstack sudo[97735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:30:16 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-0e0f1a26-c8ab-4c3d-8411-7e82ed588959 tempest-GroupSnapshotsTest-66536182 None] Lock "cinder-quobyte-aa8fbef0-4e85-43d3-ba7e-f41d355b7253" released by "delete_volume" :: held 1.067s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:30:16 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-0e0f1a26-c8ab-4c3d-8411-7e82ed588959 tempest-GroupSnapshotsTest-66536182 None] Created reservations ['522a63d2-89c8-4cd4-8762-0157377b2195'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:30:16 devstack cinder-volume[86553]: WARNING cinder.quota [None req-0e0f1a26-c8ab-4c3d-8411-7e82ed588959 tempest-GroupSnapshotsTest-66536182 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-903579964 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-903579964, it is now deprecated. Please use the default quota class for default quota. Sep 28 09:30:16 devstack cinder-volume[86553]: WARNING cinder.quota [None req-0e0f1a26-c8ab-4c3d-8411-7e82ed588959 tempest-GroupSnapshotsTest-66536182 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-903579964 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-903579964, it is now deprecated. Please use the default quota class for default quota. Sep 28 09:30:16 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-0e0f1a26-c8ab-4c3d-8411-7e82ed588959 tempest-GroupSnapshotsTest-66536182 None] Created reservations ['21de45fd-02b0-4b10-91e8-6a82066b518b', '5217bc11-9b36-42f1-86e4-df44d10ff4f0', '40fe948a-5ab5-4bc5-8c16-a5f6ed4158b9', 'ce79e19c-3b0e-4e4b-9687-e7561fb08693'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:30:17 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-0e0f1a26-c8ab-4c3d-8411-7e82ed588959 tempest-GroupSnapshotsTest-66536182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:30:17 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-0e0f1a26-c8ab-4c3d-8411-7e82ed588959 tempest-GroupSnapshotsTest-66536182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:30:17 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-0e0f1a26-c8ab-4c3d-8411-7e82ed588959 tempest-GroupSnapshotsTest-66536182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:30:17 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-0e0f1a26-c8ab-4c3d-8411-7e82ed588959 tempest-GroupSnapshotsTest-66536182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:30:17 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-0e0f1a26-c8ab-4c3d-8411-7e82ed588959 tempest-GroupSnapshotsTest-66536182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:30:17 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0e0f1a26-c8ab-4c3d-8411-7e82ed588959 tempest-GroupSnapshotsTest-66536182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:30:17 devstack sudo[97742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:30:17 devstack sudo[97742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:30:17 devstack sudo[97735]: pam_unix(sudo:session): session closed for user root Sep 28 09:30:17 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-04432b4b-247e-4ea6-b9b6-46953399bd88 tempest-VolumesTestJSON-2121285435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d17bc2a6-6df2-41fb-acbb-8979dd25148f 1073741824" returned: 0 in 0.881s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:30:17 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-04432b4b-247e-4ea6-b9b6-46953399bd88 tempest-VolumesTestJSON-2121285435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d17bc2a6-6df2-41fb-acbb-8979dd25148f {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:30:17 devstack sudo[97742]: pam_unix(sudo:session): session closed for user root Sep 28 09:30:17 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0e0f1a26-c8ab-4c3d-8411-7e82ed588959 tempest-GroupSnapshotsTest-66536182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.325s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:30:17 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-0e0f1a26-c8ab-4c3d-8411-7e82ed588959 tempest-GroupSnapshotsTest-66536182 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:30:17 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-0e0f1a26-c8ab-4c3d-8411-7e82ed588959 tempest-GroupSnapshotsTest-66536182 None] Delete group completed successfully. Sep 28 09:30:17 devstack sudo[97747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d17bc2a6-6df2-41fb-acbb-8979dd25148f Sep 28 09:30:17 devstack sudo[97747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:30:17 devstack sudo[97747]: pam_unix(sudo:session): session closed for user root Sep 28 09:30:17 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-04432b4b-247e-4ea6-b9b6-46953399bd88 tempest-VolumesTestJSON-2121285435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d17bc2a6-6df2-41fb-acbb-8979dd25148f" returned: 0 in 0.268s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:30:17 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-04432b4b-247e-4ea6-b9b6-46953399bd88 tempest-VolumesTestJSON-2121285435 None] <== create_volume: return (1219ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:30:17 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-04432b4b-247e-4ea6-b9b6-46953399bd88 tempest-VolumesTestJSON-2121285435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.222s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:30:17 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-04432b4b-247e-4ea6-b9b6-46953399bd88 tempest-VolumesTestJSON-2121285435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30e4a1ba-c719-43e4-89d7-8bc10846ad6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d17bc2a6-6df2-41fb-acbb-8979dd25148f', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:30:17 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-04432b4b-247e-4ea6-b9b6-46953399bd88 tempest-VolumesTestJSON-2121285435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29dd4b9f-fdf6-4c23-bcde-4ea93cec381d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:30:17 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-04432b4b-247e-4ea6-b9b6-46953399bd88 tempest-VolumesTestJSON-2121285435 None] Volume volume-d17bc2a6-6df2-41fb-acbb-8979dd25148f (d17bc2a6-6df2-41fb-acbb-8979dd25148f): created successfully Sep 28 09:30:17 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-04432b4b-247e-4ea6-b9b6-46953399bd88 tempest-VolumesTestJSON-2121285435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29dd4b9f-fdf6-4c23-bcde-4ea93cec381d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:30:17 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-04432b4b-247e-4ea6-b9b6-46953399bd88 tempest-VolumesTestJSON-2121285435 None] Flow 'volume_create_manager' (30f888e7-067e-4b9e-96fc-5b9ff6157409) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:30:17 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-04432b4b-247e-4ea6-b9b6-46953399bd88 tempest-VolumesTestJSON-2121285435 None] Created volume successfully. Sep 28 09:30:18 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-5c2526e9-7995-4d15-add8-81b3ede21905 tempest-GroupSnapshotsTest-66536182 None] group_snapshot c2a0e1b3-93bb-4f48-9923-294ee76d4312: deleting Sep 28 09:30:18 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-77980088-78ef-4c8e-86a6-454d2c783faa tempest-VolumeQuotasNegativeTestJSON-74323896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:30:18 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-77980088-78ef-4c8e-86a6-454d2c783faa tempest-VolumeQuotasNegativeTestJSON-74323896 None] Flow 'volume_create_manager' (5e7e414a-b9cd-4ec9-9073-d8d2827eb1c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:30:18 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-77980088-78ef-4c8e-86a6-454d2c783faa tempest-VolumeQuotasNegativeTestJSON-74323896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c29e26b-b690-4c07-ba31-4764801db705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:30:18 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-77980088-78ef-4c8e-86a6-454d2c783faa tempest-VolumeQuotasNegativeTestJSON-74323896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c29e26b-b690-4c07-ba31-4764801db705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:30:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1584481315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=084d0fac-1312-4ab1-835c-fe116a3b0792,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d266fef74024ed298ea779e3a8adf94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:30:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:30:18Z,use_quota=True,user_id='8e9f33230cd14055845d672351004332',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:30:18 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-77980088-78ef-4c8e-86a6-454d2c783faa tempest-VolumeQuotasNegativeTestJSON-74323896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fe2883a-9608-445f-9a97-f50339a737a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:30:18 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-77980088-78ef-4c8e-86a6-454d2c783faa tempest-VolumeQuotasNegativeTestJSON-74323896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fe2883a-9608-445f-9a97-f50339a737a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:30:18 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-77980088-78ef-4c8e-86a6-454d2c783faa tempest-VolumeQuotasNegativeTestJSON-74323896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4b446b0-e3df-4b26-ae7c-3ffe804a3e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:30:18 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-77980088-78ef-4c8e-86a6-454d2c783faa tempest-VolumeQuotasNegativeTestJSON-74323896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4b446b0-e3df-4b26-ae7c-3ffe804a3e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '084d0fac-1312-4ab1-835c-fe116a3b0792', 'volume_name': 'volume-084d0fac-1312-4ab1-835c-fe116a3b0792', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:30:18 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-77980088-78ef-4c8e-86a6-454d2c783faa tempest-VolumeQuotasNegativeTestJSON-74323896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3683aeed-9a0b-48ef-9894-77dcb5a7c33c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:30:18 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-77980088-78ef-4c8e-86a6-454d2c783faa tempest-VolumeQuotasNegativeTestJSON-74323896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3683aeed-9a0b-48ef-9894-77dcb5a7c33c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:30:18 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-77980088-78ef-4c8e-86a6-454d2c783faa tempest-VolumeQuotasNegativeTestJSON-74323896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28d5deca-24ea-40c5-b588-dcaaf919c38d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:30:18 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-77980088-78ef-4c8e-86a6-454d2c783faa tempest-VolumeQuotasNegativeTestJSON-74323896 None] Volume 084d0fac-1312-4ab1-835c-fe116a3b0792: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-084d0fac-1312-4ab1-835c-fe116a3b0792', 'volume_size': 1} Sep 28 09:30:18 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-77980088-78ef-4c8e-86a6-454d2c783faa tempest-VolumeQuotasNegativeTestJSON-74323896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:30:18 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-77980088-78ef-4c8e-86a6-454d2c783faa tempest-VolumeQuotasNegativeTestJSON-74323896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:30:18 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-77980088-78ef-4c8e-86a6-454d2c783faa tempest-VolumeQuotasNegativeTestJSON-74323896 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:30:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1584481315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=084d0fac-1312-4ab1-835c-fe116a3b0792,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d266fef74024ed298ea779e3a8adf94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:30:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:30:18Z,use_quota=True,user_id='8e9f33230cd14055845d672351004332',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:30:18 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-77980088-78ef-4c8e-86a6-454d2c783faa tempest-VolumeQuotasNegativeTestJSON-74323896 None] Creating volume 084d0fac-1312-4ab1-835c-fe116a3b0792 {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:30:18 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-77980088-78ef-4c8e-86a6-454d2c783faa tempest-VolumeQuotasNegativeTestJSON-74323896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:30:18 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-77980088-78ef-4c8e-86a6-454d2c783faa tempest-VolumeQuotasNegativeTestJSON-74323896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:30:18 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-77980088-78ef-4c8e-86a6-454d2c783faa tempest-VolumeQuotasNegativeTestJSON-74323896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:30:18 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-77980088-78ef-4c8e-86a6-454d2c783faa tempest-VolumeQuotasNegativeTestJSON-74323896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:30:18 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-77980088-78ef-4c8e-86a6-454d2c783faa tempest-VolumeQuotasNegativeTestJSON-74323896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:30:18 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-77980088-78ef-4c8e-86a6-454d2c783faa tempest-VolumeQuotasNegativeTestJSON-74323896 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:30:18 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-77980088-78ef-4c8e-86a6-454d2c783faa tempest-VolumeQuotasNegativeTestJSON-74323896 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:30:18 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-77980088-78ef-4c8e-86a6-454d2c783faa tempest-VolumeQuotasNegativeTestJSON-74323896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-084d0fac-1312-4ab1-835c-fe116a3b0792 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:30:18 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-5c2526e9-7995-4d15-add8-81b3ede21905 tempest-GroupSnapshotsTest-66536182 None] group_snapshot c2a0e1b3-93bb-4f48-9923-294ee76d4312: deleting {{(pid=86553) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 09:30:18 devstack sudo[97750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-084d0fac-1312-4ab1-835c-fe116a3b0792 1073741824 Sep 28 09:30:18 devstack sudo[97750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:30:18 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-5c2526e9-7995-4d15-add8-81b3ede21905 tempest-GroupSnapshotsTest-66536182 None] Acquiring lock "cinder-quobyte-3d167427-800f-4ea9-a81b-2413a90f56ae" by "delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:30:18 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-5c2526e9-7995-4d15-add8-81b3ede21905 tempest-GroupSnapshotsTest-66536182 None] Lock "cinder-quobyte-3d167427-800f-4ea9-a81b-2413a90f56ae" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:30:18 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-5c2526e9-7995-4d15-add8-81b3ede21905 tempest-GroupSnapshotsTest-66536182 None] Acquiring lock "cinder-quobyte-7c3245c8-507d-43d9-b9b8-3aa8f11e8b8e" by "_delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:30:18 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-5c2526e9-7995-4d15-add8-81b3ede21905 tempest-GroupSnapshotsTest-66536182 None] Lock "cinder-quobyte-7c3245c8-507d-43d9-b9b8-3aa8f11e8b8e" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:30:18 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-5c2526e9-7995-4d15-add8-81b3ede21905 tempest-GroupSnapshotsTest-66536182 None] Deleting offline snapshot 7c3245c8-507d-43d9-b9b8-3aa8f11e8b8e of volume 3d167427-800f-4ea9-a81b-2413a90f56ae {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 09:30:18 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-5c2526e9-7995-4d15-add8-81b3ede21905 tempest-GroupSnapshotsTest-66536182 None] snapshot_file for this snap is: volume-3d167427-800f-4ea9-a81b-2413a90f56ae.7c3245c8-507d-43d9-b9b8-3aa8f11e8b8e {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 09:30:18 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef6eeaa-15ef-4a05-990b-9b01b1c2ab7d]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:30:18 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-5c2526e9-7995-4d15-add8-81b3ede21905 tempest-GroupSnapshotsTest-66536182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3d167427-800f-4ea9-a81b-2413a90f56ae.7c3245c8-507d-43d9-b9b8-3aa8f11e8b8e {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:30:18 devstack sudo[97752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3d167427-800f-4ea9-a81b-2413a90f56ae.7c3245c8-507d-43d9-b9b8-3aa8f11e8b8e Sep 28 09:30:18 devstack sudo[97752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:30:19 devstack sudo[97750]: pam_unix(sudo:session): session closed for user root Sep 28 09:30:19 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-77980088-78ef-4c8e-86a6-454d2c783faa tempest-VolumeQuotasNegativeTestJSON-74323896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-084d0fac-1312-4ab1-835c-fe116a3b0792 1073741824" returned: 0 in 0.651s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:30:19 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-77980088-78ef-4c8e-86a6-454d2c783faa tempest-VolumeQuotasNegativeTestJSON-74323896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-084d0fac-1312-4ab1-835c-fe116a3b0792 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:30:19 devstack sudo[97760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-084d0fac-1312-4ab1-835c-fe116a3b0792 Sep 28 09:30:19 devstack sudo[97760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:30:19 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-c85fd642-4569-4a60-bae3-cdfd3896e0ba tempest-VolumesTestJSON-2121285435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:30:19 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-c85fd642-4569-4a60-bae3-cdfd3896e0ba tempest-VolumesTestJSON-2121285435 None] Flow 'volume_create_manager' (f0a7571c-4306-4efb-a2d4-ee44e77417a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:30:19 devstack sudo[97752]: pam_unix(sudo:session): session closed for user root Sep 28 09:30:19 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-c85fd642-4569-4a60-bae3-cdfd3896e0ba tempest-VolumesTestJSON-2121285435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e951652c-83e2-49fd-9d06-36555821c5b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:30:19 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-5c2526e9-7995-4d15-add8-81b3ede21905 tempest-GroupSnapshotsTest-66536182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3d167427-800f-4ea9-a81b-2413a90f56ae.7c3245c8-507d-43d9-b9b8-3aa8f11e8b8e" returned: 0 in 0.664s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:30:19 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-5c2526e9-7995-4d15-add8-81b3ede21905 tempest-GroupSnapshotsTest-66536182 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d167427-800f-4ea9-a81b-2413a90f56ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86553) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 09:30:19 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-c85fd642-4569-4a60-bae3-cdfd3896e0ba tempest-VolumesTestJSON-2121285435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e951652c-83e2-49fd-9d06-36555821c5b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:30:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2100254855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=034df405-9281-49f8-83d0-28bbe37690df,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1080cd625cb042c38d6329adcc59a77b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:30:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:30:19Z,use_quota=True,user_id='c7a85514632344148038e03a3c7c933c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:30:19 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-c85fd642-4569-4a60-bae3-cdfd3896e0ba tempest-VolumesTestJSON-2121285435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be159019-35e5-4c6c-9f4a-957c58ae8c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:30:19 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-c85fd642-4569-4a60-bae3-cdfd3896e0ba tempest-VolumesTestJSON-2121285435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be159019-35e5-4c6c-9f4a-957c58ae8c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:30:19 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-c85fd642-4569-4a60-bae3-cdfd3896e0ba tempest-VolumesTestJSON-2121285435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ce3bb4f-9596-4b50-8b0c-ae745e074f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:30:19 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-c85fd642-4569-4a60-bae3-cdfd3896e0ba tempest-VolumesTestJSON-2121285435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ce3bb4f-9596-4b50-8b0c-ae745e074f3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '034df405-9281-49f8-83d0-28bbe37690df', 'volume_name': 'volume-034df405-9281-49f8-83d0-28bbe37690df', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:30:19 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-c85fd642-4569-4a60-bae3-cdfd3896e0ba tempest-VolumesTestJSON-2121285435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b157084d-4717-4ecd-b39e-72576c8863c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:30:19 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-c85fd642-4569-4a60-bae3-cdfd3896e0ba tempest-VolumesTestJSON-2121285435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b157084d-4717-4ecd-b39e-72576c8863c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:30:19 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-c85fd642-4569-4a60-bae3-cdfd3896e0ba tempest-VolumesTestJSON-2121285435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f4bf87c-987c-4baa-92a4-69380cb51019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:30:19 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-c85fd642-4569-4a60-bae3-cdfd3896e0ba tempest-VolumesTestJSON-2121285435 None] Volume 034df405-9281-49f8-83d0-28bbe37690df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-034df405-9281-49f8-83d0-28bbe37690df', 'volume_size': 1} Sep 28 09:30:19 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-c85fd642-4569-4a60-bae3-cdfd3896e0ba tempest-VolumesTestJSON-2121285435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:30:19 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab768c0-198c-45a3-9282-935903369ac2]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:30:19 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-5c2526e9-7995-4d15-add8-81b3ede21905 tempest-GroupSnapshotsTest-66536182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3d167427-800f-4ea9-a81b-2413a90f56ae {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:30:19 devstack sudo[97760]: pam_unix(sudo:session): session closed for user root Sep 28 09:30:19 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-77980088-78ef-4c8e-86a6-454d2c783faa tempest-VolumeQuotasNegativeTestJSON-74323896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-084d0fac-1312-4ab1-835c-fe116a3b0792" returned: 0 in 0.367s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:30:19 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-77980088-78ef-4c8e-86a6-454d2c783faa tempest-VolumeQuotasNegativeTestJSON-74323896 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:30:19 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-77980088-78ef-4c8e-86a6-454d2c783faa tempest-VolumeQuotasNegativeTestJSON-74323896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.077s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:30:19 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-c85fd642-4569-4a60-bae3-cdfd3896e0ba tempest-VolumesTestJSON-2121285435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.150s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:30:19 devstack sudo[97763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3d167427-800f-4ea9-a81b-2413a90f56ae Sep 28 09:30:19 devstack sudo[97763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:30:19 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-c85fd642-4569-4a60-bae3-cdfd3896e0ba tempest-VolumesTestJSON-2121285435 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:30:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2100254855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=034df405-9281-49f8-83d0-28bbe37690df,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1080cd625cb042c38d6329adcc59a77b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:30:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:30:19Z,use_quota=True,user_id='c7a85514632344148038e03a3c7c933c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:30:19 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-c85fd642-4569-4a60-bae3-cdfd3896e0ba tempest-VolumesTestJSON-2121285435 None] Creating volume 034df405-9281-49f8-83d0-28bbe37690df {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:30:19 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-c85fd642-4569-4a60-bae3-cdfd3896e0ba tempest-VolumesTestJSON-2121285435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:30:19 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-c85fd642-4569-4a60-bae3-cdfd3896e0ba tempest-VolumesTestJSON-2121285435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:30:19 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-c85fd642-4569-4a60-bae3-cdfd3896e0ba tempest-VolumesTestJSON-2121285435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:30:19 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-c85fd642-4569-4a60-bae3-cdfd3896e0ba tempest-VolumesTestJSON-2121285435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:30:19 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-c85fd642-4569-4a60-bae3-cdfd3896e0ba tempest-VolumesTestJSON-2121285435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:30:19 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-c85fd642-4569-4a60-bae3-cdfd3896e0ba tempest-VolumesTestJSON-2121285435 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:30:19 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-c85fd642-4569-4a60-bae3-cdfd3896e0ba tempest-VolumesTestJSON-2121285435 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:30:19 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c85fd642-4569-4a60-bae3-cdfd3896e0ba tempest-VolumesTestJSON-2121285435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-034df405-9281-49f8-83d0-28bbe37690df 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:30:19 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-77980088-78ef-4c8e-86a6-454d2c783faa tempest-VolumeQuotasNegativeTestJSON-74323896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28d5deca-24ea-40c5-b588-dcaaf919c38d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-084d0fac-1312-4ab1-835c-fe116a3b0792', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:30:19 devstack sudo[97766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-034df405-9281-49f8-83d0-28bbe37690df 1073741824 Sep 28 09:30:19 devstack sudo[97766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:30:19 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-77980088-78ef-4c8e-86a6-454d2c783faa tempest-VolumeQuotasNegativeTestJSON-74323896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b26a95ac-ac7c-400f-9ed3-f83a4e481601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:30:19 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-77980088-78ef-4c8e-86a6-454d2c783faa tempest-VolumeQuotasNegativeTestJSON-74323896 None] Volume volume-084d0fac-1312-4ab1-835c-fe116a3b0792 (084d0fac-1312-4ab1-835c-fe116a3b0792): created successfully Sep 28 09:30:19 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-77980088-78ef-4c8e-86a6-454d2c783faa tempest-VolumeQuotasNegativeTestJSON-74323896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b26a95ac-ac7c-400f-9ed3-f83a4e481601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:30:19 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-77980088-78ef-4c8e-86a6-454d2c783faa tempest-VolumeQuotasNegativeTestJSON-74323896 None] Flow 'volume_create_manager' (5e7e414a-b9cd-4ec9-9073-d8d2827eb1c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:30:19 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-77980088-78ef-4c8e-86a6-454d2c783faa tempest-VolumeQuotasNegativeTestJSON-74323896 None] Created volume successfully. Sep 28 09:30:20 devstack sudo[97763]: pam_unix(sudo:session): session closed for user root Sep 28 09:30:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-5c2526e9-7995-4d15-add8-81b3ede21905 tempest-GroupSnapshotsTest-66536182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3d167427-800f-4ea9-a81b-2413a90f56ae" returned: 0 in 0.675s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:30:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-5c2526e9-7995-4d15-add8-81b3ede21905 tempest-GroupSnapshotsTest-66536182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3d167427-800f-4ea9-a81b-2413a90f56ae.7c3245c8-507d-43d9-b9b8-3aa8f11e8b8e {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:30:20 devstack sudo[97775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3d167427-800f-4ea9-a81b-2413a90f56ae.7c3245c8-507d-43d9-b9b8-3aa8f11e8b8e Sep 28 09:30:20 devstack sudo[97775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:30:20 devstack sudo[97766]: pam_unix(sudo:session): session closed for user root Sep 28 09:30:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c85fd642-4569-4a60-bae3-cdfd3896e0ba tempest-VolumesTestJSON-2121285435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-034df405-9281-49f8-83d0-28bbe37690df 1073741824" returned: 0 in 0.616s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:30:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c85fd642-4569-4a60-bae3-cdfd3896e0ba tempest-VolumesTestJSON-2121285435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-034df405-9281-49f8-83d0-28bbe37690df {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:30:20 devstack sudo[97777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-034df405-9281-49f8-83d0-28bbe37690df Sep 28 09:30:20 devstack sudo[97777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:30:20 devstack sudo[97775]: pam_unix(sudo:session): session closed for user root Sep 28 09:30:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-5c2526e9-7995-4d15-add8-81b3ede21905 tempest-GroupSnapshotsTest-66536182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3d167427-800f-4ea9-a81b-2413a90f56ae.7c3245c8-507d-43d9-b9b8-3aa8f11e8b8e" returned: 0 in 0.455s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:30:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-5c2526e9-7995-4d15-add8-81b3ede21905 tempest-GroupSnapshotsTest-66536182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3d167427-800f-4ea9-a81b-2413a90f56ae.7c3245c8-507d-43d9-b9b8-3aa8f11e8b8e {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:30:20 devstack sudo[97777]: pam_unix(sudo:session): session closed for user root Sep 28 09:30:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c85fd642-4569-4a60-bae3-cdfd3896e0ba tempest-VolumesTestJSON-2121285435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-034df405-9281-49f8-83d0-28bbe37690df" returned: 0 in 0.351s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:30:20 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-c85fd642-4569-4a60-bae3-cdfd3896e0ba tempest-VolumesTestJSON-2121285435 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:30:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-c85fd642-4569-4a60-bae3-cdfd3896e0ba tempest-VolumesTestJSON-2121285435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:30:20 devstack sudo[97787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3d167427-800f-4ea9-a81b-2413a90f56ae.7c3245c8-507d-43d9-b9b8-3aa8f11e8b8e Sep 28 09:30:20 devstack sudo[97787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:30:20 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-c85fd642-4569-4a60-bae3-cdfd3896e0ba tempest-VolumesTestJSON-2121285435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f4bf87c-987c-4baa-92a4-69380cb51019) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-034df405-9281-49f8-83d0-28bbe37690df', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:30:20 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-c85fd642-4569-4a60-bae3-cdfd3896e0ba tempest-VolumesTestJSON-2121285435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b300c96-8a6c-47ed-b1b1-49f399ef903b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:30:20 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-c85fd642-4569-4a60-bae3-cdfd3896e0ba tempest-VolumesTestJSON-2121285435 None] Volume volume-034df405-9281-49f8-83d0-28bbe37690df (034df405-9281-49f8-83d0-28bbe37690df): created successfully Sep 28 09:30:20 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-c85fd642-4569-4a60-bae3-cdfd3896e0ba tempest-VolumesTestJSON-2121285435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b300c96-8a6c-47ed-b1b1-49f399ef903b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:30:20 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-c85fd642-4569-4a60-bae3-cdfd3896e0ba tempest-VolumesTestJSON-2121285435 None] Flow 'volume_create_manager' (f0a7571c-4306-4efb-a2d4-ee44e77417a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:30:20 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-c85fd642-4569-4a60-bae3-cdfd3896e0ba tempest-VolumesTestJSON-2121285435 None] Created volume successfully. Sep 28 09:30:20 devstack sudo[97787]: pam_unix(sudo:session): session closed for user root Sep 28 09:30:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-5c2526e9-7995-4d15-add8-81b3ede21905 tempest-GroupSnapshotsTest-66536182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3d167427-800f-4ea9-a81b-2413a90f56ae.7c3245c8-507d-43d9-b9b8-3aa8f11e8b8e" returned: 0 in 0.357s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:30:20 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-5c2526e9-7995-4d15-add8-81b3ede21905 tempest-GroupSnapshotsTest-66536182 None] Lock "cinder-quobyte-7c3245c8-507d-43d9-b9b8-3aa8f11e8b8e" released by "_delete_snapshot" :: held 2.356s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:30:20 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-5c2526e9-7995-4d15-add8-81b3ede21905 tempest-GroupSnapshotsTest-66536182 None] Lock "cinder-quobyte-3d167427-800f-4ea9-a81b-2413a90f56ae" released by "delete_snapshot" :: held 2.389s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:30:20 devstack cinder-volume[86553]: WARNING cinder.quota [None req-5c2526e9-7995-4d15-add8-81b3ede21905 tempest-GroupSnapshotsTest-66536182 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-903579964 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-903579964, it is now deprecated. Please use the default quota class for default quota. Sep 28 09:30:21 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-5c2526e9-7995-4d15-add8-81b3ede21905 tempest-GroupSnapshotsTest-66536182 None] Created reservations ['e584e6e2-1425-427e-bb0c-6365d0738dfa', '1dbaaf0e-75b9-4ccf-bb5f-b92547600606', 'e264a967-91bb-4e99-a3e3-f6c7053fcc48', '52bd9094-51df-4696-8298-57bbff792e3f'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:30:21 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-5c2526e9-7995-4d15-add8-81b3ede21905 tempest-GroupSnapshotsTest-66536182 None] group_snapshot c2a0e1b3-93bb-4f48-9923-294ee76d4312: deleted successfully Sep 28 09:30:21 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-1efc29e8-88ac-4e31-8b83-92798dd9232f tempest-VolumeQuotasNegativeTestJSON-74323896 None] Acquiring lock "cinder-084d0fac-1312-4ab1-835c-fe116a3b0792-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:30:21 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-1efc29e8-88ac-4e31-8b83-92798dd9232f tempest-VolumeQuotasNegativeTestJSON-74323896 None] Lock "cinder-084d0fac-1312-4ab1-835c-fe116a3b0792-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:30:21 devstack cinder-volume[86553]: DEBUG oslo_service.periodic_task [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86553) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 09:30:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:30:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:30:21 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:30:21 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:30:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:30:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:30:21 devstack sudo[97790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:30:21 devstack sudo[97790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:30:21 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-1efc29e8-88ac-4e31-8b83-92798dd9232f tempest-VolumeQuotasNegativeTestJSON-74323896 None] Acquiring lock "cinder-quobyte-084d0fac-1312-4ab1-835c-fe116a3b0792" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:30:21 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-1efc29e8-88ac-4e31-8b83-92798dd9232f tempest-VolumeQuotasNegativeTestJSON-74323896 None] Lock "cinder-quobyte-084d0fac-1312-4ab1-835c-fe116a3b0792" acquired by "delete_volume" :: waited 0.016s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:30:21 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[606cb08c-c622-4ab2-8c26-62961ac06cfd]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:30:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1efc29e8-88ac-4e31-8b83-92798dd9232f tempest-VolumeQuotasNegativeTestJSON-74323896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-084d0fac-1312-4ab1-835c-fe116a3b0792 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:30:21 devstack sudo[97792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-084d0fac-1312-4ab1-835c-fe116a3b0792 Sep 28 09:30:21 devstack sudo[97792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:30:21 devstack sudo[97790]: pam_unix(sudo:session): session closed for user root Sep 28 09:30:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.370s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:30:21 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:30:21 devstack cinder-volume[86553]: DEBUG oslo_service.periodic_task [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Running periodic task VolumeManager._thread_info {{(pid=86553) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 09:30:21 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] thread count: 28 {{(pid=86553) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 09:30:21 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] thread info: [<_MainThread(MainThread, started 134684877779072)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86553) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 09:30:22 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-0d80f1a4-7796-4b6d-8159-9d1ed82d2939 tempest-GroupSnapshotsTest-66536182 None] Acquiring lock "cinder-quobyte-3d167427-800f-4ea9-a81b-2413a90f56ae" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:30:22 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-0d80f1a4-7796-4b6d-8159-9d1ed82d2939 tempest-GroupSnapshotsTest-66536182 None] Lock "cinder-quobyte-3d167427-800f-4ea9-a81b-2413a90f56ae" acquired by "delete_volume" :: waited 0.053s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:30:22 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[254e8715-e8a8-4c97-bf84-af9579511bed]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:30:22 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0d80f1a4-7796-4b6d-8159-9d1ed82d2939 tempest-GroupSnapshotsTest-66536182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3d167427-800f-4ea9-a81b-2413a90f56ae {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:30:22 devstack sudo[97792]: pam_unix(sudo:session): session closed for user root Sep 28 09:30:22 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1efc29e8-88ac-4e31-8b83-92798dd9232f tempest-VolumeQuotasNegativeTestJSON-74323896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-084d0fac-1312-4ab1-835c-fe116a3b0792" returned: 0 in 0.742s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:30:22 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1efc29e8-88ac-4e31-8b83-92798dd9232f tempest-VolumeQuotasNegativeTestJSON-74323896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-084d0fac-1312-4ab1-835c-fe116a3b0792 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:30:22 devstack sudo[97801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-084d0fac-1312-4ab1-835c-fe116a3b0792 Sep 28 09:30:22 devstack sudo[97801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:30:22 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-dc230cd8-1cd9-4ff0-8992-99de8800274e tempest-VolumesTestJSON-2121285435 None] Acquiring lock "cinder-034df405-9281-49f8-83d0-28bbe37690df-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:30:22 devstack sudo[97800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3d167427-800f-4ea9-a81b-2413a90f56ae Sep 28 09:30:22 devstack sudo[97800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:30:22 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-dc230cd8-1cd9-4ff0-8992-99de8800274e tempest-VolumesTestJSON-2121285435 None] Lock "cinder-034df405-9281-49f8-83d0-28bbe37690df-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:30:22 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-dc230cd8-1cd9-4ff0-8992-99de8800274e tempest-VolumesTestJSON-2121285435 None] Acquiring lock "cinder-quobyte-034df405-9281-49f8-83d0-28bbe37690df" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:30:22 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-dc230cd8-1cd9-4ff0-8992-99de8800274e tempest-VolumesTestJSON-2121285435 None] Lock "cinder-quobyte-034df405-9281-49f8-83d0-28bbe37690df" acquired by "delete_volume" :: waited 0.027s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:30:22 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[b939cdf4-5657-4366-8432-0f555fcf8487]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:30:22 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-dc230cd8-1cd9-4ff0-8992-99de8800274e tempest-VolumesTestJSON-2121285435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-034df405-9281-49f8-83d0-28bbe37690df {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:30:22 devstack sudo[97801]: pam_unix(sudo:session): session closed for user root Sep 28 09:30:22 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1efc29e8-88ac-4e31-8b83-92798dd9232f tempest-VolumeQuotasNegativeTestJSON-74323896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-084d0fac-1312-4ab1-835c-fe116a3b0792" returned: 0 in 0.484s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:30:22 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-1efc29e8-88ac-4e31-8b83-92798dd9232f tempest-VolumeQuotasNegativeTestJSON-74323896 None] Lock "cinder-quobyte-084d0fac-1312-4ab1-835c-fe116a3b0792" released by "delete_volume" :: held 1.313s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:30:23 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-1efc29e8-88ac-4e31-8b83-92798dd9232f tempest-VolumeQuotasNegativeTestJSON-74323896 None] Created reservations ['4d026fb8-2a40-4933-8b10-79363b899c3d', '84d4ed8d-ee0b-4c7d-a31d-49850a86d1ea', '2a8ab1ba-0ea2-44ef-bbd7-f8714604952d', 'c000f077-796f-4624-b724-92ba0d894525'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:30:23 devstack sudo[97805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-034df405-9281-49f8-83d0-28bbe37690df Sep 28 09:30:23 devstack sudo[97805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:30:23 devstack sudo[97800]: pam_unix(sudo:session): session closed for user root Sep 28 09:30:23 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0d80f1a4-7796-4b6d-8159-9d1ed82d2939 tempest-GroupSnapshotsTest-66536182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3d167427-800f-4ea9-a81b-2413a90f56ae" returned: 0 in 0.693s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:30:23 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0d80f1a4-7796-4b6d-8159-9d1ed82d2939 tempest-GroupSnapshotsTest-66536182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3d167427-800f-4ea9-a81b-2413a90f56ae {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:30:23 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-1efc29e8-88ac-4e31-8b83-92798dd9232f tempest-VolumeQuotasNegativeTestJSON-74323896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:30:23 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-1efc29e8-88ac-4e31-8b83-92798dd9232f tempest-VolumeQuotasNegativeTestJSON-74323896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:30:23 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-1efc29e8-88ac-4e31-8b83-92798dd9232f tempest-VolumeQuotasNegativeTestJSON-74323896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:30:23 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-1efc29e8-88ac-4e31-8b83-92798dd9232f tempest-VolumeQuotasNegativeTestJSON-74323896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:30:23 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-1efc29e8-88ac-4e31-8b83-92798dd9232f tempest-VolumeQuotasNegativeTestJSON-74323896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:30:23 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1efc29e8-88ac-4e31-8b83-92798dd9232f tempest-VolumeQuotasNegativeTestJSON-74323896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:30:23 devstack sudo[97810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3d167427-800f-4ea9-a81b-2413a90f56ae Sep 28 09:30:23 devstack sudo[97810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:30:23 devstack sudo[97812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:30:23 devstack sudo[97812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:30:23 devstack sudo[97810]: pam_unix(sudo:session): session closed for user root Sep 28 09:30:23 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0d80f1a4-7796-4b6d-8159-9d1ed82d2939 tempest-GroupSnapshotsTest-66536182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3d167427-800f-4ea9-a81b-2413a90f56ae" returned: 0 in 0.382s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:30:23 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-0d80f1a4-7796-4b6d-8159-9d1ed82d2939 tempest-GroupSnapshotsTest-66536182 None] Lock "cinder-quobyte-3d167427-800f-4ea9-a81b-2413a90f56ae" released by "delete_volume" :: held 1.231s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:30:23 devstack sudo[97812]: pam_unix(sudo:session): session closed for user root Sep 28 09:30:23 devstack sudo[97805]: pam_unix(sudo:session): session closed for user root Sep 28 09:30:23 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1efc29e8-88ac-4e31-8b83-92798dd9232f tempest-VolumeQuotasNegativeTestJSON-74323896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.373s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:30:23 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-1efc29e8-88ac-4e31-8b83-92798dd9232f tempest-VolumeQuotasNegativeTestJSON-74323896 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:30:23 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-dc230cd8-1cd9-4ff0-8992-99de8800274e tempest-VolumesTestJSON-2121285435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-034df405-9281-49f8-83d0-28bbe37690df" returned: 0 in 0.646s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:30:23 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-dc230cd8-1cd9-4ff0-8992-99de8800274e tempest-VolumesTestJSON-2121285435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-034df405-9281-49f8-83d0-28bbe37690df {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:30:23 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-1efc29e8-88ac-4e31-8b83-92798dd9232f tempest-VolumeQuotasNegativeTestJSON-74323896 None] Deleted volume successfully. Sep 28 09:30:23 devstack sudo[97819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-034df405-9281-49f8-83d0-28bbe37690df Sep 28 09:30:23 devstack sudo[97819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:30:23 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-1efc29e8-88ac-4e31-8b83-92798dd9232f tempest-VolumeQuotasNegativeTestJSON-74323896 None] Lock "cinder-084d0fac-1312-4ab1-835c-fe116a3b0792-delete_volume" released by "delete_volume" :: held 2.121s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:30:23 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-0d80f1a4-7796-4b6d-8159-9d1ed82d2939 tempest-GroupSnapshotsTest-66536182 None] Created reservations ['efc61d0c-d931-41c8-a377-128ecf41ed94'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:30:23 devstack cinder-volume[86553]: WARNING cinder.db.api [None req-0d80f1a4-7796-4b6d-8159-9d1ed82d2939 tempest-GroupSnapshotsTest-66536182 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-903579964'] Sep 28 09:30:23 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-0d80f1a4-7796-4b6d-8159-9d1ed82d2939 tempest-GroupSnapshotsTest-66536182 None] Created reservations ['fb5b5524-7ae4-4ab0-b456-75a9f588d493', '18b2354f-9193-4819-8516-169c237a7db2', 'fd9c7f7b-6ec5-4091-b830-9e6867b8e1f4', '31166346-5372-406b-9938-faf1a098292d'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:30:24 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-0d80f1a4-7796-4b6d-8159-9d1ed82d2939 tempest-GroupSnapshotsTest-66536182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:30:24 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-0d80f1a4-7796-4b6d-8159-9d1ed82d2939 tempest-GroupSnapshotsTest-66536182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:30:24 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-0d80f1a4-7796-4b6d-8159-9d1ed82d2939 tempest-GroupSnapshotsTest-66536182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:30:24 devstack sudo[97819]: pam_unix(sudo:session): session closed for user root Sep 28 09:30:24 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-0d80f1a4-7796-4b6d-8159-9d1ed82d2939 tempest-GroupSnapshotsTest-66536182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:30:24 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-0d80f1a4-7796-4b6d-8159-9d1ed82d2939 tempest-GroupSnapshotsTest-66536182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:30:24 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0d80f1a4-7796-4b6d-8159-9d1ed82d2939 tempest-GroupSnapshotsTest-66536182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:30:24 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-dc230cd8-1cd9-4ff0-8992-99de8800274e tempest-VolumesTestJSON-2121285435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-034df405-9281-49f8-83d0-28bbe37690df" returned: 0 in 0.595s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:30:24 devstack sudo[97822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:30:24 devstack sudo[97822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:30:24 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-dc230cd8-1cd9-4ff0-8992-99de8800274e tempest-VolumesTestJSON-2121285435 None] Lock "cinder-quobyte-034df405-9281-49f8-83d0-28bbe37690df" released by "delete_volume" :: held 1.322s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:30:24 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-dc230cd8-1cd9-4ff0-8992-99de8800274e tempest-VolumesTestJSON-2121285435 None] Created reservations ['33e93ac3-5f43-4430-9cba-232c8c93f3f3', '70c2f04c-89d6-4a71-a6ca-b9ee6afca458', 'd827c09a-8675-4e5d-b862-fd51c3494139', '53737f26-b911-4944-bc51-c3db298c0e95'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:30:24 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-dc230cd8-1cd9-4ff0-8992-99de8800274e tempest-VolumesTestJSON-2121285435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:30:24 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-dc230cd8-1cd9-4ff0-8992-99de8800274e tempest-VolumesTestJSON-2121285435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:30:24 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-dc230cd8-1cd9-4ff0-8992-99de8800274e tempest-VolumesTestJSON-2121285435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:30:24 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-dc230cd8-1cd9-4ff0-8992-99de8800274e tempest-VolumesTestJSON-2121285435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:30:24 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-dc230cd8-1cd9-4ff0-8992-99de8800274e tempest-VolumesTestJSON-2121285435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:30:24 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-dc230cd8-1cd9-4ff0-8992-99de8800274e tempest-VolumesTestJSON-2121285435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:30:24 devstack sudo[97824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:30:24 devstack sudo[97824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:30:24 devstack sudo[97822]: pam_unix(sudo:session): session closed for user root Sep 28 09:30:24 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0d80f1a4-7796-4b6d-8159-9d1ed82d2939 tempest-GroupSnapshotsTest-66536182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.312s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:30:24 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-0d80f1a4-7796-4b6d-8159-9d1ed82d2939 tempest-GroupSnapshotsTest-66536182 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:30:24 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-0d80f1a4-7796-4b6d-8159-9d1ed82d2939 tempest-GroupSnapshotsTest-66536182 None] Delete group completed successfully. Sep 28 09:30:24 devstack sudo[97824]: pam_unix(sudo:session): session closed for user root Sep 28 09:30:24 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-dc230cd8-1cd9-4ff0-8992-99de8800274e tempest-VolumesTestJSON-2121285435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.320s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:30:24 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-dc230cd8-1cd9-4ff0-8992-99de8800274e tempest-VolumesTestJSON-2121285435 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:30:24 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-dc230cd8-1cd9-4ff0-8992-99de8800274e tempest-VolumesTestJSON-2121285435 None] Deleted volume successfully. Sep 28 09:30:24 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-dc230cd8-1cd9-4ff0-8992-99de8800274e tempest-VolumesTestJSON-2121285435 None] Lock "cinder-034df405-9281-49f8-83d0-28bbe37690df-delete_volume" released by "delete_volume" :: held 1.954s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:30:25 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-d73778fc-a636-4805-b76f-1f6820b619ec tempest-VolumesTestJSON-2121285435 None] Acquiring lock "cinder-d17bc2a6-6df2-41fb-acbb-8979dd25148f-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:30:25 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-d73778fc-a636-4805-b76f-1f6820b619ec tempest-VolumesTestJSON-2121285435 None] Lock "cinder-d17bc2a6-6df2-41fb-acbb-8979dd25148f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:30:25 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-d73778fc-a636-4805-b76f-1f6820b619ec tempest-VolumesTestJSON-2121285435 None] Acquiring lock "cinder-quobyte-d17bc2a6-6df2-41fb-acbb-8979dd25148f" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:30:25 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-d73778fc-a636-4805-b76f-1f6820b619ec tempest-VolumesTestJSON-2121285435 None] Lock "cinder-quobyte-d17bc2a6-6df2-41fb-acbb-8979dd25148f" acquired by "delete_volume" :: waited 0.020s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:30:25 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed72e699-d96a-4181-b0aa-55bdff281d9d]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:30:25 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-d73778fc-a636-4805-b76f-1f6820b619ec tempest-VolumesTestJSON-2121285435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d17bc2a6-6df2-41fb-acbb-8979dd25148f {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:30:25 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-b37f076f-29e6-4e17-8c41-071304a26cb1 tempest-GroupSnapshotsTest-66536182 None] Group tempest-GroupSnapshotsTest-Group-628960400: creating Sep 28 09:30:25 devstack sudo[97828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d17bc2a6-6df2-41fb-acbb-8979dd25148f Sep 28 09:30:25 devstack sudo[97828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:30:25 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-b37f076f-29e6-4e17-8c41-071304a26cb1 tempest-GroupSnapshotsTest-66536182 None] Group tempest-GroupSnapshotsTest-Group-628960400: created successfully Sep 28 09:30:25 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-b37f076f-29e6-4e17-8c41-071304a26cb1 tempest-GroupSnapshotsTest-66536182 None] Create group completed successfully. Sep 28 09:30:25 devstack sudo[97828]: pam_unix(sudo:session): session closed for user root Sep 28 09:30:25 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-d73778fc-a636-4805-b76f-1f6820b619ec tempest-VolumesTestJSON-2121285435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d17bc2a6-6df2-41fb-acbb-8979dd25148f" returned: 0 in 0.478s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:30:25 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-d73778fc-a636-4805-b76f-1f6820b619ec tempest-VolumesTestJSON-2121285435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d17bc2a6-6df2-41fb-acbb-8979dd25148f {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:30:25 devstack sudo[97833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d17bc2a6-6df2-41fb-acbb-8979dd25148f Sep 28 09:30:25 devstack sudo[97833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:30:26 devstack sudo[97833]: pam_unix(sudo:session): session closed for user root Sep 28 09:30:26 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-d73778fc-a636-4805-b76f-1f6820b619ec tempest-VolumesTestJSON-2121285435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d17bc2a6-6df2-41fb-acbb-8979dd25148f" returned: 0 in 0.311s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:30:26 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-d73778fc-a636-4805-b76f-1f6820b619ec tempest-VolumesTestJSON-2121285435 None] Lock "cinder-quobyte-d17bc2a6-6df2-41fb-acbb-8979dd25148f" released by "delete_volume" :: held 0.853s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:30:26 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-d73778fc-a636-4805-b76f-1f6820b619ec tempest-VolumesTestJSON-2121285435 None] Created reservations ['7a4c11f1-57fa-4105-a49e-613406a6123f', '602310d3-157e-42fb-bb23-f18fe4ddc355', 'cb72ed28-f22d-4fa3-bd19-f97136a96bef', '4eb98b23-3ecb-4045-9f70-528b12537e4d'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:30:26 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-d73778fc-a636-4805-b76f-1f6820b619ec tempest-VolumesTestJSON-2121285435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:30:26 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-d73778fc-a636-4805-b76f-1f6820b619ec tempest-VolumesTestJSON-2121285435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:30:26 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-d73778fc-a636-4805-b76f-1f6820b619ec tempest-VolumesTestJSON-2121285435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:30:26 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-d73778fc-a636-4805-b76f-1f6820b619ec tempest-VolumesTestJSON-2121285435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:30:26 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-d73778fc-a636-4805-b76f-1f6820b619ec tempest-VolumesTestJSON-2121285435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:30:26 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-d73778fc-a636-4805-b76f-1f6820b619ec tempest-VolumesTestJSON-2121285435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:30:26 devstack sudo[97836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:30:26 devstack sudo[97836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:30:26 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-4624d39e-1137-4b8a-b35e-ed3305b46deb tempest-VolumesTestJSON-2121285435 None] Acquiring lock "cinder-e2c991bd-4195-46e0-8425-f7c4a1b7225e-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:30:26 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-4624d39e-1137-4b8a-b35e-ed3305b46deb tempest-VolumesTestJSON-2121285435 None] Lock "cinder-e2c991bd-4195-46e0-8425-f7c4a1b7225e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:30:26 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-4624d39e-1137-4b8a-b35e-ed3305b46deb tempest-VolumesTestJSON-2121285435 None] Acquiring lock "cinder-quobyte-e2c991bd-4195-46e0-8425-f7c4a1b7225e" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:30:26 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-4624d39e-1137-4b8a-b35e-ed3305b46deb tempest-VolumesTestJSON-2121285435 None] Lock "cinder-quobyte-e2c991bd-4195-46e0-8425-f7c4a1b7225e" acquired by "delete_volume" :: waited 0.034s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:30:26 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c4ec547-d4b0-45c0-ab71-7d9fa3173297]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:30:26 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-4624d39e-1137-4b8a-b35e-ed3305b46deb tempest-VolumesTestJSON-2121285435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-e2c991bd-4195-46e0-8425-f7c4a1b7225e {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:30:26 devstack sudo[97838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-e2c991bd-4195-46e0-8425-f7c4a1b7225e Sep 28 09:30:26 devstack sudo[97838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:30:26 devstack sudo[97836]: pam_unix(sudo:session): session closed for user root Sep 28 09:30:26 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-d73778fc-a636-4805-b76f-1f6820b619ec tempest-VolumesTestJSON-2121285435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.499s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:30:26 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-d73778fc-a636-4805-b76f-1f6820b619ec tempest-VolumesTestJSON-2121285435 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:30:26 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-d73778fc-a636-4805-b76f-1f6820b619ec tempest-VolumesTestJSON-2121285435 None] Deleted volume successfully. Sep 28 09:30:26 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-d73778fc-a636-4805-b76f-1f6820b619ec tempest-VolumesTestJSON-2121285435 None] Lock "cinder-d17bc2a6-6df2-41fb-acbb-8979dd25148f-delete_volume" released by "delete_volume" :: held 1.647s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:30:27 devstack sudo[97838]: pam_unix(sudo:session): session closed for user root Sep 28 09:30:27 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-4624d39e-1137-4b8a-b35e-ed3305b46deb tempest-VolumesTestJSON-2121285435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-e2c991bd-4195-46e0-8425-f7c4a1b7225e" returned: 0 in 0.688s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:30:27 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-4624d39e-1137-4b8a-b35e-ed3305b46deb tempest-VolumesTestJSON-2121285435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-e2c991bd-4195-46e0-8425-f7c4a1b7225e {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:30:27 devstack sudo[97845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-e2c991bd-4195-46e0-8425-f7c4a1b7225e Sep 28 09:30:27 devstack sudo[97845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:30:27 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1290475-7497-4117-a3da-13e73614e76e tempest-GroupSnapshotsTest-66536182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:30:27 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b1290475-7497-4117-a3da-13e73614e76e tempest-GroupSnapshotsTest-66536182 None] Flow 'volume_create_manager' (f3a01d7f-bc3c-4c62-a5b5-ffa8a08c935d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:30:27 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b1290475-7497-4117-a3da-13e73614e76e tempest-GroupSnapshotsTest-66536182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2639e3cd-7e23-4163-b2ce-a63b7c9c2e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:30:27 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b1290475-7497-4117-a3da-13e73614e76e tempest-GroupSnapshotsTest-66536182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2639e3cd-7e23-4163-b2ce-a63b7c9c2e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:30:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-736035261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2df568e5-d5fc-4a22-8e7a-2a00580cecbf,host='devstack@QuobyteHD#QuobyteHD',id=c02db52a-d114-4a54-bde6-3729016a737c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='964f6f31e07341aeb603b37fc019071c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:30:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:30:27Z,use_quota=True,user_id='51bf61d870194f83b9e7a4290b47b9cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c86e2afa-4903-443a-a9e2-35c1024ce3ce),volume_type_id=c86e2afa-4903-443a-a9e2-35c1024ce3ce)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:30:27 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b1290475-7497-4117-a3da-13e73614e76e tempest-GroupSnapshotsTest-66536182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc2b448c-0d27-48d0-b110-ba72fca11196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:30:27 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b1290475-7497-4117-a3da-13e73614e76e tempest-GroupSnapshotsTest-66536182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc2b448c-0d27-48d0-b110-ba72fca11196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:30:27 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b1290475-7497-4117-a3da-13e73614e76e tempest-GroupSnapshotsTest-66536182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05f48d36-697a-4cc0-ac7b-1e2b58efa815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:30:27 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b1290475-7497-4117-a3da-13e73614e76e tempest-GroupSnapshotsTest-66536182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05f48d36-697a-4cc0-ac7b-1e2b58efa815) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c02db52a-d114-4a54-bde6-3729016a737c', 'volume_name': 'volume-c02db52a-d114-4a54-bde6-3729016a737c', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:30:27 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b1290475-7497-4117-a3da-13e73614e76e tempest-GroupSnapshotsTest-66536182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5cdf0bf-6fcd-40fe-86f3-5e1402e1b010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:30:27 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b1290475-7497-4117-a3da-13e73614e76e tempest-GroupSnapshotsTest-66536182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5cdf0bf-6fcd-40fe-86f3-5e1402e1b010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:30:27 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b1290475-7497-4117-a3da-13e73614e76e tempest-GroupSnapshotsTest-66536182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d0d525b-746d-4329-8ed9-138c664ef1bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:30:27 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-b1290475-7497-4117-a3da-13e73614e76e tempest-GroupSnapshotsTest-66536182 None] Volume c02db52a-d114-4a54-bde6-3729016a737c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c02db52a-d114-4a54-bde6-3729016a737c', 'volume_size': 1} Sep 28 09:30:27 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-b1290475-7497-4117-a3da-13e73614e76e tempest-GroupSnapshotsTest-66536182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:30:27 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-b1290475-7497-4117-a3da-13e73614e76e tempest-GroupSnapshotsTest-66536182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:30:27 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-b1290475-7497-4117-a3da-13e73614e76e tempest-GroupSnapshotsTest-66536182 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2df568e5-d5fc-4a22-8e7a-2a00580cecbf,created_at=2026-09-28T07:30:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-736035261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2df568e5-d5fc-4a22-8e7a-2a00580cecbf,host='devstack@QuobyteHD#QuobyteHD',id=c02db52a-d114-4a54-bde6-3729016a737c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='964f6f31e07341aeb603b37fc019071c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:30:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:30:27Z,use_quota=True,user_id='51bf61d870194f83b9e7a4290b47b9cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c86e2afa-4903-443a-a9e2-35c1024ce3ce),volume_type_id=c86e2afa-4903-443a-a9e2-35c1024ce3ce)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:30:27 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-b1290475-7497-4117-a3da-13e73614e76e tempest-GroupSnapshotsTest-66536182 None] Creating volume c02db52a-d114-4a54-bde6-3729016a737c {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:30:27 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-b1290475-7497-4117-a3da-13e73614e76e tempest-GroupSnapshotsTest-66536182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:30:27 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-b1290475-7497-4117-a3da-13e73614e76e tempest-GroupSnapshotsTest-66536182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:30:27 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-b1290475-7497-4117-a3da-13e73614e76e tempest-GroupSnapshotsTest-66536182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:30:27 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-b1290475-7497-4117-a3da-13e73614e76e tempest-GroupSnapshotsTest-66536182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:30:27 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-b1290475-7497-4117-a3da-13e73614e76e tempest-GroupSnapshotsTest-66536182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:30:27 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-b1290475-7497-4117-a3da-13e73614e76e tempest-GroupSnapshotsTest-66536182 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:30:27 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-b1290475-7497-4117-a3da-13e73614e76e tempest-GroupSnapshotsTest-66536182 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:30:27 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b1290475-7497-4117-a3da-13e73614e76e tempest-GroupSnapshotsTest-66536182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c02db52a-d114-4a54-bde6-3729016a737c 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:30:27 devstack sudo[97847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c02db52a-d114-4a54-bde6-3729016a737c 1073741824 Sep 28 09:30:27 devstack sudo[97847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:30:27 devstack sudo[97845]: pam_unix(sudo:session): session closed for user root Sep 28 09:30:27 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-4624d39e-1137-4b8a-b35e-ed3305b46deb tempest-VolumesTestJSON-2121285435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-e2c991bd-4195-46e0-8425-f7c4a1b7225e" returned: 0 in 0.400s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:30:27 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-4624d39e-1137-4b8a-b35e-ed3305b46deb tempest-VolumesTestJSON-2121285435 None] Lock "cinder-quobyte-e2c991bd-4195-46e0-8425-f7c4a1b7225e" released by "delete_volume" :: held 1.173s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:30:27 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-4624d39e-1137-4b8a-b35e-ed3305b46deb tempest-VolumesTestJSON-2121285435 None] Created reservations ['86b72542-d9d1-4e40-a961-b6b8f8ae1ec3', 'b76d30a3-3dbf-4921-a056-e1b445a48728', '730bfcb5-1e0b-455b-b605-a7bfd6d09eb1', '164cbf5c-3bbc-460f-91b8-5afbc290d4c9'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:30:27 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-4624d39e-1137-4b8a-b35e-ed3305b46deb tempest-VolumesTestJSON-2121285435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:30:27 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-4624d39e-1137-4b8a-b35e-ed3305b46deb tempest-VolumesTestJSON-2121285435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:30:27 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-4624d39e-1137-4b8a-b35e-ed3305b46deb tempest-VolumesTestJSON-2121285435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:30:27 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-4624d39e-1137-4b8a-b35e-ed3305b46deb tempest-VolumesTestJSON-2121285435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:30:27 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-4624d39e-1137-4b8a-b35e-ed3305b46deb tempest-VolumesTestJSON-2121285435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:30:27 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-4624d39e-1137-4b8a-b35e-ed3305b46deb tempest-VolumesTestJSON-2121285435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:30:27 devstack sudo[97854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:30:27 devstack sudo[97854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:30:28 devstack sudo[97847]: pam_unix(sudo:session): session closed for user root Sep 28 09:30:28 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b1290475-7497-4117-a3da-13e73614e76e tempest-GroupSnapshotsTest-66536182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c02db52a-d114-4a54-bde6-3729016a737c 1073741824" returned: 0 in 0.662s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:30:28 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b1290475-7497-4117-a3da-13e73614e76e tempest-GroupSnapshotsTest-66536182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c02db52a-d114-4a54-bde6-3729016a737c {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:30:28 devstack sudo[97858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c02db52a-d114-4a54-bde6-3729016a737c Sep 28 09:30:28 devstack sudo[97858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:30:28 devstack sudo[97854]: pam_unix(sudo:session): session closed for user root Sep 28 09:30:28 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-4624d39e-1137-4b8a-b35e-ed3305b46deb tempest-VolumesTestJSON-2121285435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.406s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:30:28 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-4624d39e-1137-4b8a-b35e-ed3305b46deb tempest-VolumesTestJSON-2121285435 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:30:28 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-4624d39e-1137-4b8a-b35e-ed3305b46deb tempest-VolumesTestJSON-2121285435 None] Deleted volume successfully. Sep 28 09:30:28 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-4624d39e-1137-4b8a-b35e-ed3305b46deb tempest-VolumesTestJSON-2121285435 None] Lock "cinder-e2c991bd-4195-46e0-8425-f7c4a1b7225e-delete_volume" released by "delete_volume" :: held 1.910s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:30:28 devstack sudo[97858]: pam_unix(sudo:session): session closed for user root Sep 28 09:30:28 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b1290475-7497-4117-a3da-13e73614e76e tempest-GroupSnapshotsTest-66536182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c02db52a-d114-4a54-bde6-3729016a737c" returned: 0 in 0.306s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:30:28 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-b1290475-7497-4117-a3da-13e73614e76e tempest-GroupSnapshotsTest-66536182 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:30:28 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-b1290475-7497-4117-a3da-13e73614e76e tempest-GroupSnapshotsTest-66536182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:30:28 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b1290475-7497-4117-a3da-13e73614e76e tempest-GroupSnapshotsTest-66536182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d0d525b-746d-4329-8ed9-138c664ef1bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c02db52a-d114-4a54-bde6-3729016a737c', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:30:28 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b1290475-7497-4117-a3da-13e73614e76e tempest-GroupSnapshotsTest-66536182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65819f71-53d6-42f4-962b-58d63bfea03a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:30:28 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-b1290475-7497-4117-a3da-13e73614e76e tempest-GroupSnapshotsTest-66536182 None] Volume volume-c02db52a-d114-4a54-bde6-3729016a737c (c02db52a-d114-4a54-bde6-3729016a737c): created successfully Sep 28 09:30:28 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b1290475-7497-4117-a3da-13e73614e76e tempest-GroupSnapshotsTest-66536182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65819f71-53d6-42f4-962b-58d63bfea03a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:30:28 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b1290475-7497-4117-a3da-13e73614e76e tempest-GroupSnapshotsTest-66536182 None] Flow 'volume_create_manager' (f3a01d7f-bc3c-4c62-a5b5-ffa8a08c935d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:30:28 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-b1290475-7497-4117-a3da-13e73614e76e tempest-GroupSnapshotsTest-66536182 None] Created volume successfully. Sep 28 09:30:29 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-64d7754d-e74d-44a7-8a1a-ecf0e402d8f7 tempest-TestInstancesWithCinderVolumes-768341847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:30:29 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-64d7754d-e74d-44a7-8a1a-ecf0e402d8f7 tempest-TestInstancesWithCinderVolumes-768341847 None] Flow 'volume_create_manager' (632fd1d9-e915-4b83-8696-aeca70f128fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:30:29 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-64d7754d-e74d-44a7-8a1a-ecf0e402d8f7 tempest-TestInstancesWithCinderVolumes-768341847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe328c14-6e7f-4f6b-a029-4cf1d8f66d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:30:29 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-64d7754d-e74d-44a7-8a1a-ecf0e402d8f7 tempest-TestInstancesWithCinderVolumes-768341847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe328c14-6e7f-4f6b-a029-4cf1d8f66d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:30:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1134688310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44c9ccc6-0417-4565-a45e-21b743ec2993,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59c12b70a8034f189f824766d3dc227f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:30:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:30:29Z,use_quota=True,user_id='76b0721bd197419babc3076ac1a9552f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20138a47-3266-4607-97b4-5b1e178f676e),volume_type_id=20138a47-3266-4607-97b4-5b1e178f676e)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:30:29 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-64d7754d-e74d-44a7-8a1a-ecf0e402d8f7 tempest-TestInstancesWithCinderVolumes-768341847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7036c5fd-b554-44b9-a86d-45e377515c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:30:29 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-64d7754d-e74d-44a7-8a1a-ecf0e402d8f7 tempest-TestInstancesWithCinderVolumes-768341847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7036c5fd-b554-44b9-a86d-45e377515c03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:30:29 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-64d7754d-e74d-44a7-8a1a-ecf0e402d8f7 tempest-TestInstancesWithCinderVolumes-768341847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6a6fd1a-1249-42eb-a2c1-0fb642346599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:30:29 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-64d7754d-e74d-44a7-8a1a-ecf0e402d8f7 tempest-TestInstancesWithCinderVolumes-768341847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6a6fd1a-1249-42eb-a2c1-0fb642346599) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44c9ccc6-0417-4565-a45e-21b743ec2993', 'volume_name': 'volume-44c9ccc6-0417-4565-a45e-21b743ec2993', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:30:29 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-64d7754d-e74d-44a7-8a1a-ecf0e402d8f7 tempest-TestInstancesWithCinderVolumes-768341847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ca1715d-1628-495e-a200-85ed8adf813a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:30:29 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-64d7754d-e74d-44a7-8a1a-ecf0e402d8f7 tempest-TestInstancesWithCinderVolumes-768341847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ca1715d-1628-495e-a200-85ed8adf813a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:30:29 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-64d7754d-e74d-44a7-8a1a-ecf0e402d8f7 tempest-TestInstancesWithCinderVolumes-768341847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85a0aab1-d656-4ec4-a65f-c69c95c95166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:30:29 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-64d7754d-e74d-44a7-8a1a-ecf0e402d8f7 tempest-TestInstancesWithCinderVolumes-768341847 None] Volume 44c9ccc6-0417-4565-a45e-21b743ec2993: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44c9ccc6-0417-4565-a45e-21b743ec2993', 'volume_size': 1} Sep 28 09:30:29 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-64d7754d-e74d-44a7-8a1a-ecf0e402d8f7 tempest-TestInstancesWithCinderVolumes-768341847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:30:29 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-64d7754d-e74d-44a7-8a1a-ecf0e402d8f7 tempest-TestInstancesWithCinderVolumes-768341847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:30:29 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-64d7754d-e74d-44a7-8a1a-ecf0e402d8f7 tempest-TestInstancesWithCinderVolumes-768341847 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:30:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1134688310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44c9ccc6-0417-4565-a45e-21b743ec2993,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59c12b70a8034f189f824766d3dc227f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:30:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:30:29Z,use_quota=True,user_id='76b0721bd197419babc3076ac1a9552f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20138a47-3266-4607-97b4-5b1e178f676e),volume_type_id=20138a47-3266-4607-97b4-5b1e178f676e)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:30:29 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-64d7754d-e74d-44a7-8a1a-ecf0e402d8f7 tempest-TestInstancesWithCinderVolumes-768341847 None] Creating volume 44c9ccc6-0417-4565-a45e-21b743ec2993 {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:30:29 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-64d7754d-e74d-44a7-8a1a-ecf0e402d8f7 tempest-TestInstancesWithCinderVolumes-768341847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:30:29 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-64d7754d-e74d-44a7-8a1a-ecf0e402d8f7 tempest-TestInstancesWithCinderVolumes-768341847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:30:29 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-64d7754d-e74d-44a7-8a1a-ecf0e402d8f7 tempest-TestInstancesWithCinderVolumes-768341847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:30:29 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-64d7754d-e74d-44a7-8a1a-ecf0e402d8f7 tempest-TestInstancesWithCinderVolumes-768341847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:30:29 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-64d7754d-e74d-44a7-8a1a-ecf0e402d8f7 tempest-TestInstancesWithCinderVolumes-768341847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:30:29 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-64d7754d-e74d-44a7-8a1a-ecf0e402d8f7 tempest-TestInstancesWithCinderVolumes-768341847 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:30:29 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-64d7754d-e74d-44a7-8a1a-ecf0e402d8f7 tempest-TestInstancesWithCinderVolumes-768341847 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:30:29 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-64d7754d-e74d-44a7-8a1a-ecf0e402d8f7 tempest-TestInstancesWithCinderVolumes-768341847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-44c9ccc6-0417-4565-a45e-21b743ec2993 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:30:29 devstack sudo[97863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-44c9ccc6-0417-4565-a45e-21b743ec2993 1073741824 Sep 28 09:30:29 devstack sudo[97863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:30:29 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-d108fc77-c2bc-4937-8554-340f2a7d7f79 tempest-TestInstancesWithCinderVolumes-768341847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:30:29 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-d108fc77-c2bc-4937-8554-340f2a7d7f79 tempest-TestInstancesWithCinderVolumes-768341847 None] Flow 'volume_create_manager' (afe06801-fe71-45bb-85ef-ed6d83e9c348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:30:29 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-d108fc77-c2bc-4937-8554-340f2a7d7f79 tempest-TestInstancesWithCinderVolumes-768341847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8174a1e-6c10-48ba-bb71-343a65e83fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:30:29 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-d108fc77-c2bc-4937-8554-340f2a7d7f79 tempest-TestInstancesWithCinderVolumes-768341847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8174a1e-6c10-48ba-bb71-343a65e83fa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:30:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-991925996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b769227-250e-4375-881f-be870680efeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59c12b70a8034f189f824766d3dc227f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:30:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:30:30Z,use_quota=True,user_id='76b0721bd197419babc3076ac1a9552f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(865bc14a-93f5-4bb1-8055-91d91ba98183),volume_type_id=865bc14a-93f5-4bb1-8055-91d91ba98183)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:30:29 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-d108fc77-c2bc-4937-8554-340f2a7d7f79 tempest-TestInstancesWithCinderVolumes-768341847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e57375f9-3284-4118-b56d-86ee9befdbb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:30:29 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-d108fc77-c2bc-4937-8554-340f2a7d7f79 tempest-TestInstancesWithCinderVolumes-768341847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e57375f9-3284-4118-b56d-86ee9befdbb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:30:29 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-d108fc77-c2bc-4937-8554-340f2a7d7f79 tempest-TestInstancesWithCinderVolumes-768341847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47586739-7451-41b7-921d-c0efc3109c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:30:29 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-d108fc77-c2bc-4937-8554-340f2a7d7f79 tempest-TestInstancesWithCinderVolumes-768341847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47586739-7451-41b7-921d-c0efc3109c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b769227-250e-4375-881f-be870680efeb', 'volume_name': 'volume-5b769227-250e-4375-881f-be870680efeb', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:30:29 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-d108fc77-c2bc-4937-8554-340f2a7d7f79 tempest-TestInstancesWithCinderVolumes-768341847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c5da82e-e5bf-413a-95f2-25b5fcfa1846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:30:29 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-d108fc77-c2bc-4937-8554-340f2a7d7f79 tempest-TestInstancesWithCinderVolumes-768341847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c5da82e-e5bf-413a-95f2-25b5fcfa1846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:30:29 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-d108fc77-c2bc-4937-8554-340f2a7d7f79 tempest-TestInstancesWithCinderVolumes-768341847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a22e10e1-83cc-4779-b7f5-789719ba984c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:30:29 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-d108fc77-c2bc-4937-8554-340f2a7d7f79 tempest-TestInstancesWithCinderVolumes-768341847 None] Volume 5b769227-250e-4375-881f-be870680efeb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b769227-250e-4375-881f-be870680efeb', 'volume_size': 1} Sep 28 09:30:29 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-d108fc77-c2bc-4937-8554-340f2a7d7f79 tempest-TestInstancesWithCinderVolumes-768341847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:30:30 devstack sudo[97863]: pam_unix(sudo:session): session closed for user root Sep 28 09:30:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-64d7754d-e74d-44a7-8a1a-ecf0e402d8f7 tempest-TestInstancesWithCinderVolumes-768341847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-44c9ccc6-0417-4565-a45e-21b743ec2993 1073741824" returned: 0 in 0.824s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:30:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-64d7754d-e74d-44a7-8a1a-ecf0e402d8f7 tempest-TestInstancesWithCinderVolumes-768341847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-44c9ccc6-0417-4565-a45e-21b743ec2993 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:30:30 devstack sudo[97870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-44c9ccc6-0417-4565-a45e-21b743ec2993 Sep 28 09:30:30 devstack sudo[97870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:30:30 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-3087531d-ac8c-48d0-b086-2ea172cedc29 tempest-GroupSnapshotsTest-66536182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:30:30 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-3087531d-ac8c-48d0-b086-2ea172cedc29 tempest-GroupSnapshotsTest-66536182 None] Flow 'volume_create_manager' (281b8b7f-ae8d-480c-be9b-94cbd2cbc1a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:30:30 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-3087531d-ac8c-48d0-b086-2ea172cedc29 tempest-GroupSnapshotsTest-66536182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dde1405-1059-40cc-bbf9-2f0fc637b7e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:30:30 devstack sudo[97870]: pam_unix(sudo:session): session closed for user root Sep 28 09:30:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-64d7754d-e74d-44a7-8a1a-ecf0e402d8f7 tempest-TestInstancesWithCinderVolumes-768341847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-44c9ccc6-0417-4565-a45e-21b743ec2993" returned: 0 in 0.375s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:30:30 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-64d7754d-e74d-44a7-8a1a-ecf0e402d8f7 tempest-TestInstancesWithCinderVolumes-768341847 None] <== create_volume: return (1306ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:30:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-64d7754d-e74d-44a7-8a1a-ecf0e402d8f7 tempest-TestInstancesWithCinderVolumes-768341847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.308s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:30:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-d108fc77-c2bc-4937-8554-340f2a7d7f79 tempest-TestInstancesWithCinderVolumes-768341847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.685s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:30:30 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-d108fc77-c2bc-4937-8554-340f2a7d7f79 tempest-TestInstancesWithCinderVolumes-768341847 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:30:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-991925996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b769227-250e-4375-881f-be870680efeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59c12b70a8034f189f824766d3dc227f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:30:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:30:30Z,use_quota=True,user_id='76b0721bd197419babc3076ac1a9552f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(865bc14a-93f5-4bb1-8055-91d91ba98183),volume_type_id=865bc14a-93f5-4bb1-8055-91d91ba98183)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:30:30 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-d108fc77-c2bc-4937-8554-340f2a7d7f79 tempest-TestInstancesWithCinderVolumes-768341847 None] Creating volume 5b769227-250e-4375-881f-be870680efeb {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:30:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-d108fc77-c2bc-4937-8554-340f2a7d7f79 tempest-TestInstancesWithCinderVolumes-768341847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:30:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-d108fc77-c2bc-4937-8554-340f2a7d7f79 tempest-TestInstancesWithCinderVolumes-768341847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:30:30 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-d108fc77-c2bc-4937-8554-340f2a7d7f79 tempest-TestInstancesWithCinderVolumes-768341847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:30:30 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-d108fc77-c2bc-4937-8554-340f2a7d7f79 tempest-TestInstancesWithCinderVolumes-768341847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:30:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-d108fc77-c2bc-4937-8554-340f2a7d7f79 tempest-TestInstancesWithCinderVolumes-768341847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:30:30 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-d108fc77-c2bc-4937-8554-340f2a7d7f79 tempest-TestInstancesWithCinderVolumes-768341847 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:30:30 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-d108fc77-c2bc-4937-8554-340f2a7d7f79 tempest-TestInstancesWithCinderVolumes-768341847 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:30:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-d108fc77-c2bc-4937-8554-340f2a7d7f79 tempest-TestInstancesWithCinderVolumes-768341847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-5b769227-250e-4375-881f-be870680efeb 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:30:30 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-3087531d-ac8c-48d0-b086-2ea172cedc29 tempest-GroupSnapshotsTest-66536182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dde1405-1059-40cc-bbf9-2f0fc637b7e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:30:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1388167685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2df568e5-d5fc-4a22-8e7a-2a00580cecbf,host='devstack@QuobyteHD#QuobyteHD',id=b251d71c-d4aa-440c-9a0e-d804811a43b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='964f6f31e07341aeb603b37fc019071c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:30:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:30:30Z,use_quota=True,user_id='51bf61d870194f83b9e7a4290b47b9cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c86e2afa-4903-443a-a9e2-35c1024ce3ce),volume_type_id=c86e2afa-4903-443a-a9e2-35c1024ce3ce)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:30:30 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-3087531d-ac8c-48d0-b086-2ea172cedc29 tempest-GroupSnapshotsTest-66536182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f364e1a-6fbb-4651-9754-049c7d1b53f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:30:30 devstack sudo[97879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-5b769227-250e-4375-881f-be870680efeb 1073741824 Sep 28 09:30:30 devstack sudo[97879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:30:30 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-3087531d-ac8c-48d0-b086-2ea172cedc29 tempest-GroupSnapshotsTest-66536182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f364e1a-6fbb-4651-9754-049c7d1b53f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:30:30 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-3087531d-ac8c-48d0-b086-2ea172cedc29 tempest-GroupSnapshotsTest-66536182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cc81671-f35a-49d0-a76f-399776eb3eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:30:30 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-3087531d-ac8c-48d0-b086-2ea172cedc29 tempest-GroupSnapshotsTest-66536182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cc81671-f35a-49d0-a76f-399776eb3eec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b251d71c-d4aa-440c-9a0e-d804811a43b4', 'volume_name': 'volume-b251d71c-d4aa-440c-9a0e-d804811a43b4', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:30:30 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-3087531d-ac8c-48d0-b086-2ea172cedc29 tempest-GroupSnapshotsTest-66536182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55cca0e9-8c61-4c93-af0f-c68793cde68b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:30:30 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-3087531d-ac8c-48d0-b086-2ea172cedc29 tempest-GroupSnapshotsTest-66536182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55cca0e9-8c61-4c93-af0f-c68793cde68b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:30:30 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-3087531d-ac8c-48d0-b086-2ea172cedc29 tempest-GroupSnapshotsTest-66536182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f603b3ad-e5a1-4992-8bbb-98ba413ba434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:30:30 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-3087531d-ac8c-48d0-b086-2ea172cedc29 tempest-GroupSnapshotsTest-66536182 None] Volume b251d71c-d4aa-440c-9a0e-d804811a43b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b251d71c-d4aa-440c-9a0e-d804811a43b4', 'volume_size': 1} Sep 28 09:30:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-3087531d-ac8c-48d0-b086-2ea172cedc29 tempest-GroupSnapshotsTest-66536182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:30:30 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-64d7754d-e74d-44a7-8a1a-ecf0e402d8f7 tempest-TestInstancesWithCinderVolumes-768341847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85a0aab1-d656-4ec4-a65f-c69c95c95166) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44c9ccc6-0417-4565-a45e-21b743ec2993', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:30:30 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-64d7754d-e74d-44a7-8a1a-ecf0e402d8f7 tempest-TestInstancesWithCinderVolumes-768341847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df4edd7a-c4c0-43c8-8edb-b6c0b398751e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:30:30 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-64d7754d-e74d-44a7-8a1a-ecf0e402d8f7 tempest-TestInstancesWithCinderVolumes-768341847 None] Volume volume-44c9ccc6-0417-4565-a45e-21b743ec2993 (44c9ccc6-0417-4565-a45e-21b743ec2993): created successfully Sep 28 09:30:30 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-64d7754d-e74d-44a7-8a1a-ecf0e402d8f7 tempest-TestInstancesWithCinderVolumes-768341847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df4edd7a-c4c0-43c8-8edb-b6c0b398751e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:30:30 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-64d7754d-e74d-44a7-8a1a-ecf0e402d8f7 tempest-TestInstancesWithCinderVolumes-768341847 None] Flow 'volume_create_manager' (632fd1d9-e915-4b83-8696-aeca70f128fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:30:30 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-64d7754d-e74d-44a7-8a1a-ecf0e402d8f7 tempest-TestInstancesWithCinderVolumes-768341847 None] Created volume successfully. Sep 28 09:30:31 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbf6de0d-716b-4c81-a03c-d88346069de6 tempest-TestInstancesWithCinderVolumes-768341847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:30:31 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-dbf6de0d-716b-4c81-a03c-d88346069de6 tempest-TestInstancesWithCinderVolumes-768341847 None] Flow 'volume_create_manager' (a676668c-b8a4-46a8-a82a-97316e3b569c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:30:31 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-dbf6de0d-716b-4c81-a03c-d88346069de6 tempest-TestInstancesWithCinderVolumes-768341847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9cbdaa0-875c-41fa-bbea-25b4e34b419d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:30:31 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-dbf6de0d-716b-4c81-a03c-d88346069de6 tempest-TestInstancesWithCinderVolumes-768341847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9cbdaa0-875c-41fa-bbea-25b4e34b419d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:30:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1426437173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f00318e-6c8c-415b-a51a-08197b883b08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59c12b70a8034f189f824766d3dc227f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:30:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:30:31Z,use_quota=True,user_id='76b0721bd197419babc3076ac1a9552f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091f0645-8a8b-4949-b5a7-5dbb96b1e6ad),volume_type_id=091f0645-8a8b-4949-b5a7-5dbb96b1e6ad)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:30:31 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-dbf6de0d-716b-4c81-a03c-d88346069de6 tempest-TestInstancesWithCinderVolumes-768341847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bf01c7b-3627-475e-aec3-6eaeffb3944c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:30:31 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-dbf6de0d-716b-4c81-a03c-d88346069de6 tempest-TestInstancesWithCinderVolumes-768341847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bf01c7b-3627-475e-aec3-6eaeffb3944c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:30:31 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-dbf6de0d-716b-4c81-a03c-d88346069de6 tempest-TestInstancesWithCinderVolumes-768341847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ceb41544-5b80-4e95-8249-693b95980f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:30:31 devstack cinder-volume[86553]: DEBUG cinder.image.glance [None req-dbf6de0d-716b-4c81-a03c-d88346069de6 tempest-TestInstancesWithCinderVolumes-768341847 None] Creating Keystone auth plugin from conf {{(pid=86553) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 09:30:31 devstack sudo[97879]: pam_unix(sudo:session): session closed for user root Sep 28 09:30:31 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-d108fc77-c2bc-4937-8554-340f2a7d7f79 tempest-TestInstancesWithCinderVolumes-768341847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-5b769227-250e-4375-881f-be870680efeb 1073741824" returned: 0 in 0.641s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:30:31 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-d108fc77-c2bc-4937-8554-340f2a7d7f79 tempest-TestInstancesWithCinderVolumes-768341847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-5b769227-250e-4375-881f-be870680efeb {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:30:31 devstack sudo[97886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-5b769227-250e-4375-881f-be870680efeb Sep 28 09:30:31 devstack sudo[97886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:30:31 devstack sudo[97886]: pam_unix(sudo:session): session closed for user root Sep 28 09:30:31 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-d108fc77-c2bc-4937-8554-340f2a7d7f79 tempest-TestInstancesWithCinderVolumes-768341847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-5b769227-250e-4375-881f-be870680efeb" returned: 0 in 0.281s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:30:31 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-d108fc77-c2bc-4937-8554-340f2a7d7f79 tempest-TestInstancesWithCinderVolumes-768341847 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:30:31 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-d108fc77-c2bc-4937-8554-340f2a7d7f79 tempest-TestInstancesWithCinderVolumes-768341847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:30:31 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-3087531d-ac8c-48d0-b086-2ea172cedc29 tempest-GroupSnapshotsTest-66536182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.849s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:30:31 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-3087531d-ac8c-48d0-b086-2ea172cedc29 tempest-GroupSnapshotsTest-66536182 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2df568e5-d5fc-4a22-8e7a-2a00580cecbf,created_at=2026-09-28T07:30:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1388167685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2df568e5-d5fc-4a22-8e7a-2a00580cecbf,host='devstack@QuobyteHD#QuobyteHD',id=b251d71c-d4aa-440c-9a0e-d804811a43b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='964f6f31e07341aeb603b37fc019071c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:30:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:30:30Z,use_quota=True,user_id='51bf61d870194f83b9e7a4290b47b9cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c86e2afa-4903-443a-a9e2-35c1024ce3ce),volume_type_id=c86e2afa-4903-443a-a9e2-35c1024ce3ce)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:30:31 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-3087531d-ac8c-48d0-b086-2ea172cedc29 tempest-GroupSnapshotsTest-66536182 None] Creating volume b251d71c-d4aa-440c-9a0e-d804811a43b4 {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:30:31 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-3087531d-ac8c-48d0-b086-2ea172cedc29 tempest-GroupSnapshotsTest-66536182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:30:31 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-3087531d-ac8c-48d0-b086-2ea172cedc29 tempest-GroupSnapshotsTest-66536182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:30:31 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-3087531d-ac8c-48d0-b086-2ea172cedc29 tempest-GroupSnapshotsTest-66536182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:30:31 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-3087531d-ac8c-48d0-b086-2ea172cedc29 tempest-GroupSnapshotsTest-66536182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:30:31 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-3087531d-ac8c-48d0-b086-2ea172cedc29 tempest-GroupSnapshotsTest-66536182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:30:31 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-3087531d-ac8c-48d0-b086-2ea172cedc29 tempest-GroupSnapshotsTest-66536182 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:30:31 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-3087531d-ac8c-48d0-b086-2ea172cedc29 tempest-GroupSnapshotsTest-66536182 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:30:31 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3087531d-ac8c-48d0-b086-2ea172cedc29 tempest-GroupSnapshotsTest-66536182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b251d71c-d4aa-440c-9a0e-d804811a43b4 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:30:31 devstack sudo[97889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b251d71c-d4aa-440c-9a0e-d804811a43b4 1073741824 Sep 28 09:30:31 devstack sudo[97889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:30:31 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-d108fc77-c2bc-4937-8554-340f2a7d7f79 tempest-TestInstancesWithCinderVolumes-768341847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a22e10e1-83cc-4779-b7f5-789719ba984c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b769227-250e-4375-881f-be870680efeb', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:30:31 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-d108fc77-c2bc-4937-8554-340f2a7d7f79 tempest-TestInstancesWithCinderVolumes-768341847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de0be390-118d-4dff-a788-cd5190326e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:30:31 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-d108fc77-c2bc-4937-8554-340f2a7d7f79 tempest-TestInstancesWithCinderVolumes-768341847 None] Volume volume-5b769227-250e-4375-881f-be870680efeb (5b769227-250e-4375-881f-be870680efeb): created successfully Sep 28 09:30:31 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-d108fc77-c2bc-4937-8554-340f2a7d7f79 tempest-TestInstancesWithCinderVolumes-768341847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de0be390-118d-4dff-a788-cd5190326e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:30:31 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-d108fc77-c2bc-4937-8554-340f2a7d7f79 tempest-TestInstancesWithCinderVolumes-768341847 None] Flow 'volume_create_manager' (afe06801-fe71-45bb-85ef-ed6d83e9c348) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:30:31 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-d108fc77-c2bc-4937-8554-340f2a7d7f79 tempest-TestInstancesWithCinderVolumes-768341847 None] Created volume successfully. Sep 28 09:30:31 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-dbf6de0d-716b-4c81-a03c-d88346069de6 tempest-TestInstancesWithCinderVolumes-768341847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ceb41544-5b80-4e95-8249-693b95980f58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3f00318e-6c8c-415b-a51a-08197b883b08', 'volume_name': 'volume-3f00318e-6c8c-415b-a51a-08197b883b08', 'volume_size': 1, 'image_id': 'd1b87fb2-41a1-48e4-9551-b9d5b1dcee80', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d1b87fb2-41a1-48e4-9551-b9d5b1dcee80', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1040477904', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '59c12b70a8034f189f824766d3dc227f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd1b87fb2-41a1-48e4-9551-b9d5b1dcee80', 'created_at': datetime.datetime(2026, 9, 28, 7, 30, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 7, 30, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d1b87fb2-41a1-48e4-9551-b9d5b1dcee80/file', 'properties': {}}, 'image_service': }' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:30:31 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-dbf6de0d-716b-4c81-a03c-d88346069de6 tempest-TestInstancesWithCinderVolumes-768341847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b105b7d-bfbb-486d-8041-0538b00280bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:30:32 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-dbf6de0d-716b-4c81-a03c-d88346069de6 tempest-TestInstancesWithCinderVolumes-768341847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b105b7d-bfbb-486d-8041-0538b00280bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:30:32 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-dbf6de0d-716b-4c81-a03c-d88346069de6 tempest-TestInstancesWithCinderVolumes-768341847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a30e13f-c8cc-4400-a34e-52e56c7acd4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:30:32 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-dbf6de0d-716b-4c81-a03c-d88346069de6 tempest-TestInstancesWithCinderVolumes-768341847 None] Volume 3f00318e-6c8c-415b-a51a-08197b883b08: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3f00318e-6c8c-415b-a51a-08197b883b08', 'volume_size': 1, 'image_id': 'd1b87fb2-41a1-48e4-9551-b9d5b1dcee80', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d1b87fb2-41a1-48e4-9551-b9d5b1dcee80', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1040477904', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '59c12b70a8034f189f824766d3dc227f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd1b87fb2-41a1-48e4-9551-b9d5b1dcee80', 'created_at': datetime.datetime(2026, 9, 28, 7, 30, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 7, 30, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d1b87fb2-41a1-48e4-9551-b9d5b1dcee80/file', 'properties': {}}, 'image_service': } Sep 28 09:30:32 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbf6de0d-716b-4c81-a03c-d88346069de6 tempest-TestInstancesWithCinderVolumes-768341847 None] Trying to clone 3f00318e-6c8c-415b-a51a-08197b883b08 from image d1b87fb2-41a1-48e4-9551-b9d5b1dcee80 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d1b87fb2-41a1-48e4-9551-b9d5b1dcee80', 'metadata': {}}]). {{(pid=86553) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 09:30:32 devstack sudo[97889]: pam_unix(sudo:session): session closed for user root Sep 28 09:30:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3087531d-ac8c-48d0-b086-2ea172cedc29 tempest-GroupSnapshotsTest-66536182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b251d71c-d4aa-440c-9a0e-d804811a43b4 1073741824" returned: 0 in 0.672s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:30:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3087531d-ac8c-48d0-b086-2ea172cedc29 tempest-GroupSnapshotsTest-66536182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b251d71c-d4aa-440c-9a0e-d804811a43b4 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:30:32 devstack sudo[97895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b251d71c-d4aa-440c-9a0e-d804811a43b4 Sep 28 09:30:32 devstack sudo[97895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:30:32 devstack sudo[97895]: pam_unix(sudo:session): session closed for user root Sep 28 09:30:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3087531d-ac8c-48d0-b086-2ea172cedc29 tempest-GroupSnapshotsTest-66536182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b251d71c-d4aa-440c-9a0e-d804811a43b4" returned: 0 in 0.343s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:30:32 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-3087531d-ac8c-48d0-b086-2ea172cedc29 tempest-GroupSnapshotsTest-66536182 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:30:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-3087531d-ac8c-48d0-b086-2ea172cedc29 tempest-GroupSnapshotsTest-66536182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:30:32 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-3087531d-ac8c-48d0-b086-2ea172cedc29 tempest-GroupSnapshotsTest-66536182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f603b3ad-e5a1-4992-8bbb-98ba413ba434) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b251d71c-d4aa-440c-9a0e-d804811a43b4', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:30:32 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-3087531d-ac8c-48d0-b086-2ea172cedc29 tempest-GroupSnapshotsTest-66536182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bd75773-408d-4c71-963a-f4e5ed500d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:30:32 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-3087531d-ac8c-48d0-b086-2ea172cedc29 tempest-GroupSnapshotsTest-66536182 None] Volume volume-b251d71c-d4aa-440c-9a0e-d804811a43b4 (b251d71c-d4aa-440c-9a0e-d804811a43b4): created successfully Sep 28 09:30:32 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-3087531d-ac8c-48d0-b086-2ea172cedc29 tempest-GroupSnapshotsTest-66536182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bd75773-408d-4c71-963a-f4e5ed500d37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:30:32 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-3087531d-ac8c-48d0-b086-2ea172cedc29 tempest-GroupSnapshotsTest-66536182 None] Flow 'volume_create_manager' (281b8b7f-ae8d-480c-be9b-94cbd2cbc1a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:30:32 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-3087531d-ac8c-48d0-b086-2ea172cedc29 tempest-GroupSnapshotsTest-66536182 None] Created volume successfully. Sep 28 09:30:33 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-6cfaa6e4-b3ec-453d-9d50-d117faa91eee tempest-GroupSnapshotsTest-66536182 None] Update group completed successfully. Sep 28 09:30:34 devstack cinder-volume[86553]: DEBUG dbcounter [-] [86553] Writing DB stats cinder:SELECT=151,cinder:INSERT=44,cinder:UPDATE=202,cinder:DELETE=10 {{(pid=86553) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 09:30:34 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-3ec24a91-3455-4941-a96f-23d124ffe1de tempest-GroupSnapshotsTest-66536182 None] Update group completed successfully. Sep 28 09:30:34 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e9a35a5d-c115-43e1-b656-85a28e77e7a8 tempest-BackendsCapabilitiesAdminTestsJSON-1910307025 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.1194190979004, 'free_capacity_gb': 1775.1194190979004, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86553) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 28 09:30:34 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b55b3086-8d5b-488b-b0a9-1348a40703db tempest-BackendsCapabilitiesAdminTestsJSON-1910307025 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.1194190979004, 'free_capacity_gb': 1775.1194190979004, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86553) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 28 09:30:35 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-7a83e6e5-1735-41b0-9ba5-d5c076a0ca48 tempest-GroupSnapshotsTest-66536182 None] Update group completed successfully. Sep 28 09:30:36 devstack cinder-volume[86553]: DEBUG cinder.image.image_utils [None req-dbf6de0d-716b-4c81-a03c-d88346069de6 tempest-TestInstancesWithCinderVolumes-768341847 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d1b87fb2-41a1-48e4-9551-b9d5b1dcee80_3fgap_tfdevstack@QuobyteHD, size 20.69 MB, duration 4.19 sec {{(pid=86553) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 09:30:36 devstack cinder-volume[86553]: INFO cinder.image.image_utils [None req-dbf6de0d-716b-4c81-a03c-d88346069de6 tempest-TestInstancesWithCinderVolumes-768341847 None] Image download 20.69 MB at 4.94 MB/s Sep 28 09:30:36 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b96c02-b2f6-499b-a904-030e7e1118d7]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:30:36 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-dbf6de0d-716b-4c81-a03c-d88346069de6 tempest-TestInstancesWithCinderVolumes-768341847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1b87fb2-41a1-48e4-9551-b9d5b1dcee80_3fgap_tfdevstack@QuobyteHD {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:30:36 devstack sudo[97898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1b87fb2-41a1-48e4-9551-b9d5b1dcee80_3fgap_tfdevstack@QuobyteHD Sep 28 09:30:36 devstack sudo[97898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:30:36 devstack sudo[97898]: pam_unix(sudo:session): session closed for user root Sep 28 09:30:36 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-dbf6de0d-716b-4c81-a03c-d88346069de6 tempest-TestInstancesWithCinderVolumes-768341847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1b87fb2-41a1-48e4-9551-b9d5b1dcee80_3fgap_tfdevstack@QuobyteHD" returned: 0 in 0.345s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:30:36 devstack cinder-volume[86553]: DEBUG cinder.image.image_utils [None req-dbf6de0d-716b-4c81-a03c-d88346069de6 tempest-TestInstancesWithCinderVolumes-768341847 None] Temporary image d1b87fb2-41a1-48e4-9551-b9d5b1dcee80 is fetched for user 76b0721bd197419babc3076ac1a9552f. {{(pid=86553) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 09:30:36 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c299f24-703b-4eb7-b50e-2201ce07f71b]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:30:36 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-dbf6de0d-716b-4c81-a03c-d88346069de6 tempest-TestInstancesWithCinderVolumes-768341847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1b87fb2-41a1-48e4-9551-b9d5b1dcee80_3fgap_tfdevstack@QuobyteHD {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:30:36 devstack sudo[97904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1b87fb2-41a1-48e4-9551-b9d5b1dcee80_3fgap_tfdevstack@QuobyteHD Sep 28 09:30:36 devstack sudo[97904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:30:36 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-cf00d6ba-114d-48ed-8360-6c106a6c821d tempest-GroupSnapshotsTest-66536182 None] Update group completed successfully. Sep 28 09:30:37 devstack sudo[97904]: pam_unix(sudo:session): session closed for user root Sep 28 09:30:37 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-dbf6de0d-716b-4c81-a03c-d88346069de6 tempest-TestInstancesWithCinderVolumes-768341847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1b87fb2-41a1-48e4-9551-b9d5b1dcee80_3fgap_tfdevstack@QuobyteHD" returned: 0 in 0.420s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:30:37 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-dbf6de0d-716b-4c81-a03c-d88346069de6 tempest-TestInstancesWithCinderVolumes-768341847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:30:37 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-dbf6de0d-716b-4c81-a03c-d88346069de6 tempest-TestInstancesWithCinderVolumes-768341847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:30:37 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-dbf6de0d-716b-4c81-a03c-d88346069de6 tempest-TestInstancesWithCinderVolumes-768341847 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:30:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1426437173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f00318e-6c8c-415b-a51a-08197b883b08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59c12b70a8034f189f824766d3dc227f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:30:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:30:31Z,use_quota=True,user_id='76b0721bd197419babc3076ac1a9552f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091f0645-8a8b-4949-b5a7-5dbb96b1e6ad),volume_type_id=091f0645-8a8b-4949-b5a7-5dbb96b1e6ad)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:30:37 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-dbf6de0d-716b-4c81-a03c-d88346069de6 tempest-TestInstancesWithCinderVolumes-768341847 None] Creating volume 3f00318e-6c8c-415b-a51a-08197b883b08 {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:30:37 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-dbf6de0d-716b-4c81-a03c-d88346069de6 tempest-TestInstancesWithCinderVolumes-768341847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:30:37 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-dbf6de0d-716b-4c81-a03c-d88346069de6 tempest-TestInstancesWithCinderVolumes-768341847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:30:37 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-dbf6de0d-716b-4c81-a03c-d88346069de6 tempest-TestInstancesWithCinderVolumes-768341847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:30:37 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-dbf6de0d-716b-4c81-a03c-d88346069de6 tempest-TestInstancesWithCinderVolumes-768341847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:30:37 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-dbf6de0d-716b-4c81-a03c-d88346069de6 tempest-TestInstancesWithCinderVolumes-768341847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:30:37 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-dbf6de0d-716b-4c81-a03c-d88346069de6 tempest-TestInstancesWithCinderVolumes-768341847 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:30:37 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-dbf6de0d-716b-4c81-a03c-d88346069de6 tempest-TestInstancesWithCinderVolumes-768341847 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:30:37 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-dbf6de0d-716b-4c81-a03c-d88346069de6 tempest-TestInstancesWithCinderVolumes-768341847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3f00318e-6c8c-415b-a51a-08197b883b08 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:30:37 devstack sudo[97909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3f00318e-6c8c-415b-a51a-08197b883b08 1073741824 Sep 28 09:30:37 devstack sudo[97909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:30:37 devstack sudo[97909]: pam_unix(sudo:session): session closed for user root Sep 28 09:30:37 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-dbf6de0d-716b-4c81-a03c-d88346069de6 tempest-TestInstancesWithCinderVolumes-768341847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3f00318e-6c8c-415b-a51a-08197b883b08 1073741824" returned: 0 in 0.597s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:30:37 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-dbf6de0d-716b-4c81-a03c-d88346069de6 tempest-TestInstancesWithCinderVolumes-768341847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3f00318e-6c8c-415b-a51a-08197b883b08 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:30:37 devstack sudo[97916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3f00318e-6c8c-415b-a51a-08197b883b08 Sep 28 09:30:37 devstack sudo[97916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:30:38 devstack sudo[97916]: pam_unix(sudo:session): session closed for user root Sep 28 09:30:38 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-dbf6de0d-716b-4c81-a03c-d88346069de6 tempest-TestInstancesWithCinderVolumes-768341847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3f00318e-6c8c-415b-a51a-08197b883b08" returned: 0 in 0.339s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:30:38 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-dbf6de0d-716b-4c81-a03c-d88346069de6 tempest-TestInstancesWithCinderVolumes-768341847 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:30:38 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-dbf6de0d-716b-4c81-a03c-d88346069de6 tempest-TestInstancesWithCinderVolumes-768341847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:30:38 devstack cinder-volume[86553]: DEBUG cinder.volume.volume_utils [None req-dbf6de0d-716b-4c81-a03c-d88346069de6 tempest-TestInstancesWithCinderVolumes-768341847 None] Attempting download of d1b87fb2-41a1-48e4-9551-b9d5b1dcee80 ((None, [{'url': 'file:///opt/stack/data/glance/images/d1b87fb2-41a1-48e4-9551-b9d5b1dcee80', 'metadata': {}}])) to volume 3f00318e-6c8c-415b-a51a-08197b883b08. {{(pid=86553) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 09:30:38 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[041ebc51-60ad-4bff-a1c3-679cee02306f]: (4, 'raw') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:30:38 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-dbf6de0d-716b-4c81-a03c-d88346069de6 tempest-TestInstancesWithCinderVolumes-768341847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d1b87fb2-41a1-48e4-9551-b9d5b1dcee80_b72k9hap {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:30:38 devstack sudo[97919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d1b87fb2-41a1-48e4-9551-b9d5b1dcee80_b72k9hap Sep 28 09:30:38 devstack sudo[97919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:30:38 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-05cf6387-fef4-4871-ae37-57c1d0563314 tempest-GroupSnapshotsTest-66536182 None] GroupSnapshot 3b859b6b-f231-44c9-a5de-25fbcf1b2308: creating. Sep 28 09:30:38 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-05cf6387-fef4-4871-ae37-57c1d0563314 tempest-GroupSnapshotsTest-66536182 None] Group snapshot 3b859b6b-f231-44c9-a5de-25fbcf1b2308: creating. {{(pid=86553) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 09:30:38 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-05cf6387-fef4-4871-ae37-57c1d0563314 tempest-GroupSnapshotsTest-66536182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:30:38 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-05cf6387-fef4-4871-ae37-57c1d0563314 tempest-GroupSnapshotsTest-66536182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:30:38 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-05cf6387-fef4-4871-ae37-57c1d0563314 tempest-GroupSnapshotsTest-66536182 None] Creating offline snapshot 8a53ce27-660b-4aa0-9f20-b205443634ff of volume b251d71c-d4aa-440c-9a0e-d804811a43b4 {{(pid=86553) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 09:30:38 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[a861fd25-20ca-4880-9eb8-de8661ffc7b8]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:30:38 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-05cf6387-fef4-4871-ae37-57c1d0563314 tempest-GroupSnapshotsTest-66536182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b251d71c-d4aa-440c-9a0e-d804811a43b4 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:30:38 devstack sudo[97919]: pam_unix(sudo:session): session closed for user root Sep 28 09:30:38 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-dbf6de0d-716b-4c81-a03c-d88346069de6 tempest-TestInstancesWithCinderVolumes-768341847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d1b87fb2-41a1-48e4-9551-b9d5b1dcee80_b72k9hap" returned: 0 in 0.470s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:30:38 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-dbf6de0d-716b-4c81-a03c-d88346069de6 tempest-TestInstancesWithCinderVolumes-768341847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d1b87fb2-41a1-48e4-9551-b9d5b1dcee80_b72k9hap {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:30:38 devstack sudo[97921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b251d71c-d4aa-440c-9a0e-d804811a43b4 Sep 28 09:30:38 devstack sudo[97921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:30:38 devstack sudo[97924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d1b87fb2-41a1-48e4-9551-b9d5b1dcee80_b72k9hap Sep 28 09:30:38 devstack sudo[97924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:30:39 devstack sudo[97924]: pam_unix(sudo:session): session closed for user root Sep 28 09:30:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-dbf6de0d-716b-4c81-a03c-d88346069de6 tempest-TestInstancesWithCinderVolumes-768341847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d1b87fb2-41a1-48e4-9551-b9d5b1dcee80_b72k9hap" returned: 1 in 0.412s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:30:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-dbf6de0d-716b-4c81-a03c-d88346069de6 tempest-TestInstancesWithCinderVolumes-768341847 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d1b87fb2-41a1-48e4-9551-b9d5b1dcee80_b72k9hap' failed. Not Retrying. {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 09:30:39 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[85be9000-a1e6-40c5-b571-aa08e7f53e5e]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:30:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-dbf6de0d-716b-4c81-a03c-d88346069de6 tempest-TestInstancesWithCinderVolumes-768341847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1b87fb2-41a1-48e4-9551-b9d5b1dcee80_3fgap_tfdevstack@QuobyteHD {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:30:39 devstack sudo[97921]: pam_unix(sudo:session): session closed for user root Sep 28 09:30:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-05cf6387-fef4-4871-ae37-57c1d0563314 tempest-GroupSnapshotsTest-66536182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b251d71c-d4aa-440c-9a0e-d804811a43b4" returned: 0 in 0.571s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:30:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-05cf6387-fef4-4871-ae37-57c1d0563314 tempest-GroupSnapshotsTest-66536182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b251d71c-d4aa-440c-9a0e-d804811a43b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b251d71c-d4aa-440c-9a0e-d804811a43b4.8a53ce27-660b-4aa0-9f20-b205443634ff 1G {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:30:39 devstack sudo[97935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b251d71c-d4aa-440c-9a0e-d804811a43b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b251d71c-d4aa-440c-9a0e-d804811a43b4.8a53ce27-660b-4aa0-9f20-b205443634ff 1G Sep 28 09:30:39 devstack sudo[97935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:30:39 devstack sudo[97934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1b87fb2-41a1-48e4-9551-b9d5b1dcee80_3fgap_tfdevstack@QuobyteHD Sep 28 09:30:39 devstack sudo[97934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:30:39 devstack sudo[97934]: pam_unix(sudo:session): session closed for user root Sep 28 09:30:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-dbf6de0d-716b-4c81-a03c-d88346069de6 tempest-TestInstancesWithCinderVolumes-768341847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1b87fb2-41a1-48e4-9551-b9d5b1dcee80_3fgap_tfdevstack@QuobyteHD" returned: 0 in 0.494s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:30:39 devstack cinder-volume[86553]: DEBUG cinder.image.image_utils [None req-dbf6de0d-716b-4c81-a03c-d88346069de6 tempest-TestInstancesWithCinderVolumes-768341847 None] d1b87fb2-41a1-48e4-9551-b9d5b1dcee80 was qcow2, converting to qcow2 {{(pid=86553) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 09:30:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-dbf6de0d-716b-4c81-a03c-d88346069de6 tempest-TestInstancesWithCinderVolumes-768341847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d1b87fb2-41a1-48e4-9551-b9d5b1dcee80_3fgap_tfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3f00318e-6c8c-415b-a51a-08197b883b08 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:30:39 devstack sudo[97945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d1b87fb2-41a1-48e4-9551-b9d5b1dcee80_3fgap_tfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3f00318e-6c8c-415b-a51a-08197b883b08 Sep 28 09:30:39 devstack sudo[97945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:30:39 devstack sudo[97935]: pam_unix(sudo:session): session closed for user root Sep 28 09:30:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-05cf6387-fef4-4871-ae37-57c1d0563314 tempest-GroupSnapshotsTest-66536182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b251d71c-d4aa-440c-9a0e-d804811a43b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b251d71c-d4aa-440c-9a0e-d804811a43b4.8a53ce27-660b-4aa0-9f20-b205443634ff 1G" returned: 0 in 0.538s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:30:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-05cf6387-fef4-4871-ae37-57c1d0563314 tempest-GroupSnapshotsTest-66536182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b251d71c-d4aa-440c-9a0e-d804811a43b4 -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b251d71c-d4aa-440c-9a0e-d804811a43b4.8a53ce27-660b-4aa0-9f20-b205443634ff {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:30:39 devstack sudo[97948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b251d71c-d4aa-440c-9a0e-d804811a43b4 -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b251d71c-d4aa-440c-9a0e-d804811a43b4.8a53ce27-660b-4aa0-9f20-b205443634ff Sep 28 09:30:39 devstack sudo[97948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:30:40 devstack sudo[97948]: pam_unix(sudo:session): session closed for user root Sep 28 09:30:40 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-05cf6387-fef4-4871-ae37-57c1d0563314 tempest-GroupSnapshotsTest-66536182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b251d71c-d4aa-440c-9a0e-d804811a43b4 -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b251d71c-d4aa-440c-9a0e-d804811a43b4.8a53ce27-660b-4aa0-9f20-b205443634ff" returned: 0 in 0.418s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:30:40 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-05cf6387-fef4-4871-ae37-57c1d0563314 tempest-GroupSnapshotsTest-66536182 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b251d71c-d4aa-440c-9a0e-d804811a43b4.8a53ce27-660b-4aa0-9f20-b205443634ff is being set with open permissions: ugo+rw: NotImplementedError Sep 28 09:30:40 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-05cf6387-fef4-4871-ae37-57c1d0563314 tempest-GroupSnapshotsTest-66536182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b251d71c-d4aa-440c-9a0e-d804811a43b4.8a53ce27-660b-4aa0-9f20-b205443634ff {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:30:40 devstack sudo[97957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b251d71c-d4aa-440c-9a0e-d804811a43b4.8a53ce27-660b-4aa0-9f20-b205443634ff Sep 28 09:30:40 devstack sudo[97957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:30:40 devstack sudo[97957]: pam_unix(sudo:session): session closed for user root Sep 28 09:30:40 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-05cf6387-fef4-4871-ae37-57c1d0563314 tempest-GroupSnapshotsTest-66536182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b251d71c-d4aa-440c-9a0e-d804811a43b4.8a53ce27-660b-4aa0-9f20-b205443634ff" returned: 0 in 0.333s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:30:40 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-05cf6387-fef4-4871-ae37-57c1d0563314 tempest-GroupSnapshotsTest-66536182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b251d71c-d4aa-440c-9a0e-d804811a43b4.info {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:30:40 devstack sudo[97961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b251d71c-d4aa-440c-9a0e-d804811a43b4.info Sep 28 09:30:40 devstack sudo[97961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:30:40 devstack sudo[97961]: pam_unix(sudo:session): session closed for user root Sep 28 09:30:40 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-05cf6387-fef4-4871-ae37-57c1d0563314 tempest-GroupSnapshotsTest-66536182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b251d71c-d4aa-440c-9a0e-d804811a43b4.info" returned: 0 in 0.352s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:30:40 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-05cf6387-fef4-4871-ae37-57c1d0563314 tempest-GroupSnapshotsTest-66536182 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b251d71c-d4aa-440c-9a0e-d804811a43b4.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 09:30:40 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-05cf6387-fef4-4871-ae37-57c1d0563314 tempest-GroupSnapshotsTest-66536182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b251d71c-d4aa-440c-9a0e-d804811a43b4.info {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:30:41 devstack sudo[97965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b251d71c-d4aa-440c-9a0e-d804811a43b4.info Sep 28 09:30:41 devstack sudo[97965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:30:41 devstack sudo[97965]: pam_unix(sudo:session): session closed for user root Sep 28 09:30:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-05cf6387-fef4-4871-ae37-57c1d0563314 tempest-GroupSnapshotsTest-66536182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b251d71c-d4aa-440c-9a0e-d804811a43b4.info" returned: 0 in 0.316s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:30:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-05cf6387-fef4-4871-ae37-57c1d0563314 tempest-GroupSnapshotsTest-66536182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.683s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:30:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-05cf6387-fef4-4871-ae37-57c1d0563314 tempest-GroupSnapshotsTest-66536182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:30:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-05cf6387-fef4-4871-ae37-57c1d0563314 tempest-GroupSnapshotsTest-66536182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:30:41 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-05cf6387-fef4-4871-ae37-57c1d0563314 tempest-GroupSnapshotsTest-66536182 None] Creating offline snapshot ce3d4463-67fb-429e-911d-edc758817b5f of volume c02db52a-d114-4a54-bde6-3729016a737c {{(pid=86553) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 09:30:41 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[b24907b2-578e-48ab-98d9-04bf83cb16e7]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:30:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-05cf6387-fef4-4871-ae37-57c1d0563314 tempest-GroupSnapshotsTest-66536182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c02db52a-d114-4a54-bde6-3729016a737c {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:30:41 devstack sudo[97968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c02db52a-d114-4a54-bde6-3729016a737c Sep 28 09:30:41 devstack sudo[97968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:30:41 devstack sudo[97968]: pam_unix(sudo:session): session closed for user root Sep 28 09:30:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-05cf6387-fef4-4871-ae37-57c1d0563314 tempest-GroupSnapshotsTest-66536182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c02db52a-d114-4a54-bde6-3729016a737c" returned: 0 in 0.523s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:30:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-05cf6387-fef4-4871-ae37-57c1d0563314 tempest-GroupSnapshotsTest-66536182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c02db52a-d114-4a54-bde6-3729016a737c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c02db52a-d114-4a54-bde6-3729016a737c.ce3d4463-67fb-429e-911d-edc758817b5f 1G {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:30:41 devstack sudo[97973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c02db52a-d114-4a54-bde6-3729016a737c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c02db52a-d114-4a54-bde6-3729016a737c.ce3d4463-67fb-429e-911d-edc758817b5f 1G Sep 28 09:30:41 devstack sudo[97973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:30:42 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-7befb372-ede8-47ee-8710-92f4f8dba0b8 tempest-GroupsV314Test-1779058192 None] Group tempest-GroupsV314Test-Group-1998624383: creating Sep 28 09:30:42 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-7befb372-ede8-47ee-8710-92f4f8dba0b8 tempest-GroupsV314Test-1779058192 None] Group tempest-GroupsV314Test-Group-1998624383: created successfully Sep 28 09:30:42 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-7befb372-ede8-47ee-8710-92f4f8dba0b8 tempest-GroupsV314Test-1779058192 None] Create group completed successfully. Sep 28 09:30:42 devstack sudo[97945]: pam_unix(sudo:session): session closed for user root Sep 28 09:30:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-dbf6de0d-716b-4c81-a03c-d88346069de6 tempest-TestInstancesWithCinderVolumes-768341847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d1b87fb2-41a1-48e4-9551-b9d5b1dcee80_3fgap_tfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3f00318e-6c8c-415b-a51a-08197b883b08" returned: 0 in 2.521s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:30:42 devstack cinder-volume[86553]: DEBUG cinder.image.image_utils [None req-dbf6de0d-716b-4c81-a03c-d88346069de6 tempest-TestInstancesWithCinderVolumes-768341847 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d1b87fb2-41a1-48e4-9551-b9d5b1dcee80_3fgap_tfdevstack@QuobyteHD, size 112.00 MB, duration 2.52 sec, destination /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3f00318e-6c8c-415b-a51a-08197b883b08 {{(pid=86553) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 09:30:42 devstack cinder-volume[86553]: INFO cinder.image.image_utils [None req-dbf6de0d-716b-4c81-a03c-d88346069de6 tempest-TestInstancesWithCinderVolumes-768341847 None] Converted 112.00 MB image at 44.40 MB/s Sep 28 09:30:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-dbf6de0d-716b-4c81-a03c-d88346069de6 tempest-TestInstancesWithCinderVolumes-768341847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3f00318e-6c8c-415b-a51a-08197b883b08 1G {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:30:42 devstack sudo[97976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3f00318e-6c8c-415b-a51a-08197b883b08 1G Sep 28 09:30:42 devstack sudo[97976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:30:42 devstack sudo[97973]: pam_unix(sudo:session): session closed for user root Sep 28 09:30:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-05cf6387-fef4-4871-ae37-57c1d0563314 tempest-GroupSnapshotsTest-66536182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c02db52a-d114-4a54-bde6-3729016a737c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c02db52a-d114-4a54-bde6-3729016a737c.ce3d4463-67fb-429e-911d-edc758817b5f 1G" returned: 0 in 0.514s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:30:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-05cf6387-fef4-4871-ae37-57c1d0563314 tempest-GroupSnapshotsTest-66536182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c02db52a-d114-4a54-bde6-3729016a737c -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c02db52a-d114-4a54-bde6-3729016a737c.ce3d4463-67fb-429e-911d-edc758817b5f {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:30:42 devstack sudo[97981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c02db52a-d114-4a54-bde6-3729016a737c -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c02db52a-d114-4a54-bde6-3729016a737c.ce3d4463-67fb-429e-911d-edc758817b5f Sep 28 09:30:42 devstack sudo[97981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:30:42 devstack sudo[97976]: pam_unix(sudo:session): session closed for user root Sep 28 09:30:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-dbf6de0d-716b-4c81-a03c-d88346069de6 tempest-TestInstancesWithCinderVolumes-768341847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3f00318e-6c8c-415b-a51a-08197b883b08 1G" returned: 0 in 0.354s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:30:42 devstack cinder-volume[86553]: DEBUG cinder.volume.volume_utils [None req-dbf6de0d-716b-4c81-a03c-d88346069de6 tempest-TestInstancesWithCinderVolumes-768341847 None] Downloaded image d1b87fb2-41a1-48e4-9551-b9d5b1dcee80 ((None, [{'url': 'file:///opt/stack/data/glance/images/d1b87fb2-41a1-48e4-9551-b9d5b1dcee80', 'metadata': {}}])) to volume 3f00318e-6c8c-415b-a51a-08197b883b08 successfully. {{(pid=86553) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 09:30:42 devstack cinder-volume[86553]: DEBUG cinder.image.image_utils [None req-dbf6de0d-716b-4c81-a03c-d88346069de6 tempest-TestInstancesWithCinderVolumes-768341847 None] Temporary image d1b87fb2-41a1-48e4-9551-b9d5b1dcee80 for user 76b0721bd197419babc3076ac1a9552f is deleted. {{(pid=86553) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 09:30:42 devstack cinder-volume[86553]: DEBUG cinder.volume.volume_utils [None req-dbf6de0d-716b-4c81-a03c-d88346069de6 tempest-TestInstancesWithCinderVolumes-768341847 None] Marking volume 3f00318e-6c8c-415b-a51a-08197b883b08 as bootable. {{(pid=86553) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 09:30:42 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbf6de0d-716b-4c81-a03c-d88346069de6 tempest-TestInstancesWithCinderVolumes-768341847 None] Copying metadata from image d1b87fb2-41a1-48e4-9551-b9d5b1dcee80 to 3f00318e-6c8c-415b-a51a-08197b883b08. {{(pid=86553) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 09:30:42 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbf6de0d-716b-4c81-a03c-d88346069de6 tempest-TestInstancesWithCinderVolumes-768341847 None] Creating volume glance metadata for volume 3f00318e-6c8c-415b-a51a-08197b883b08 backed by image d1b87fb2-41a1-48e4-9551-b9d5b1dcee80 with: {'image_id': 'd1b87fb2-41a1-48e4-9551-b9d5b1dcee80', 'image_name': 'tempest-scenario-img--1040477904', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86553) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 09:30:42 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-dbf6de0d-716b-4c81-a03c-d88346069de6 tempest-TestInstancesWithCinderVolumes-768341847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a30e13f-c8cc-4400-a34e-52e56c7acd4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f00318e-6c8c-415b-a51a-08197b883b08', 'volume_size': 1, 'image_id': 'd1b87fb2-41a1-48e4-9551-b9d5b1dcee80', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d1b87fb2-41a1-48e4-9551-b9d5b1dcee80', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1040477904', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '59c12b70a8034f189f824766d3dc227f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd1b87fb2-41a1-48e4-9551-b9d5b1dcee80', 'created_at': datetime.datetime(2026, 9, 28, 7, 30, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 7, 30, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d1b87fb2-41a1-48e4-9551-b9d5b1dcee80/file', 'properties': {}}, 'image_service': }' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:30:42 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-dbf6de0d-716b-4c81-a03c-d88346069de6 tempest-TestInstancesWithCinderVolumes-768341847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58c5a94a-c48f-445e-a23f-322765a4a286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:30:42 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-dbf6de0d-716b-4c81-a03c-d88346069de6 tempest-TestInstancesWithCinderVolumes-768341847 None] Volume volume-3f00318e-6c8c-415b-a51a-08197b883b08 (3f00318e-6c8c-415b-a51a-08197b883b08): created successfully Sep 28 09:30:42 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-dbf6de0d-716b-4c81-a03c-d88346069de6 tempest-TestInstancesWithCinderVolumes-768341847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58c5a94a-c48f-445e-a23f-322765a4a286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:30:42 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-dbf6de0d-716b-4c81-a03c-d88346069de6 tempest-TestInstancesWithCinderVolumes-768341847 None] Flow 'volume_create_manager' (a676668c-b8a4-46a8-a82a-97316e3b569c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:30:42 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-dbf6de0d-716b-4c81-a03c-d88346069de6 tempest-TestInstancesWithCinderVolumes-768341847 None] Created volume successfully. Sep 28 09:30:42 devstack sudo[97981]: pam_unix(sudo:session): session closed for user root Sep 28 09:30:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-05cf6387-fef4-4871-ae37-57c1d0563314 tempest-GroupSnapshotsTest-66536182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c02db52a-d114-4a54-bde6-3729016a737c -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c02db52a-d114-4a54-bde6-3729016a737c.ce3d4463-67fb-429e-911d-edc758817b5f" returned: 0 in 0.438s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:30:42 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-05cf6387-fef4-4871-ae37-57c1d0563314 tempest-GroupSnapshotsTest-66536182 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c02db52a-d114-4a54-bde6-3729016a737c.ce3d4463-67fb-429e-911d-edc758817b5f is being set with open permissions: ugo+rw: NotImplementedError Sep 28 09:30:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-05cf6387-fef4-4871-ae37-57c1d0563314 tempest-GroupSnapshotsTest-66536182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c02db52a-d114-4a54-bde6-3729016a737c.ce3d4463-67fb-429e-911d-edc758817b5f {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:30:42 devstack sudo[97988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c02db52a-d114-4a54-bde6-3729016a737c.ce3d4463-67fb-429e-911d-edc758817b5f Sep 28 09:30:42 devstack sudo[97988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:30:43 devstack sudo[97988]: pam_unix(sudo:session): session closed for user root Sep 28 09:30:43 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-05cf6387-fef4-4871-ae37-57c1d0563314 tempest-GroupSnapshotsTest-66536182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c02db52a-d114-4a54-bde6-3729016a737c.ce3d4463-67fb-429e-911d-edc758817b5f" returned: 0 in 0.260s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:30:43 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-05cf6387-fef4-4871-ae37-57c1d0563314 tempest-GroupSnapshotsTest-66536182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c02db52a-d114-4a54-bde6-3729016a737c.info {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:30:43 devstack sudo[97991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c02db52a-d114-4a54-bde6-3729016a737c.info Sep 28 09:30:43 devstack sudo[97991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:30:43 devstack sudo[97991]: pam_unix(sudo:session): session closed for user root Sep 28 09:30:43 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-05cf6387-fef4-4871-ae37-57c1d0563314 tempest-GroupSnapshotsTest-66536182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c02db52a-d114-4a54-bde6-3729016a737c.info" returned: 0 in 0.322s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:30:43 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-05cf6387-fef4-4871-ae37-57c1d0563314 tempest-GroupSnapshotsTest-66536182 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c02db52a-d114-4a54-bde6-3729016a737c.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 09:30:43 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-05cf6387-fef4-4871-ae37-57c1d0563314 tempest-GroupSnapshotsTest-66536182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c02db52a-d114-4a54-bde6-3729016a737c.info {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:30:43 devstack sudo[97994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c02db52a-d114-4a54-bde6-3729016a737c.info Sep 28 09:30:43 devstack sudo[97994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:30:43 devstack sudo[97994]: pam_unix(sudo:session): session closed for user root Sep 28 09:30:43 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-05cf6387-fef4-4871-ae37-57c1d0563314 tempest-GroupSnapshotsTest-66536182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c02db52a-d114-4a54-bde6-3729016a737c.info" returned: 0 in 0.308s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:30:43 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-05cf6387-fef4-4871-ae37-57c1d0563314 tempest-GroupSnapshotsTest-66536182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.495s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:30:43 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-dae61587-ff12-423c-bfe3-f39f9a0ab6b7 tempest-GroupsV314Test-1779058192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:30:43 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-dae61587-ff12-423c-bfe3-f39f9a0ab6b7 tempest-GroupsV314Test-1779058192 None] Flow 'volume_create_manager' (d36089f7-a90c-4d88-a0db-229579df95c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:30:43 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-dae61587-ff12-423c-bfe3-f39f9a0ab6b7 tempest-GroupsV314Test-1779058192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebaddb61-3d8c-4e3f-901d-0ca60cebef32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:30:43 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-dae61587-ff12-423c-bfe3-f39f9a0ab6b7 tempest-GroupsV314Test-1779058192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebaddb61-3d8c-4e3f-901d-0ca60cebef32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:30:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-42937014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=22e18660-cde1-4e0a-bf9a-b4f7bd8d8df1,host='devstack@QuobyteHD#QuobyteHD',id=bb61222c-b02a-46e7-bf06-3577d86158de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6bfb183f22249fe9fd1dfef3bde2bca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:30:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:30:44Z,use_quota=True,user_id='18a59f05e4aa415a9990e3e1e656baba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7522d2a2-95ca-41c4-8095-58902af746bb),volume_type_id=7522d2a2-95ca-41c4-8095-58902af746bb)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:30:43 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-dae61587-ff12-423c-bfe3-f39f9a0ab6b7 tempest-GroupsV314Test-1779058192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e32b1769-9e03-40e1-87ab-644b99a48055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:30:43 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-dae61587-ff12-423c-bfe3-f39f9a0ab6b7 tempest-GroupsV314Test-1779058192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e32b1769-9e03-40e1-87ab-644b99a48055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:30:43 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-dae61587-ff12-423c-bfe3-f39f9a0ab6b7 tempest-GroupsV314Test-1779058192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59c31c45-259a-4890-b2cb-90b3b618cbf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:30:43 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-dae61587-ff12-423c-bfe3-f39f9a0ab6b7 tempest-GroupsV314Test-1779058192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59c31c45-259a-4890-b2cb-90b3b618cbf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb61222c-b02a-46e7-bf06-3577d86158de', 'volume_name': 'volume-bb61222c-b02a-46e7-bf06-3577d86158de', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:30:43 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-dae61587-ff12-423c-bfe3-f39f9a0ab6b7 tempest-GroupsV314Test-1779058192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f22c90e-877d-458a-8512-b1cb597e6e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:30:44 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-dae61587-ff12-423c-bfe3-f39f9a0ab6b7 tempest-GroupsV314Test-1779058192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f22c90e-877d-458a-8512-b1cb597e6e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:30:44 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-dae61587-ff12-423c-bfe3-f39f9a0ab6b7 tempest-GroupsV314Test-1779058192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06ea0c8e-3678-4a16-ba38-269e9a63c705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:30:44 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-dae61587-ff12-423c-bfe3-f39f9a0ab6b7 tempest-GroupsV314Test-1779058192 None] Volume bb61222c-b02a-46e7-bf06-3577d86158de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb61222c-b02a-46e7-bf06-3577d86158de', 'volume_size': 1} Sep 28 09:30:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-dae61587-ff12-423c-bfe3-f39f9a0ab6b7 tempest-GroupsV314Test-1779058192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:30:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-dae61587-ff12-423c-bfe3-f39f9a0ab6b7 tempest-GroupsV314Test-1779058192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:30:44 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-dae61587-ff12-423c-bfe3-f39f9a0ab6b7 tempest-GroupsV314Test-1779058192 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=22e18660-cde1-4e0a-bf9a-b4f7bd8d8df1,created_at=2026-09-28T07:30:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-42937014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=22e18660-cde1-4e0a-bf9a-b4f7bd8d8df1,host='devstack@QuobyteHD#QuobyteHD',id=bb61222c-b02a-46e7-bf06-3577d86158de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6bfb183f22249fe9fd1dfef3bde2bca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:30:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:30:44Z,use_quota=True,user_id='18a59f05e4aa415a9990e3e1e656baba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7522d2a2-95ca-41c4-8095-58902af746bb),volume_type_id=7522d2a2-95ca-41c4-8095-58902af746bb)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:30:44 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-dae61587-ff12-423c-bfe3-f39f9a0ab6b7 tempest-GroupsV314Test-1779058192 None] Creating volume bb61222c-b02a-46e7-bf06-3577d86158de {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:30:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-dae61587-ff12-423c-bfe3-f39f9a0ab6b7 tempest-GroupsV314Test-1779058192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:30:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-dae61587-ff12-423c-bfe3-f39f9a0ab6b7 tempest-GroupsV314Test-1779058192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:30:44 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-dae61587-ff12-423c-bfe3-f39f9a0ab6b7 tempest-GroupsV314Test-1779058192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:30:44 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-dae61587-ff12-423c-bfe3-f39f9a0ab6b7 tempest-GroupsV314Test-1779058192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:30:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-dae61587-ff12-423c-bfe3-f39f9a0ab6b7 tempest-GroupsV314Test-1779058192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:30:44 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-dae61587-ff12-423c-bfe3-f39f9a0ab6b7 tempest-GroupsV314Test-1779058192 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:30:44 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-dae61587-ff12-423c-bfe3-f39f9a0ab6b7 tempest-GroupsV314Test-1779058192 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:30:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-dae61587-ff12-423c-bfe3-f39f9a0ab6b7 tempest-GroupsV314Test-1779058192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bb61222c-b02a-46e7-bf06-3577d86158de 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:30:44 devstack sudo[97997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bb61222c-b02a-46e7-bf06-3577d86158de 1073741824 Sep 28 09:30:44 devstack sudo[97997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:30:44 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-05cf6387-fef4-4871-ae37-57c1d0563314 tempest-GroupSnapshotsTest-66536182 None] group_snapshot 3b859b6b-f231-44c9-a5de-25fbcf1b2308: created successfully Sep 28 09:30:44 devstack sudo[97997]: pam_unix(sudo:session): session closed for user root Sep 28 09:30:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-dae61587-ff12-423c-bfe3-f39f9a0ab6b7 tempest-GroupsV314Test-1779058192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bb61222c-b02a-46e7-bf06-3577d86158de 1073741824" returned: 0 in 0.562s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:30:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-dae61587-ff12-423c-bfe3-f39f9a0ab6b7 tempest-GroupsV314Test-1779058192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bb61222c-b02a-46e7-bf06-3577d86158de {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:30:44 devstack sudo[98004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bb61222c-b02a-46e7-bf06-3577d86158de Sep 28 09:30:44 devstack sudo[98004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:30:44 devstack sudo[98004]: pam_unix(sudo:session): session closed for user root Sep 28 09:30:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-dae61587-ff12-423c-bfe3-f39f9a0ab6b7 tempest-GroupsV314Test-1779058192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bb61222c-b02a-46e7-bf06-3577d86158de" returned: 0 in 0.360s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:30:44 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-dae61587-ff12-423c-bfe3-f39f9a0ab6b7 tempest-GroupsV314Test-1779058192 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:30:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-dae61587-ff12-423c-bfe3-f39f9a0ab6b7 tempest-GroupsV314Test-1779058192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:30:45 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-dae61587-ff12-423c-bfe3-f39f9a0ab6b7 tempest-GroupsV314Test-1779058192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06ea0c8e-3678-4a16-ba38-269e9a63c705) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb61222c-b02a-46e7-bf06-3577d86158de', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:30:45 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-dae61587-ff12-423c-bfe3-f39f9a0ab6b7 tempest-GroupsV314Test-1779058192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (661462bd-87d3-48f8-8b8d-aee3c89791fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:30:45 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-dae61587-ff12-423c-bfe3-f39f9a0ab6b7 tempest-GroupsV314Test-1779058192 None] Volume volume-bb61222c-b02a-46e7-bf06-3577d86158de (bb61222c-b02a-46e7-bf06-3577d86158de): created successfully Sep 28 09:30:45 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-dae61587-ff12-423c-bfe3-f39f9a0ab6b7 tempest-GroupsV314Test-1779058192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (661462bd-87d3-48f8-8b8d-aee3c89791fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:30:45 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-dae61587-ff12-423c-bfe3-f39f9a0ab6b7 tempest-GroupsV314Test-1779058192 None] Flow 'volume_create_manager' (d36089f7-a90c-4d88-a0db-229579df95c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:30:45 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-dae61587-ff12-423c-bfe3-f39f9a0ab6b7 tempest-GroupsV314Test-1779058192 None] Created volume successfully. Sep 28 09:30:45 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-4f9e812c-3580-47ce-9246-778f13bb6e04 tempest-GroupSnapshotsTest-66536182 None] group_snapshot 3b859b6b-f231-44c9-a5de-25fbcf1b2308: deleting Sep 28 09:30:45 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-4f9e812c-3580-47ce-9246-778f13bb6e04 tempest-GroupSnapshotsTest-66536182 None] group_snapshot 3b859b6b-f231-44c9-a5de-25fbcf1b2308: deleting {{(pid=86553) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 09:30:45 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-4f9e812c-3580-47ce-9246-778f13bb6e04 tempest-GroupSnapshotsTest-66536182 None] Acquiring lock "cinder-quobyte-b251d71c-d4aa-440c-9a0e-d804811a43b4" by "delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:30:45 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-4f9e812c-3580-47ce-9246-778f13bb6e04 tempest-GroupSnapshotsTest-66536182 None] Lock "cinder-quobyte-b251d71c-d4aa-440c-9a0e-d804811a43b4" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:30:45 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-4f9e812c-3580-47ce-9246-778f13bb6e04 tempest-GroupSnapshotsTest-66536182 None] Acquiring lock "cinder-quobyte-8a53ce27-660b-4aa0-9f20-b205443634ff" by "_delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:30:45 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-4f9e812c-3580-47ce-9246-778f13bb6e04 tempest-GroupSnapshotsTest-66536182 None] Lock "cinder-quobyte-8a53ce27-660b-4aa0-9f20-b205443634ff" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:30:45 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-4f9e812c-3580-47ce-9246-778f13bb6e04 tempest-GroupSnapshotsTest-66536182 None] Deleting offline snapshot 8a53ce27-660b-4aa0-9f20-b205443634ff of volume b251d71c-d4aa-440c-9a0e-d804811a43b4 {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 09:30:45 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-4f9e812c-3580-47ce-9246-778f13bb6e04 tempest-GroupSnapshotsTest-66536182 None] snapshot_file for this snap is: volume-b251d71c-d4aa-440c-9a0e-d804811a43b4.8a53ce27-660b-4aa0-9f20-b205443634ff {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 09:30:45 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[d607c3cb-b504-44ba-8bde-244482999e8e]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:30:45 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-4f9e812c-3580-47ce-9246-778f13bb6e04 tempest-GroupSnapshotsTest-66536182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b251d71c-d4aa-440c-9a0e-d804811a43b4.8a53ce27-660b-4aa0-9f20-b205443634ff {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:30:45 devstack sudo[98009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b251d71c-d4aa-440c-9a0e-d804811a43b4.8a53ce27-660b-4aa0-9f20-b205443634ff Sep 28 09:30:45 devstack sudo[98009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:30:45 devstack sudo[98009]: pam_unix(sudo:session): session closed for user root Sep 28 09:30:45 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-4f9e812c-3580-47ce-9246-778f13bb6e04 tempest-GroupSnapshotsTest-66536182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b251d71c-d4aa-440c-9a0e-d804811a43b4.8a53ce27-660b-4aa0-9f20-b205443634ff" returned: 0 in 0.495s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:30:45 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-4f9e812c-3580-47ce-9246-778f13bb6e04 tempest-GroupSnapshotsTest-66536182 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b251d71c-d4aa-440c-9a0e-d804811a43b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86553) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 09:30:45 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[fddaebcd-3e52-4f97-a951-bdefb97a1b76]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:30:45 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-4f9e812c-3580-47ce-9246-778f13bb6e04 tempest-GroupSnapshotsTest-66536182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b251d71c-d4aa-440c-9a0e-d804811a43b4 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:30:46 devstack sudo[98014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b251d71c-d4aa-440c-9a0e-d804811a43b4 Sep 28 09:30:46 devstack sudo[98014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:30:46 devstack sudo[98014]: pam_unix(sudo:session): session closed for user root Sep 28 09:30:46 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-4f9e812c-3580-47ce-9246-778f13bb6e04 tempest-GroupSnapshotsTest-66536182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b251d71c-d4aa-440c-9a0e-d804811a43b4" returned: 0 in 0.687s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:30:46 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-4f9e812c-3580-47ce-9246-778f13bb6e04 tempest-GroupSnapshotsTest-66536182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b251d71c-d4aa-440c-9a0e-d804811a43b4.8a53ce27-660b-4aa0-9f20-b205443634ff {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:30:46 devstack sudo[98024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b251d71c-d4aa-440c-9a0e-d804811a43b4.8a53ce27-660b-4aa0-9f20-b205443634ff Sep 28 09:30:46 devstack sudo[98024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:30:47 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-acaabafc-9f36-4ae1-a663-a54e12bce01c req-725cf57c-f659-4842-9554-49958a2ed4fd tempest-TestInstancesWithCinderVolumes-768341847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:30:47 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-acaabafc-9f36-4ae1-a663-a54e12bce01c req-725cf57c-f659-4842-9554-49958a2ed4fd tempest-TestInstancesWithCinderVolumes-768341847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:30:47 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-acaabafc-9f36-4ae1-a663-a54e12bce01c req-725cf57c-f659-4842-9554-49958a2ed4fd tempest-TestInstancesWithCinderVolumes-768341847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:30:47 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [req-acaabafc-9f36-4ae1-a663-a54e12bce01c req-725cf57c-f659-4842-9554-49958a2ed4fd tempest-TestInstancesWithCinderVolumes-768341847 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d', 'name': 'volume-3f00318e-6c8c-415b-a51a-08197b883b08', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd603fb3c-7cf1-4c74-b004-623998f795df', 'enforce_multipath': True} {{(pid=86553) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 09:30:47 devstack cinder-volume[86553]: INFO cinder.volume.manager [req-acaabafc-9f36-4ae1-a663-a54e12bce01c req-725cf57c-f659-4842-9554-49958a2ed4fd tempest-TestInstancesWithCinderVolumes-768341847 None] attachment_update completed successfully. Sep 28 09:30:47 devstack sudo[98024]: pam_unix(sudo:session): session closed for user root Sep 28 09:30:47 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-4f9e812c-3580-47ce-9246-778f13bb6e04 tempest-GroupSnapshotsTest-66536182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b251d71c-d4aa-440c-9a0e-d804811a43b4.8a53ce27-660b-4aa0-9f20-b205443634ff" returned: 0 in 0.565s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:30:47 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-4f9e812c-3580-47ce-9246-778f13bb6e04 tempest-GroupSnapshotsTest-66536182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b251d71c-d4aa-440c-9a0e-d804811a43b4.8a53ce27-660b-4aa0-9f20-b205443634ff {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:30:47 devstack sudo[98039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b251d71c-d4aa-440c-9a0e-d804811a43b4.8a53ce27-660b-4aa0-9f20-b205443634ff Sep 28 09:30:47 devstack sudo[98039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:30:47 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-3700df97-4f35-473a-b790-96d915bf3ae0 tempest-GroupsV314Test-1779058192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:30:47 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-3700df97-4f35-473a-b790-96d915bf3ae0 tempest-GroupsV314Test-1779058192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.004s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:30:47 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-3700df97-4f35-473a-b790-96d915bf3ae0 tempest-GroupsV314Test-1779058192 None] Cloning volume bb61222c-b02a-46e7-bf06-3577d86158de to volume 33012efb-a7a8-4225-a081-1498d25d540b Sep 28 09:30:47 devstack sudo[98039]: pam_unix(sudo:session): session closed for user root Sep 28 09:30:47 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-4f9e812c-3580-47ce-9246-778f13bb6e04 tempest-GroupSnapshotsTest-66536182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b251d71c-d4aa-440c-9a0e-d804811a43b4.8a53ce27-660b-4aa0-9f20-b205443634ff" returned: 0 in 0.491s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:30:47 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-4f9e812c-3580-47ce-9246-778f13bb6e04 tempest-GroupSnapshotsTest-66536182 None] Lock "cinder-quobyte-8a53ce27-660b-4aa0-9f20-b205443634ff" released by "_delete_snapshot" :: held 2.449s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:30:47 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-4f9e812c-3580-47ce-9246-778f13bb6e04 tempest-GroupSnapshotsTest-66536182 None] Lock "cinder-quobyte-b251d71c-d4aa-440c-9a0e-d804811a43b4" released by "delete_snapshot" :: held 2.490s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:30:47 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-3700df97-4f35-473a-b790-96d915bf3ae0 tempest-GroupsV314Test-1779058192 None] Creating offline snapshot 32f11731-3dfa-4c8a-b2fd-f2f4353c3259 of volume bb61222c-b02a-46e7-bf06-3577d86158de {{(pid=86553) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 09:30:47 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-4f9e812c-3580-47ce-9246-778f13bb6e04 tempest-GroupSnapshotsTest-66536182 None] Acquiring lock "cinder-quobyte-c02db52a-d114-4a54-bde6-3729016a737c" by "delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:30:47 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d43bd2-66cf-4376-90e5-c0fbfc831528]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:30:47 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3700df97-4f35-473a-b790-96d915bf3ae0 tempest-GroupsV314Test-1779058192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bb61222c-b02a-46e7-bf06-3577d86158de {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:30:47 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-4f9e812c-3580-47ce-9246-778f13bb6e04 tempest-GroupSnapshotsTest-66536182 None] Lock "cinder-quobyte-c02db52a-d114-4a54-bde6-3729016a737c" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:30:47 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-4f9e812c-3580-47ce-9246-778f13bb6e04 tempest-GroupSnapshotsTest-66536182 None] Acquiring lock "cinder-quobyte-ce3d4463-67fb-429e-911d-edc758817b5f" by "_delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:30:47 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-4f9e812c-3580-47ce-9246-778f13bb6e04 tempest-GroupSnapshotsTest-66536182 None] Lock "cinder-quobyte-ce3d4463-67fb-429e-911d-edc758817b5f" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:30:47 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-4f9e812c-3580-47ce-9246-778f13bb6e04 tempest-GroupSnapshotsTest-66536182 None] Deleting offline snapshot ce3d4463-67fb-429e-911d-edc758817b5f of volume c02db52a-d114-4a54-bde6-3729016a737c {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 09:30:47 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-4f9e812c-3580-47ce-9246-778f13bb6e04 tempest-GroupSnapshotsTest-66536182 None] snapshot_file for this snap is: volume-c02db52a-d114-4a54-bde6-3729016a737c.ce3d4463-67fb-429e-911d-edc758817b5f {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 09:30:47 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f04572d-6036-44c4-b318-ebd9d6094caa]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:30:47 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-4f9e812c-3580-47ce-9246-778f13bb6e04 tempest-GroupSnapshotsTest-66536182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c02db52a-d114-4a54-bde6-3729016a737c.ce3d4463-67fb-429e-911d-edc758817b5f {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:30:48 devstack sudo[98043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bb61222c-b02a-46e7-bf06-3577d86158de Sep 28 09:30:48 devstack sudo[98043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:30:48 devstack sudo[98044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c02db52a-d114-4a54-bde6-3729016a737c.ce3d4463-67fb-429e-911d-edc758817b5f Sep 28 09:30:48 devstack sudo[98044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:30:48 devstack sudo[98043]: pam_unix(sudo:session): session closed for user root Sep 28 09:30:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3700df97-4f35-473a-b790-96d915bf3ae0 tempest-GroupsV314Test-1779058192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bb61222c-b02a-46e7-bf06-3577d86158de" returned: 0 in 0.522s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:30:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3700df97-4f35-473a-b790-96d915bf3ae0 tempest-GroupsV314Test-1779058192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bb61222c-b02a-46e7-bf06-3577d86158de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bb61222c-b02a-46e7-bf06-3577d86158de.32f11731-3dfa-4c8a-b2fd-f2f4353c3259 1G {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:30:48 devstack sudo[98052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bb61222c-b02a-46e7-bf06-3577d86158de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bb61222c-b02a-46e7-bf06-3577d86158de.32f11731-3dfa-4c8a-b2fd-f2f4353c3259 1G Sep 28 09:30:48 devstack sudo[98052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:30:48 devstack sudo[98044]: pam_unix(sudo:session): session closed for user root Sep 28 09:30:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-4f9e812c-3580-47ce-9246-778f13bb6e04 tempest-GroupSnapshotsTest-66536182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c02db52a-d114-4a54-bde6-3729016a737c.ce3d4463-67fb-429e-911d-edc758817b5f" returned: 0 in 0.501s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:30:48 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-4f9e812c-3580-47ce-9246-778f13bb6e04 tempest-GroupSnapshotsTest-66536182 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c02db52a-d114-4a54-bde6-3729016a737c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86553) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 09:30:48 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[86a38b1b-3b97-4eae-9e21-c6f50bf1a220]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:30:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-4f9e812c-3580-47ce-9246-778f13bb6e04 tempest-GroupSnapshotsTest-66536182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c02db52a-d114-4a54-bde6-3729016a737c {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:30:48 devstack sudo[98055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c02db52a-d114-4a54-bde6-3729016a737c Sep 28 09:30:48 devstack sudo[98055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:30:49 devstack sudo[98055]: pam_unix(sudo:session): session closed for user root Sep 28 09:30:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-4f9e812c-3580-47ce-9246-778f13bb6e04 tempest-GroupSnapshotsTest-66536182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c02db52a-d114-4a54-bde6-3729016a737c" returned: 0 in 0.481s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:30:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-4f9e812c-3580-47ce-9246-778f13bb6e04 tempest-GroupSnapshotsTest-66536182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c02db52a-d114-4a54-bde6-3729016a737c.ce3d4463-67fb-429e-911d-edc758817b5f {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:30:49 devstack sudo[98052]: pam_unix(sudo:session): session closed for user root Sep 28 09:30:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3700df97-4f35-473a-b790-96d915bf3ae0 tempest-GroupsV314Test-1779058192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bb61222c-b02a-46e7-bf06-3577d86158de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bb61222c-b02a-46e7-bf06-3577d86158de.32f11731-3dfa-4c8a-b2fd-f2f4353c3259 1G" returned: 0 in 0.639s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:30:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3700df97-4f35-473a-b790-96d915bf3ae0 tempest-GroupsV314Test-1779058192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb61222c-b02a-46e7-bf06-3577d86158de -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bb61222c-b02a-46e7-bf06-3577d86158de.32f11731-3dfa-4c8a-b2fd-f2f4353c3259 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:30:49 devstack sudo[98064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c02db52a-d114-4a54-bde6-3729016a737c.ce3d4463-67fb-429e-911d-edc758817b5f Sep 28 09:30:49 devstack sudo[98064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:30:49 devstack sudo[98066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb61222c-b02a-46e7-bf06-3577d86158de -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bb61222c-b02a-46e7-bf06-3577d86158de.32f11731-3dfa-4c8a-b2fd-f2f4353c3259 Sep 28 09:30:49 devstack sudo[98066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:30:49 devstack sudo[98066]: pam_unix(sudo:session): session closed for user root Sep 28 09:30:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3700df97-4f35-473a-b790-96d915bf3ae0 tempest-GroupsV314Test-1779058192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb61222c-b02a-46e7-bf06-3577d86158de -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bb61222c-b02a-46e7-bf06-3577d86158de.32f11731-3dfa-4c8a-b2fd-f2f4353c3259" returned: 0 in 0.459s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:30:49 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-3700df97-4f35-473a-b790-96d915bf3ae0 tempest-GroupsV314Test-1779058192 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bb61222c-b02a-46e7-bf06-3577d86158de.32f11731-3dfa-4c8a-b2fd-f2f4353c3259 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 09:30:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3700df97-4f35-473a-b790-96d915bf3ae0 tempest-GroupsV314Test-1779058192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bb61222c-b02a-46e7-bf06-3577d86158de.32f11731-3dfa-4c8a-b2fd-f2f4353c3259 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:30:49 devstack sudo[98076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bb61222c-b02a-46e7-bf06-3577d86158de.32f11731-3dfa-4c8a-b2fd-f2f4353c3259 Sep 28 09:30:49 devstack sudo[98076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:30:49 devstack sudo[98064]: pam_unix(sudo:session): session closed for user root Sep 28 09:30:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-4f9e812c-3580-47ce-9246-778f13bb6e04 tempest-GroupSnapshotsTest-66536182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c02db52a-d114-4a54-bde6-3729016a737c.ce3d4463-67fb-429e-911d-edc758817b5f" returned: 0 in 0.576s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:30:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-4f9e812c-3580-47ce-9246-778f13bb6e04 tempest-GroupSnapshotsTest-66536182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c02db52a-d114-4a54-bde6-3729016a737c.ce3d4463-67fb-429e-911d-edc758817b5f {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:30:49 devstack sudo[98078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c02db52a-d114-4a54-bde6-3729016a737c.ce3d4463-67fb-429e-911d-edc758817b5f Sep 28 09:30:49 devstack sudo[98078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:30:49 devstack sudo[98076]: pam_unix(sudo:session): session closed for user root Sep 28 09:30:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3700df97-4f35-473a-b790-96d915bf3ae0 tempest-GroupsV314Test-1779058192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bb61222c-b02a-46e7-bf06-3577d86158de.32f11731-3dfa-4c8a-b2fd-f2f4353c3259" returned: 0 in 0.406s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:30:49 devstack sudo[98078]: pam_unix(sudo:session): session closed for user root Sep 28 09:30:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-4f9e812c-3580-47ce-9246-778f13bb6e04 tempest-GroupSnapshotsTest-66536182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c02db52a-d114-4a54-bde6-3729016a737c.ce3d4463-67fb-429e-911d-edc758817b5f" returned: 0 in 0.354s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:30:49 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-4f9e812c-3580-47ce-9246-778f13bb6e04 tempest-GroupSnapshotsTest-66536182 None] Lock "cinder-quobyte-ce3d4463-67fb-429e-911d-edc758817b5f" released by "_delete_snapshot" :: held 2.073s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:30:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3700df97-4f35-473a-b790-96d915bf3ae0 tempest-GroupsV314Test-1779058192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bb61222c-b02a-46e7-bf06-3577d86158de.info {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:30:50 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-4f9e812c-3580-47ce-9246-778f13bb6e04 tempest-GroupSnapshotsTest-66536182 None] Lock "cinder-quobyte-c02db52a-d114-4a54-bde6-3729016a737c" released by "delete_snapshot" :: held 2.129s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:30:50 devstack sudo[98082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bb61222c-b02a-46e7-bf06-3577d86158de.info Sep 28 09:30:50 devstack sudo[98082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:30:50 devstack cinder-volume[86553]: WARNING cinder.quota [None req-4f9e812c-3580-47ce-9246-778f13bb6e04 tempest-GroupSnapshotsTest-66536182 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-984886878 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-984886878, it is now deprecated. Please use the default quota class for default quota. Sep 28 09:30:50 devstack cinder-volume[86553]: WARNING cinder.quota [None req-4f9e812c-3580-47ce-9246-778f13bb6e04 tempest-GroupSnapshotsTest-66536182 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-984886878 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-984886878, it is now deprecated. Please use the default quota class for default quota. Sep 28 09:30:50 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-4f9e812c-3580-47ce-9246-778f13bb6e04 tempest-GroupSnapshotsTest-66536182 None] Created reservations ['494adec4-bd2c-4e0b-ba15-aae7f9c22dda', '6e2704fe-c3a1-4f8b-9a16-04eb7dc8a984', '5d94bec9-2bc5-4bf0-95cc-50f25f63770f', '3bd3444a-1f7a-4545-bcdb-e58cc3f19fce'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:30:50 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-4f9e812c-3580-47ce-9246-778f13bb6e04 tempest-GroupSnapshotsTest-66536182 None] Created reservations ['569f4b9f-82b5-47ad-86fc-f6fedb9ec0d0', 'd1741f91-387a-4fc8-a488-fea0a6005ce0', '2dea4a54-f69d-4f43-a76c-0c4a4fa9decf', '50548a72-d4f4-437b-ad2c-f9e1c2b3909f'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:30:50 devstack sudo[98082]: pam_unix(sudo:session): session closed for user root Sep 28 09:30:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3700df97-4f35-473a-b790-96d915bf3ae0 tempest-GroupsV314Test-1779058192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bb61222c-b02a-46e7-bf06-3577d86158de.info" returned: 0 in 0.419s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:30:50 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-3700df97-4f35-473a-b790-96d915bf3ae0 tempest-GroupsV314Test-1779058192 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bb61222c-b02a-46e7-bf06-3577d86158de.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 09:30:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3700df97-4f35-473a-b790-96d915bf3ae0 tempest-GroupsV314Test-1779058192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bb61222c-b02a-46e7-bf06-3577d86158de.info {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:30:50 devstack sudo[98085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bb61222c-b02a-46e7-bf06-3577d86158de.info Sep 28 09:30:50 devstack sudo[98085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:30:50 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-4f9e812c-3580-47ce-9246-778f13bb6e04 tempest-GroupSnapshotsTest-66536182 None] group_snapshot 3b859b6b-f231-44c9-a5de-25fbcf1b2308: deleted successfully Sep 28 09:30:50 devstack sudo[98085]: pam_unix(sudo:session): session closed for user root Sep 28 09:30:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3700df97-4f35-473a-b790-96d915bf3ae0 tempest-GroupsV314Test-1779058192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bb61222c-b02a-46e7-bf06-3577d86158de.info" returned: 0 in 0.316s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:30:50 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-3700df97-4f35-473a-b790-96d915bf3ae0 tempest-GroupsV314Test-1779058192 None] Acquiring lock "cinder-quobyte-33012efb-a7a8-4225-a081-1498d25d540b" by "_copy_volume_from_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:30:50 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-3700df97-4f35-473a-b790-96d915bf3ae0 tempest-GroupsV314Test-1779058192 None] Lock "cinder-quobyte-33012efb-a7a8-4225-a081-1498d25d540b" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:30:50 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-3700df97-4f35-473a-b790-96d915bf3ae0 tempest-GroupsV314Test-1779058192 None] snapshot: 32f11731-3dfa-4c8a-b2fd-f2f4353c3259, volume: 33012efb-a7a8-4225-a081-1498d25d540b, {{(pid=86553) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 09:30:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-3700df97-4f35-473a-b790-96d915bf3ae0 tempest-GroupsV314Test-1779058192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:30:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-3700df97-4f35-473a-b790-96d915bf3ae0 tempest-GroupsV314Test-1779058192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:30:50 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-3700df97-4f35-473a-b790-96d915bf3ae0 tempest-GroupsV314Test-1779058192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:30:50 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-3700df97-4f35-473a-b790-96d915bf3ae0 tempest-GroupsV314Test-1779058192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:30:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-3700df97-4f35-473a-b790-96d915bf3ae0 tempest-GroupsV314Test-1779058192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:30:50 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[b572b35c-28e8-4eb3-ae63-189139c2b933]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:30:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3700df97-4f35-473a-b790-96d915bf3ae0 tempest-GroupsV314Test-1779058192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bb61222c-b02a-46e7-bf06-3577d86158de.32f11731-3dfa-4c8a-b2fd-f2f4353c3259 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:30:50 devstack sudo[98088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bb61222c-b02a-46e7-bf06-3577d86158de.32f11731-3dfa-4c8a-b2fd-f2f4353c3259 Sep 28 09:30:50 devstack sudo[98088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:30:51 devstack sudo[98088]: pam_unix(sudo:session): session closed for user root Sep 28 09:30:51 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3700df97-4f35-473a-b790-96d915bf3ae0 tempest-GroupsV314Test-1779058192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bb61222c-b02a-46e7-bf06-3577d86158de.32f11731-3dfa-4c8a-b2fd-f2f4353c3259" returned: 0 in 0.471s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:30:51 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-3700df97-4f35-473a-b790-96d915bf3ae0 tempest-GroupsV314Test-1779058192 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb61222c-b02a-46e7-bf06-3577d86158de(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86553) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 09:30:51 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c17577e-79a6-4ac1-be93-cdb214f12920]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:30:51 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3700df97-4f35-473a-b790-96d915bf3ae0 tempest-GroupsV314Test-1779058192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bb61222c-b02a-46e7-bf06-3577d86158de {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:30:51 devstack sudo[98093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bb61222c-b02a-46e7-bf06-3577d86158de Sep 28 09:30:51 devstack sudo[98093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:30:51 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-ec420abc-cd7a-4a86-9094-6326a8a6ddd8 tempest-GroupSnapshotsTest-66536182 None] Acquiring lock "cinder-quobyte-b251d71c-d4aa-440c-9a0e-d804811a43b4" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:30:51 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-ec420abc-cd7a-4a86-9094-6326a8a6ddd8 tempest-GroupSnapshotsTest-66536182 None] Lock "cinder-quobyte-b251d71c-d4aa-440c-9a0e-d804811a43b4" acquired by "delete_volume" :: waited 0.022s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:30:51 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[16e22d9c-0bcc-4ec5-8846-49dc38fcd395]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:30:51 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ec420abc-cd7a-4a86-9094-6326a8a6ddd8 tempest-GroupSnapshotsTest-66536182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b251d71c-d4aa-440c-9a0e-d804811a43b4 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:30:51 devstack sudo[98095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b251d71c-d4aa-440c-9a0e-d804811a43b4 Sep 28 09:30:51 devstack sudo[98095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:30:52 devstack sudo[98093]: pam_unix(sudo:session): session closed for user root Sep 28 09:30:52 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3700df97-4f35-473a-b790-96d915bf3ae0 tempest-GroupsV314Test-1779058192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bb61222c-b02a-46e7-bf06-3577d86158de" returned: 0 in 0.688s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:30:52 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-3700df97-4f35-473a-b790-96d915bf3ae0 tempest-GroupsV314Test-1779058192 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bb61222c-b02a-46e7-bf06-3577d86158de {{(pid=86553) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 09:30:52 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-3700df97-4f35-473a-b790-96d915bf3ae0 tempest-GroupsV314Test-1779058192 None] Creating direct copy from snapshot {{(pid=86553) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 09:30:52 devstack cinder-volume[86553]: DEBUG cinder.utils [None req-3700df97-4f35-473a-b790-96d915bf3ae0 tempest-GroupsV314Test-1779058192 None] Path /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-33012efb-a7a8-4225-a081-1498d25d540b not found in is_blk_device check {{(pid=86553) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 09:30:52 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3700df97-4f35-473a-b790-96d915bf3ae0 tempest-GroupsV314Test-1779058192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bb61222c-b02a-46e7-bf06-3577d86158de /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-33012efb-a7a8-4225-a081-1498d25d540b {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:30:52 devstack sudo[98104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bb61222c-b02a-46e7-bf06-3577d86158de /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-33012efb-a7a8-4225-a081-1498d25d540b Sep 28 09:30:52 devstack sudo[98104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:30:52 devstack sudo[98095]: pam_unix(sudo:session): session closed for user root Sep 28 09:30:52 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ec420abc-cd7a-4a86-9094-6326a8a6ddd8 tempest-GroupSnapshotsTest-66536182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b251d71c-d4aa-440c-9a0e-d804811a43b4" returned: 0 in 0.540s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:30:52 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ec420abc-cd7a-4a86-9094-6326a8a6ddd8 tempest-GroupSnapshotsTest-66536182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b251d71c-d4aa-440c-9a0e-d804811a43b4 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:30:52 devstack sudo[98130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b251d71c-d4aa-440c-9a0e-d804811a43b4 Sep 28 09:30:52 devstack sudo[98130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:30:52 devstack sudo[98130]: pam_unix(sudo:session): session closed for user root Sep 28 09:30:52 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ec420abc-cd7a-4a86-9094-6326a8a6ddd8 tempest-GroupSnapshotsTest-66536182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b251d71c-d4aa-440c-9a0e-d804811a43b4" returned: 0 in 0.514s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:30:52 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-ec420abc-cd7a-4a86-9094-6326a8a6ddd8 tempest-GroupSnapshotsTest-66536182 None] Lock "cinder-quobyte-b251d71c-d4aa-440c-9a0e-d804811a43b4" released by "delete_volume" :: held 1.199s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:30:52 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-ec420abc-cd7a-4a86-9094-6326a8a6ddd8 tempest-GroupSnapshotsTest-66536182 None] Acquiring lock "cinder-quobyte-c02db52a-d114-4a54-bde6-3729016a737c" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:30:52 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-ec420abc-cd7a-4a86-9094-6326a8a6ddd8 tempest-GroupSnapshotsTest-66536182 None] Lock "cinder-quobyte-c02db52a-d114-4a54-bde6-3729016a737c" acquired by "delete_volume" :: waited 0.032s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:30:52 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[750627ea-b869-4669-ad27-d62e3c7a5ef6]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:30:52 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ec420abc-cd7a-4a86-9094-6326a8a6ddd8 tempest-GroupSnapshotsTest-66536182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c02db52a-d114-4a54-bde6-3729016a737c {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:30:53 devstack sudo[98229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c02db52a-d114-4a54-bde6-3729016a737c Sep 28 09:30:53 devstack sudo[98229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:30:54 devstack sudo[98229]: pam_unix(sudo:session): session closed for user root Sep 28 09:30:54 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ec420abc-cd7a-4a86-9094-6326a8a6ddd8 tempest-GroupSnapshotsTest-66536182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c02db52a-d114-4a54-bde6-3729016a737c" returned: 0 in 1.192s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:30:54 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ec420abc-cd7a-4a86-9094-6326a8a6ddd8 tempest-GroupSnapshotsTest-66536182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c02db52a-d114-4a54-bde6-3729016a737c {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:30:54 devstack sudo[98588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c02db52a-d114-4a54-bde6-3729016a737c Sep 28 09:30:54 devstack sudo[98588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:30:54 devstack sudo[98588]: pam_unix(sudo:session): session closed for user root Sep 28 09:30:54 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ec420abc-cd7a-4a86-9094-6326a8a6ddd8 tempest-GroupSnapshotsTest-66536182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c02db52a-d114-4a54-bde6-3729016a737c" returned: 0 in 0.491s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:30:54 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-ec420abc-cd7a-4a86-9094-6326a8a6ddd8 tempest-GroupSnapshotsTest-66536182 None] Lock "cinder-quobyte-c02db52a-d114-4a54-bde6-3729016a737c" released by "delete_volume" :: held 1.846s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:30:54 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-ec420abc-cd7a-4a86-9094-6326a8a6ddd8 tempest-GroupSnapshotsTest-66536182 None] Created reservations ['ac59852d-70b0-442e-9de8-4454a817ace9'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:30:54 devstack cinder-volume[86553]: WARNING cinder.quota [None req-ec420abc-cd7a-4a86-9094-6326a8a6ddd8 tempest-GroupSnapshotsTest-66536182 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-984886878 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-984886878, it is now deprecated. Please use the default quota class for default quota. Sep 28 09:30:55 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-ec420abc-cd7a-4a86-9094-6326a8a6ddd8 tempest-GroupSnapshotsTest-66536182 None] Created reservations ['baeee9c8-2187-4340-8011-50b444dccc8b', 'c457b473-9814-4f77-bff4-d10bb1f31f96', 'fc7b75e3-8b5f-414b-9276-214c6e770469', '5f511e00-856d-4de1-8784-63641f91e496'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:30:55 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-ec420abc-cd7a-4a86-9094-6326a8a6ddd8 tempest-GroupSnapshotsTest-66536182 None] Created reservations ['99e89ce1-bfbe-4112-a1e6-c7adfbcb7f49', '503fe292-9dc7-4b72-a8d5-0b4e4744aa18', '8af6bbc8-da97-4cf0-917b-a05b7e4257e2', 'd011060c-9e5c-46d0-bb75-c6f042e224a3'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:30:55 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ec420abc-cd7a-4a86-9094-6326a8a6ddd8 tempest-GroupSnapshotsTest-66536182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:30:55 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ec420abc-cd7a-4a86-9094-6326a8a6ddd8 tempest-GroupSnapshotsTest-66536182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:30:55 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ec420abc-cd7a-4a86-9094-6326a8a6ddd8 tempest-GroupSnapshotsTest-66536182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:30:55 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ec420abc-cd7a-4a86-9094-6326a8a6ddd8 tempest-GroupSnapshotsTest-66536182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:30:55 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ec420abc-cd7a-4a86-9094-6326a8a6ddd8 tempest-GroupSnapshotsTest-66536182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:30:55 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ec420abc-cd7a-4a86-9094-6326a8a6ddd8 tempest-GroupSnapshotsTest-66536182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:30:55 devstack sudo[98606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:30:55 devstack sudo[98606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:30:56 devstack sudo[98606]: pam_unix(sudo:session): session closed for user root Sep 28 09:30:56 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ec420abc-cd7a-4a86-9094-6326a8a6ddd8 tempest-GroupSnapshotsTest-66536182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.927s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:30:56 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-ec420abc-cd7a-4a86-9094-6326a8a6ddd8 tempest-GroupSnapshotsTest-66536182 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:30:56 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-ec420abc-cd7a-4a86-9094-6326a8a6ddd8 tempest-GroupSnapshotsTest-66536182 None] Delete group completed successfully. Sep 28 09:30:57 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-c49413fd-f200-4f5e-b62f-a72f8cb75a74 tempest-GroupSnapshotsTest-66536182 None] Group tempest-GroupSnapshotsTest-Group-1938424808: creating Sep 28 09:30:57 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-c49413fd-f200-4f5e-b62f-a72f8cb75a74 tempest-GroupSnapshotsTest-66536182 None] Group tempest-GroupSnapshotsTest-Group-1938424808: created successfully Sep 28 09:30:57 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-c49413fd-f200-4f5e-b62f-a72f8cb75a74 tempest-GroupSnapshotsTest-66536182 None] Create group completed successfully. Sep 28 09:31:00 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-b25aec2d-350d-4208-a389-ee092965ee41 tempest-GroupSnapshotsTest-66536182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:31:00 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b25aec2d-350d-4208-a389-ee092965ee41 tempest-GroupSnapshotsTest-66536182 None] Flow 'volume_create_manager' (d2123f90-c83c-41a0-86d2-91ea4dc9e607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:31:00 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b25aec2d-350d-4208-a389-ee092965ee41 tempest-GroupSnapshotsTest-66536182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aab2b7b6-247a-422b-b4f6-91e0966a9884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:31:00 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b25aec2d-350d-4208-a389-ee092965ee41 tempest-GroupSnapshotsTest-66536182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aab2b7b6-247a-422b-b4f6-91e0966a9884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:30:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-383891380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4fdbaa65-0c64-43c5-a65e-caa6fc1b92ac,host='devstack@QuobyteHD#QuobyteHD',id=6a720db2-8b46-47f7-a2b3-c5500a89a161,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='964f6f31e07341aeb603b37fc019071c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:31:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:31:00Z,use_quota=True,user_id='51bf61d870194f83b9e7a4290b47b9cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fbbaff-8806-4af5-b99c-cda69d6c96b7),volume_type_id=24fbbaff-8806-4af5-b99c-cda69d6c96b7)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:31:00 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b25aec2d-350d-4208-a389-ee092965ee41 tempest-GroupSnapshotsTest-66536182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15645890-929d-4714-a24a-8647473d1464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:31:00 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b25aec2d-350d-4208-a389-ee092965ee41 tempest-GroupSnapshotsTest-66536182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15645890-929d-4714-a24a-8647473d1464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:31:00 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b25aec2d-350d-4208-a389-ee092965ee41 tempest-GroupSnapshotsTest-66536182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89257ae0-f04e-40c0-bce4-5fc21d419a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:31:00 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b25aec2d-350d-4208-a389-ee092965ee41 tempest-GroupSnapshotsTest-66536182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89257ae0-f04e-40c0-bce4-5fc21d419a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a720db2-8b46-47f7-a2b3-c5500a89a161', 'volume_name': 'volume-6a720db2-8b46-47f7-a2b3-c5500a89a161', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:31:00 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b25aec2d-350d-4208-a389-ee092965ee41 tempest-GroupSnapshotsTest-66536182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27002c7b-2ee0-4290-a033-7dc96b0bf51d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:31:00 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b25aec2d-350d-4208-a389-ee092965ee41 tempest-GroupSnapshotsTest-66536182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27002c7b-2ee0-4290-a033-7dc96b0bf51d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:31:00 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b25aec2d-350d-4208-a389-ee092965ee41 tempest-GroupSnapshotsTest-66536182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab085cb6-f96e-48c9-8d74-29ffac4adbbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:31:00 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-b25aec2d-350d-4208-a389-ee092965ee41 tempest-GroupSnapshotsTest-66536182 None] Volume 6a720db2-8b46-47f7-a2b3-c5500a89a161: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a720db2-8b46-47f7-a2b3-c5500a89a161', 'volume_size': 1} Sep 28 09:31:00 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-b25aec2d-350d-4208-a389-ee092965ee41 tempest-GroupSnapshotsTest-66536182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:31:04 devstack sudo[98104]: pam_unix(sudo:session): session closed for user root Sep 28 09:31:04 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3700df97-4f35-473a-b790-96d915bf3ae0 tempest-GroupsV314Test-1779058192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bb61222c-b02a-46e7-bf06-3577d86158de /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-33012efb-a7a8-4225-a081-1498d25d540b" returned: 0 in 12.938s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:31:04 devstack cinder-volume[86553]: DEBUG cinder.image.image_utils [None req-3700df97-4f35-473a-b790-96d915bf3ae0 tempest-GroupsV314Test-1779058192 None] Image conversion details: src /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bb61222c-b02a-46e7-bf06-3577d86158de, size 1024.00 MB, duration 12.94 sec, destination /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-33012efb-a7a8-4225-a081-1498d25d540b {{(pid=86553) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 09:31:04 devstack cinder-volume[86553]: INFO cinder.image.image_utils [None req-3700df97-4f35-473a-b790-96d915bf3ae0 tempest-GroupsV314Test-1779058192 None] Converted 1024.00 MB image at 79.11 MB/s Sep 28 09:31:04 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-3700df97-4f35-473a-b790-96d915bf3ae0 tempest-GroupsV314Test-1779058192 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-33012efb-a7a8-4225-a081-1498d25d540b is being set with open permissions: ugo+rw: NotImplementedError Sep 28 09:31:04 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3700df97-4f35-473a-b790-96d915bf3ae0 tempest-GroupsV314Test-1779058192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-33012efb-a7a8-4225-a081-1498d25d540b {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:31:05 devstack sudo[98628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-33012efb-a7a8-4225-a081-1498d25d540b Sep 28 09:31:05 devstack sudo[98628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:31:05 devstack sudo[98628]: pam_unix(sudo:session): session closed for user root Sep 28 09:31:05 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3700df97-4f35-473a-b790-96d915bf3ae0 tempest-GroupsV314Test-1779058192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-33012efb-a7a8-4225-a081-1498d25d540b" returned: 0 in 0.310s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:31:05 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-3700df97-4f35-473a-b790-96d915bf3ae0 tempest-GroupsV314Test-1779058192 None] Lock "cinder-quobyte-33012efb-a7a8-4225-a081-1498d25d540b" released by "_copy_volume_from_snapshot" :: held 14.532s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:31:05 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-3700df97-4f35-473a-b790-96d915bf3ae0 tempest-GroupsV314Test-1779058192 None] Acquiring lock "cinder-quobyte-32f11731-3dfa-4c8a-b2fd-f2f4353c3259" by "_delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:31:05 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-3700df97-4f35-473a-b790-96d915bf3ae0 tempest-GroupsV314Test-1779058192 None] Lock "cinder-quobyte-32f11731-3dfa-4c8a-b2fd-f2f4353c3259" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:31:05 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-3700df97-4f35-473a-b790-96d915bf3ae0 tempest-GroupsV314Test-1779058192 None] Deleting offline snapshot 32f11731-3dfa-4c8a-b2fd-f2f4353c3259 of volume bb61222c-b02a-46e7-bf06-3577d86158de {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 09:31:05 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-3700df97-4f35-473a-b790-96d915bf3ae0 tempest-GroupsV314Test-1779058192 None] snapshot_file for this snap is: volume-bb61222c-b02a-46e7-bf06-3577d86158de.32f11731-3dfa-4c8a-b2fd-f2f4353c3259 {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 09:31:05 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[24dc0c76-ec67-4dbe-8e05-1b1a767d7c1d]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:31:05 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3700df97-4f35-473a-b790-96d915bf3ae0 tempest-GroupsV314Test-1779058192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bb61222c-b02a-46e7-bf06-3577d86158de.32f11731-3dfa-4c8a-b2fd-f2f4353c3259 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:31:05 devstack sudo[98631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bb61222c-b02a-46e7-bf06-3577d86158de.32f11731-3dfa-4c8a-b2fd-f2f4353c3259 Sep 28 09:31:05 devstack sudo[98631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:31:05 devstack sudo[98631]: pam_unix(sudo:session): session closed for user root Sep 28 09:31:05 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3700df97-4f35-473a-b790-96d915bf3ae0 tempest-GroupsV314Test-1779058192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bb61222c-b02a-46e7-bf06-3577d86158de.32f11731-3dfa-4c8a-b2fd-f2f4353c3259" returned: 0 in 0.533s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:31:05 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-3700df97-4f35-473a-b790-96d915bf3ae0 tempest-GroupsV314Test-1779058192 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb61222c-b02a-46e7-bf06-3577d86158de(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86553) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 09:31:06 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c120f3-4619-4d92-b484-14e8c9e49383]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:31:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3700df97-4f35-473a-b790-96d915bf3ae0 tempest-GroupsV314Test-1779058192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bb61222c-b02a-46e7-bf06-3577d86158de {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:31:06 devstack sudo[98640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bb61222c-b02a-46e7-bf06-3577d86158de Sep 28 09:31:06 devstack sudo[98640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:31:06 devstack sudo[98640]: pam_unix(sudo:session): session closed for user root Sep 28 09:31:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3700df97-4f35-473a-b790-96d915bf3ae0 tempest-GroupsV314Test-1779058192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bb61222c-b02a-46e7-bf06-3577d86158de" returned: 0 in 0.738s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:31:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3700df97-4f35-473a-b790-96d915bf3ae0 tempest-GroupsV314Test-1779058192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bb61222c-b02a-46e7-bf06-3577d86158de.32f11731-3dfa-4c8a-b2fd-f2f4353c3259 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:31:06 devstack sudo[98645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bb61222c-b02a-46e7-bf06-3577d86158de.32f11731-3dfa-4c8a-b2fd-f2f4353c3259 Sep 28 09:31:06 devstack sudo[98645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:31:07 devstack sudo[98645]: pam_unix(sudo:session): session closed for user root Sep 28 09:31:07 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3700df97-4f35-473a-b790-96d915bf3ae0 tempest-GroupsV314Test-1779058192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bb61222c-b02a-46e7-bf06-3577d86158de.32f11731-3dfa-4c8a-b2fd-f2f4353c3259" returned: 0 in 0.421s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:31:07 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3700df97-4f35-473a-b790-96d915bf3ae0 tempest-GroupsV314Test-1779058192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bb61222c-b02a-46e7-bf06-3577d86158de.32f11731-3dfa-4c8a-b2fd-f2f4353c3259 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:31:07 devstack sudo[98652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bb61222c-b02a-46e7-bf06-3577d86158de.32f11731-3dfa-4c8a-b2fd-f2f4353c3259 Sep 28 09:31:07 devstack sudo[98652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:31:07 devstack sudo[98652]: pam_unix(sudo:session): session closed for user root Sep 28 09:31:07 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3700df97-4f35-473a-b790-96d915bf3ae0 tempest-GroupsV314Test-1779058192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bb61222c-b02a-46e7-bf06-3577d86158de.32f11731-3dfa-4c8a-b2fd-f2f4353c3259" returned: 0 in 0.483s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:31:07 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-3700df97-4f35-473a-b790-96d915bf3ae0 tempest-GroupsV314Test-1779058192 None] Lock "cinder-quobyte-32f11731-3dfa-4c8a-b2fd-f2f4353c3259" released by "_delete_snapshot" :: held 2.354s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:31:07 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-3700df97-4f35-473a-b790-96d915bf3ae0 tempest-GroupsV314Test-1779058192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 20.069s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:31:07 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-b25aec2d-350d-4208-a389-ee092965ee41 tempest-GroupSnapshotsTest-66536182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.199s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:31:07 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-b25aec2d-350d-4208-a389-ee092965ee41 tempest-GroupSnapshotsTest-66536182 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4fdbaa65-0c64-43c5-a65e-caa6fc1b92ac,created_at=2026-09-28T07:30:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-383891380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4fdbaa65-0c64-43c5-a65e-caa6fc1b92ac,host='devstack@QuobyteHD#QuobyteHD',id=6a720db2-8b46-47f7-a2b3-c5500a89a161,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='964f6f31e07341aeb603b37fc019071c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:31:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:31:00Z,use_quota=True,user_id='51bf61d870194f83b9e7a4290b47b9cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fbbaff-8806-4af5-b99c-cda69d6c96b7),volume_type_id=24fbbaff-8806-4af5-b99c-cda69d6c96b7)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:31:07 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-b25aec2d-350d-4208-a389-ee092965ee41 tempest-GroupSnapshotsTest-66536182 None] Creating volume 6a720db2-8b46-47f7-a2b3-c5500a89a161 {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:31:07 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-b25aec2d-350d-4208-a389-ee092965ee41 tempest-GroupSnapshotsTest-66536182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:31:07 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-b25aec2d-350d-4208-a389-ee092965ee41 tempest-GroupSnapshotsTest-66536182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:31:07 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-b25aec2d-350d-4208-a389-ee092965ee41 tempest-GroupSnapshotsTest-66536182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:31:07 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-b25aec2d-350d-4208-a389-ee092965ee41 tempest-GroupSnapshotsTest-66536182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:31:07 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-b25aec2d-350d-4208-a389-ee092965ee41 tempest-GroupSnapshotsTest-66536182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:31:07 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-b25aec2d-350d-4208-a389-ee092965ee41 tempest-GroupSnapshotsTest-66536182 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:31:07 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-b25aec2d-350d-4208-a389-ee092965ee41 tempest-GroupSnapshotsTest-66536182 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:31:07 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b25aec2d-350d-4208-a389-ee092965ee41 tempest-GroupSnapshotsTest-66536182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6a720db2-8b46-47f7-a2b3-c5500a89a161 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:31:07 devstack sudo[98656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6a720db2-8b46-47f7-a2b3-c5500a89a161 1073741824 Sep 28 09:31:07 devstack sudo[98656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:31:07 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-3700df97-4f35-473a-b790-96d915bf3ae0 tempest-GroupsV314Test-1779058192 None] Create group from source-group-22e18660-cde1-4e0a-bf9a-b4f7bd8d8df1 completed successfully. Sep 28 09:31:08 devstack sudo[98656]: pam_unix(sudo:session): session closed for user root Sep 28 09:31:08 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b25aec2d-350d-4208-a389-ee092965ee41 tempest-GroupSnapshotsTest-66536182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6a720db2-8b46-47f7-a2b3-c5500a89a161 1073741824" returned: 0 in 0.618s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:31:08 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b25aec2d-350d-4208-a389-ee092965ee41 tempest-GroupSnapshotsTest-66536182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6a720db2-8b46-47f7-a2b3-c5500a89a161 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:31:08 devstack sudo[98662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6a720db2-8b46-47f7-a2b3-c5500a89a161 Sep 28 09:31:08 devstack sudo[98662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:31:08 devstack sudo[98662]: pam_unix(sudo:session): session closed for user root Sep 28 09:31:08 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b25aec2d-350d-4208-a389-ee092965ee41 tempest-GroupSnapshotsTest-66536182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6a720db2-8b46-47f7-a2b3-c5500a89a161" returned: 0 in 0.477s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:31:08 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-b25aec2d-350d-4208-a389-ee092965ee41 tempest-GroupSnapshotsTest-66536182 None] <== create_volume: return (1161ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:31:08 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-b25aec2d-350d-4208-a389-ee092965ee41 tempest-GroupSnapshotsTest-66536182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.165s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:31:08 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b25aec2d-350d-4208-a389-ee092965ee41 tempest-GroupSnapshotsTest-66536182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab085cb6-f96e-48c9-8d74-29ffac4adbbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a720db2-8b46-47f7-a2b3-c5500a89a161', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:31:08 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b25aec2d-350d-4208-a389-ee092965ee41 tempest-GroupSnapshotsTest-66536182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (722f88a5-fe1a-48e4-aa21-230754bc2753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:31:08 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-b25aec2d-350d-4208-a389-ee092965ee41 tempest-GroupSnapshotsTest-66536182 None] Volume volume-6a720db2-8b46-47f7-a2b3-c5500a89a161 (6a720db2-8b46-47f7-a2b3-c5500a89a161): created successfully Sep 28 09:31:09 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b25aec2d-350d-4208-a389-ee092965ee41 tempest-GroupSnapshotsTest-66536182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (722f88a5-fe1a-48e4-aa21-230754bc2753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:31:09 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b25aec2d-350d-4208-a389-ee092965ee41 tempest-GroupSnapshotsTest-66536182 None] Flow 'volume_create_manager' (d2123f90-c83c-41a0-86d2-91ea4dc9e607) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:31:09 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-b25aec2d-350d-4208-a389-ee092965ee41 tempest-GroupSnapshotsTest-66536182 None] Created volume successfully. Sep 28 09:31:09 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-e3cc3348-a90c-402f-9cf3-e2d0b929b999 tempest-GroupsV314Test-1779058192 None] Acquiring lock "cinder-quobyte-33012efb-a7a8-4225-a081-1498d25d540b" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:31:09 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-e3cc3348-a90c-402f-9cf3-e2d0b929b999 tempest-GroupsV314Test-1779058192 None] Lock "cinder-quobyte-33012efb-a7a8-4225-a081-1498d25d540b" acquired by "delete_volume" :: waited 0.022s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:31:09 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[96c80b25-61f8-46ce-b4dc-e914a868aa4e]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:31:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e3cc3348-a90c-402f-9cf3-e2d0b929b999 tempest-GroupsV314Test-1779058192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-33012efb-a7a8-4225-a081-1498d25d540b {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:31:10 devstack sudo[98665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-33012efb-a7a8-4225-a081-1498d25d540b Sep 28 09:31:10 devstack sudo[98665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:31:10 devstack sudo[98665]: pam_unix(sudo:session): session closed for user root Sep 28 09:31:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e3cc3348-a90c-402f-9cf3-e2d0b929b999 tempest-GroupsV314Test-1779058192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-33012efb-a7a8-4225-a081-1498d25d540b" returned: 0 in 1.073s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:31:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e3cc3348-a90c-402f-9cf3-e2d0b929b999 tempest-GroupsV314Test-1779058192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-33012efb-a7a8-4225-a081-1498d25d540b {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:31:10 devstack sudo[98671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-33012efb-a7a8-4225-a081-1498d25d540b Sep 28 09:31:10 devstack sudo[98671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:31:11 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-8181b863-d405-47e1-be8c-6a40d8344b25 tempest-GroupSnapshotsTest-66536182 None] GroupSnapshot 62b11d46-64b6-47bc-9abe-e568e0261fcc: creating. Sep 28 09:31:11 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-8181b863-d405-47e1-be8c-6a40d8344b25 tempest-GroupSnapshotsTest-66536182 None] Group snapshot 62b11d46-64b6-47bc-9abe-e568e0261fcc: creating. {{(pid=86553) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 09:31:11 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-8181b863-d405-47e1-be8c-6a40d8344b25 tempest-GroupSnapshotsTest-66536182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:31:11 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-8181b863-d405-47e1-be8c-6a40d8344b25 tempest-GroupSnapshotsTest-66536182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:31:11 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-8181b863-d405-47e1-be8c-6a40d8344b25 tempest-GroupSnapshotsTest-66536182 None] Creating offline snapshot dc283f44-bda7-4141-ac95-9d60b17cbedc of volume 6a720db2-8b46-47f7-a2b3-c5500a89a161 {{(pid=86553) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 09:31:11 devstack sudo[98671]: pam_unix(sudo:session): session closed for user root Sep 28 09:31:11 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e3cc3348-a90c-402f-9cf3-e2d0b929b999 tempest-GroupsV314Test-1779058192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-33012efb-a7a8-4225-a081-1498d25d540b" returned: 0 in 0.368s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:31:11 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeacfe21-5c8a-423c-8105-8de7522bd856]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:31:11 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-8181b863-d405-47e1-be8c-6a40d8344b25 tempest-GroupSnapshotsTest-66536182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6a720db2-8b46-47f7-a2b3-c5500a89a161 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:31:11 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-e3cc3348-a90c-402f-9cf3-e2d0b929b999 tempest-GroupsV314Test-1779058192 None] Lock "cinder-quobyte-33012efb-a7a8-4225-a081-1498d25d540b" released by "delete_volume" :: held 1.584s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:31:11 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-e3cc3348-a90c-402f-9cf3-e2d0b929b999 tempest-GroupsV314Test-1779058192 None] Created reservations ['10cdab61-4619-4378-9048-83d47d5bc416'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:31:11 devstack sudo[98674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6a720db2-8b46-47f7-a2b3-c5500a89a161 Sep 28 09:31:11 devstack sudo[98674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:31:11 devstack cinder-volume[86553]: WARNING cinder.quota [None req-e3cc3348-a90c-402f-9cf3-e2d0b929b999 tempest-GroupsV314Test-1779058192 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1461918706 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1461918706, it is now deprecated. Please use the default quota class for default quota. Sep 28 09:31:11 devstack cinder-volume[86553]: WARNING cinder.quota [None req-e3cc3348-a90c-402f-9cf3-e2d0b929b999 tempest-GroupsV314Test-1779058192 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1461918706 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1461918706, it is now deprecated. Please use the default quota class for default quota. Sep 28 09:31:11 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-e3cc3348-a90c-402f-9cf3-e2d0b929b999 tempest-GroupsV314Test-1779058192 None] Created reservations ['ee6d2ebd-2dd0-4e61-8ca6-8be35f77035b', '28339084-8c45-4979-9233-0b623632f645', '552cdd48-c5ea-47be-be10-4762abfb9a01', '93e8820e-e1d8-49eb-9a4c-92a2152d0328'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:31:11 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-e3cc3348-a90c-402f-9cf3-e2d0b929b999 tempest-GroupsV314Test-1779058192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:31:11 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-e3cc3348-a90c-402f-9cf3-e2d0b929b999 tempest-GroupsV314Test-1779058192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:31:11 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-e3cc3348-a90c-402f-9cf3-e2d0b929b999 tempest-GroupsV314Test-1779058192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:31:11 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-e3cc3348-a90c-402f-9cf3-e2d0b929b999 tempest-GroupsV314Test-1779058192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:31:11 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-e3cc3348-a90c-402f-9cf3-e2d0b929b999 tempest-GroupsV314Test-1779058192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:31:11 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e3cc3348-a90c-402f-9cf3-e2d0b929b999 tempest-GroupsV314Test-1779058192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:31:11 devstack sudo[98680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:31:11 devstack sudo[98674]: pam_unix(sudo:session): session closed for user root Sep 28 09:31:11 devstack sudo[98680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:31:11 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-8181b863-d405-47e1-be8c-6a40d8344b25 tempest-GroupSnapshotsTest-66536182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6a720db2-8b46-47f7-a2b3-c5500a89a161" returned: 0 in 0.594s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:31:11 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-8181b863-d405-47e1-be8c-6a40d8344b25 tempest-GroupSnapshotsTest-66536182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6a720db2-8b46-47f7-a2b3-c5500a89a161,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6a720db2-8b46-47f7-a2b3-c5500a89a161.dc283f44-bda7-4141-ac95-9d60b17cbedc 1G {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:31:11 devstack sudo[98682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6a720db2-8b46-47f7-a2b3-c5500a89a161,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6a720db2-8b46-47f7-a2b3-c5500a89a161.dc283f44-bda7-4141-ac95-9d60b17cbedc 1G Sep 28 09:31:11 devstack sudo[98682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:31:12 devstack sudo[98680]: pam_unix(sudo:session): session closed for user root Sep 28 09:31:12 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e3cc3348-a90c-402f-9cf3-e2d0b929b999 tempest-GroupsV314Test-1779058192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.392s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:31:12 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-e3cc3348-a90c-402f-9cf3-e2d0b929b999 tempest-GroupsV314Test-1779058192 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:31:12 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-e3cc3348-a90c-402f-9cf3-e2d0b929b999 tempest-GroupsV314Test-1779058192 None] Delete group completed successfully. Sep 28 09:31:12 devstack sudo[98682]: pam_unix(sudo:session): session closed for user root Sep 28 09:31:12 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-8181b863-d405-47e1-be8c-6a40d8344b25 tempest-GroupSnapshotsTest-66536182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6a720db2-8b46-47f7-a2b3-c5500a89a161,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6a720db2-8b46-47f7-a2b3-c5500a89a161.dc283f44-bda7-4141-ac95-9d60b17cbedc 1G" returned: 0 in 0.990s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:31:12 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-8181b863-d405-47e1-be8c-6a40d8344b25 tempest-GroupSnapshotsTest-66536182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a720db2-8b46-47f7-a2b3-c5500a89a161 -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6a720db2-8b46-47f7-a2b3-c5500a89a161.dc283f44-bda7-4141-ac95-9d60b17cbedc {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:31:12 devstack sudo[98713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a720db2-8b46-47f7-a2b3-c5500a89a161 -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6a720db2-8b46-47f7-a2b3-c5500a89a161.dc283f44-bda7-4141-ac95-9d60b17cbedc Sep 28 09:31:12 devstack sudo[98713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:31:13 devstack cinder-volume[86553]: DEBUG dbcounter [-] [86553] Writing DB stats cinder:UPDATE=159,cinder:INSERT=37,cinder:SELECT=141,cinder:DELETE=8 {{(pid=86553) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 09:31:13 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-de2f96fc-2b4d-40ad-8bd6-121afa669138 tempest-GroupsV314Test-1779058192 None] Acquiring lock "cinder-quobyte-bb61222c-b02a-46e7-bf06-3577d86158de" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:31:13 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-de2f96fc-2b4d-40ad-8bd6-121afa669138 tempest-GroupsV314Test-1779058192 None] Lock "cinder-quobyte-bb61222c-b02a-46e7-bf06-3577d86158de" acquired by "delete_volume" :: waited 0.054s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:31:13 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e5c6ec-be5e-49ce-a3d4-65dc05694ced]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:31:13 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-de2f96fc-2b4d-40ad-8bd6-121afa669138 tempest-GroupsV314Test-1779058192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bb61222c-b02a-46e7-bf06-3577d86158de {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:31:13 devstack sudo[98718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bb61222c-b02a-46e7-bf06-3577d86158de Sep 28 09:31:13 devstack sudo[98718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:31:13 devstack sudo[98713]: pam_unix(sudo:session): session closed for user root Sep 28 09:31:13 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-8181b863-d405-47e1-be8c-6a40d8344b25 tempest-GroupSnapshotsTest-66536182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a720db2-8b46-47f7-a2b3-c5500a89a161 -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6a720db2-8b46-47f7-a2b3-c5500a89a161.dc283f44-bda7-4141-ac95-9d60b17cbedc" returned: 0 in 1.099s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:31:13 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-8181b863-d405-47e1-be8c-6a40d8344b25 tempest-GroupSnapshotsTest-66536182 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6a720db2-8b46-47f7-a2b3-c5500a89a161.dc283f44-bda7-4141-ac95-9d60b17cbedc is being set with open permissions: ugo+rw: NotImplementedError Sep 28 09:31:13 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-8181b863-d405-47e1-be8c-6a40d8344b25 tempest-GroupSnapshotsTest-66536182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6a720db2-8b46-47f7-a2b3-c5500a89a161.dc283f44-bda7-4141-ac95-9d60b17cbedc {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:31:13 devstack sudo[98723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6a720db2-8b46-47f7-a2b3-c5500a89a161.dc283f44-bda7-4141-ac95-9d60b17cbedc Sep 28 09:31:13 devstack sudo[98723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:31:14 devstack sudo[98718]: pam_unix(sudo:session): session closed for user root Sep 28 09:31:14 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-de2f96fc-2b4d-40ad-8bd6-121afa669138 tempest-GroupsV314Test-1779058192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bb61222c-b02a-46e7-bf06-3577d86158de" returned: 0 in 0.891s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:31:14 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-de2f96fc-2b4d-40ad-8bd6-121afa669138 tempest-GroupsV314Test-1779058192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bb61222c-b02a-46e7-bf06-3577d86158de {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:31:14 devstack sudo[98729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bb61222c-b02a-46e7-bf06-3577d86158de Sep 28 09:31:14 devstack sudo[98729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:31:14 devstack sudo[98723]: pam_unix(sudo:session): session closed for user root Sep 28 09:31:14 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-8181b863-d405-47e1-be8c-6a40d8344b25 tempest-GroupSnapshotsTest-66536182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6a720db2-8b46-47f7-a2b3-c5500a89a161.dc283f44-bda7-4141-ac95-9d60b17cbedc" returned: 0 in 0.637s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:31:14 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-8181b863-d405-47e1-be8c-6a40d8344b25 tempest-GroupSnapshotsTest-66536182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6a720db2-8b46-47f7-a2b3-c5500a89a161.info {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:31:14 devstack sudo[98732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6a720db2-8b46-47f7-a2b3-c5500a89a161.info Sep 28 09:31:14 devstack sudo[98732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:31:14 devstack sudo[98729]: pam_unix(sudo:session): session closed for user root Sep 28 09:31:14 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-de2f96fc-2b4d-40ad-8bd6-121afa669138 tempest-GroupsV314Test-1779058192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bb61222c-b02a-46e7-bf06-3577d86158de" returned: 0 in 0.695s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:31:14 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-de2f96fc-2b4d-40ad-8bd6-121afa669138 tempest-GroupsV314Test-1779058192 None] Lock "cinder-quobyte-bb61222c-b02a-46e7-bf06-3577d86158de" released by "delete_volume" :: held 1.738s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:31:15 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-de2f96fc-2b4d-40ad-8bd6-121afa669138 tempest-GroupsV314Test-1779058192 None] Created reservations ['e7f0b959-4384-4868-a0f4-8b4d93d1e8d8'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:31:15 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-de2f96fc-2b4d-40ad-8bd6-121afa669138 tempest-GroupsV314Test-1779058192 None] Created reservations ['86c30e2e-0e31-473a-b711-bdd1eb7d2adb', '3d1c6edc-1a9f-4f61-96f1-80ff898287e7', '4ecfa31e-2ae9-462f-a600-5fd0a899903f', '7dcad848-1f66-4b26-95f6-eb6e3f6e1304'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:31:15 devstack sudo[98732]: pam_unix(sudo:session): session closed for user root Sep 28 09:31:15 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-8181b863-d405-47e1-be8c-6a40d8344b25 tempest-GroupSnapshotsTest-66536182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6a720db2-8b46-47f7-a2b3-c5500a89a161.info" returned: 0 in 0.583s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:31:15 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-8181b863-d405-47e1-be8c-6a40d8344b25 tempest-GroupSnapshotsTest-66536182 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6a720db2-8b46-47f7-a2b3-c5500a89a161.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 09:31:15 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-8181b863-d405-47e1-be8c-6a40d8344b25 tempest-GroupSnapshotsTest-66536182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6a720db2-8b46-47f7-a2b3-c5500a89a161.info {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:31:15 devstack sudo[98736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6a720db2-8b46-47f7-a2b3-c5500a89a161.info Sep 28 09:31:15 devstack sudo[98736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:31:15 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-de2f96fc-2b4d-40ad-8bd6-121afa669138 tempest-GroupsV314Test-1779058192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:31:15 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-de2f96fc-2b4d-40ad-8bd6-121afa669138 tempest-GroupsV314Test-1779058192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:31:15 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-de2f96fc-2b4d-40ad-8bd6-121afa669138 tempest-GroupsV314Test-1779058192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:31:15 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-de2f96fc-2b4d-40ad-8bd6-121afa669138 tempest-GroupsV314Test-1779058192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:31:15 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-de2f96fc-2b4d-40ad-8bd6-121afa669138 tempest-GroupsV314Test-1779058192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:31:15 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-de2f96fc-2b4d-40ad-8bd6-121afa669138 tempest-GroupsV314Test-1779058192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:31:15 devstack sudo[98738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:31:15 devstack sudo[98738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:31:15 devstack sudo[98736]: pam_unix(sudo:session): session closed for user root Sep 28 09:31:15 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-8181b863-d405-47e1-be8c-6a40d8344b25 tempest-GroupSnapshotsTest-66536182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6a720db2-8b46-47f7-a2b3-c5500a89a161.info" returned: 0 in 0.351s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:31:15 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-8181b863-d405-47e1-be8c-6a40d8344b25 tempest-GroupSnapshotsTest-66536182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.444s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:31:15 devstack sudo[98738]: pam_unix(sudo:session): session closed for user root Sep 28 09:31:15 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-de2f96fc-2b4d-40ad-8bd6-121afa669138 tempest-GroupsV314Test-1779058192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.390s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:31:15 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-de2f96fc-2b4d-40ad-8bd6-121afa669138 tempest-GroupsV314Test-1779058192 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:31:15 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-de2f96fc-2b4d-40ad-8bd6-121afa669138 tempest-GroupsV314Test-1779058192 None] Delete group completed successfully. Sep 28 09:31:15 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-8181b863-d405-47e1-be8c-6a40d8344b25 tempest-GroupSnapshotsTest-66536182 None] group_snapshot 62b11d46-64b6-47bc-9abe-e568e0261fcc: created successfully Sep 28 09:31:17 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-eee351da-d009-4ed5-a424-c2bf21e14fe5 tempest-GroupSnapshotsTest-66536182 None] group_snapshot 62b11d46-64b6-47bc-9abe-e568e0261fcc: deleting Sep 28 09:31:17 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-eee351da-d009-4ed5-a424-c2bf21e14fe5 tempest-GroupSnapshotsTest-66536182 None] group_snapshot 62b11d46-64b6-47bc-9abe-e568e0261fcc: deleting {{(pid=86553) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 09:31:17 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-eee351da-d009-4ed5-a424-c2bf21e14fe5 tempest-GroupSnapshotsTest-66536182 None] Acquiring lock "cinder-quobyte-6a720db2-8b46-47f7-a2b3-c5500a89a161" by "delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:31:17 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-eee351da-d009-4ed5-a424-c2bf21e14fe5 tempest-GroupSnapshotsTest-66536182 None] Lock "cinder-quobyte-6a720db2-8b46-47f7-a2b3-c5500a89a161" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:31:17 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-eee351da-d009-4ed5-a424-c2bf21e14fe5 tempest-GroupSnapshotsTest-66536182 None] Acquiring lock "cinder-quobyte-dc283f44-bda7-4141-ac95-9d60b17cbedc" by "_delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:31:17 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-eee351da-d009-4ed5-a424-c2bf21e14fe5 tempest-GroupSnapshotsTest-66536182 None] Lock "cinder-quobyte-dc283f44-bda7-4141-ac95-9d60b17cbedc" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:31:17 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-eee351da-d009-4ed5-a424-c2bf21e14fe5 tempest-GroupSnapshotsTest-66536182 None] Deleting offline snapshot dc283f44-bda7-4141-ac95-9d60b17cbedc of volume 6a720db2-8b46-47f7-a2b3-c5500a89a161 {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 09:31:17 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-eee351da-d009-4ed5-a424-c2bf21e14fe5 tempest-GroupSnapshotsTest-66536182 None] snapshot_file for this snap is: volume-6a720db2-8b46-47f7-a2b3-c5500a89a161.dc283f44-bda7-4141-ac95-9d60b17cbedc {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 09:31:17 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc944a6-3db5-44a7-ab67-008b3b8f5bca]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:31:17 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-eee351da-d009-4ed5-a424-c2bf21e14fe5 tempest-GroupSnapshotsTest-66536182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6a720db2-8b46-47f7-a2b3-c5500a89a161.dc283f44-bda7-4141-ac95-9d60b17cbedc {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:31:17 devstack sudo[98807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6a720db2-8b46-47f7-a2b3-c5500a89a161.dc283f44-bda7-4141-ac95-9d60b17cbedc Sep 28 09:31:17 devstack sudo[98807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:31:18 devstack sudo[98807]: pam_unix(sudo:session): session closed for user root Sep 28 09:31:18 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-eee351da-d009-4ed5-a424-c2bf21e14fe5 tempest-GroupSnapshotsTest-66536182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6a720db2-8b46-47f7-a2b3-c5500a89a161.dc283f44-bda7-4141-ac95-9d60b17cbedc" returned: 0 in 0.571s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:31:18 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-eee351da-d009-4ed5-a424-c2bf21e14fe5 tempest-GroupSnapshotsTest-66536182 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a720db2-8b46-47f7-a2b3-c5500a89a161(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86553) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 09:31:18 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[616af970-7040-4c05-9f7c-21c79e04340a]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:31:18 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-eee351da-d009-4ed5-a424-c2bf21e14fe5 tempest-GroupSnapshotsTest-66536182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6a720db2-8b46-47f7-a2b3-c5500a89a161 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:31:18 devstack sudo[98817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6a720db2-8b46-47f7-a2b3-c5500a89a161 Sep 28 09:31:18 devstack sudo[98817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:31:18 devstack sudo[98817]: pam_unix(sudo:session): session closed for user root Sep 28 09:31:18 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-eee351da-d009-4ed5-a424-c2bf21e14fe5 tempest-GroupSnapshotsTest-66536182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6a720db2-8b46-47f7-a2b3-c5500a89a161" returned: 0 in 0.403s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:31:18 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-eee351da-d009-4ed5-a424-c2bf21e14fe5 tempest-GroupSnapshotsTest-66536182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6a720db2-8b46-47f7-a2b3-c5500a89a161.dc283f44-bda7-4141-ac95-9d60b17cbedc {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:31:18 devstack sudo[98823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6a720db2-8b46-47f7-a2b3-c5500a89a161.dc283f44-bda7-4141-ac95-9d60b17cbedc Sep 28 09:31:18 devstack sudo[98823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:31:18 devstack sudo[98823]: pam_unix(sudo:session): session closed for user root Sep 28 09:31:18 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-eee351da-d009-4ed5-a424-c2bf21e14fe5 tempest-GroupSnapshotsTest-66536182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6a720db2-8b46-47f7-a2b3-c5500a89a161.dc283f44-bda7-4141-ac95-9d60b17cbedc" returned: 0 in 0.448s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:31:18 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-eee351da-d009-4ed5-a424-c2bf21e14fe5 tempest-GroupSnapshotsTest-66536182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6a720db2-8b46-47f7-a2b3-c5500a89a161.dc283f44-bda7-4141-ac95-9d60b17cbedc {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:31:18 devstack sudo[98830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6a720db2-8b46-47f7-a2b3-c5500a89a161.dc283f44-bda7-4141-ac95-9d60b17cbedc Sep 28 09:31:18 devstack sudo[98830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:31:19 devstack sudo[98830]: pam_unix(sudo:session): session closed for user root Sep 28 09:31:19 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-eee351da-d009-4ed5-a424-c2bf21e14fe5 tempest-GroupSnapshotsTest-66536182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6a720db2-8b46-47f7-a2b3-c5500a89a161.dc283f44-bda7-4141-ac95-9d60b17cbedc" returned: 0 in 0.350s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:31:19 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-eee351da-d009-4ed5-a424-c2bf21e14fe5 tempest-GroupSnapshotsTest-66536182 None] Lock "cinder-quobyte-dc283f44-bda7-4141-ac95-9d60b17cbedc" released by "_delete_snapshot" :: held 1.973s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:31:19 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-eee351da-d009-4ed5-a424-c2bf21e14fe5 tempest-GroupSnapshotsTest-66536182 None] Lock "cinder-quobyte-6a720db2-8b46-47f7-a2b3-c5500a89a161" released by "delete_snapshot" :: held 2.006s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:31:19 devstack cinder-volume[86553]: WARNING cinder.quota [None req-eee351da-d009-4ed5-a424-c2bf21e14fe5 tempest-GroupSnapshotsTest-66536182 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1565539683 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1565539683, it is now deprecated. Please use the default quota class for default quota. Sep 28 09:31:19 devstack cinder-volume[86553]: WARNING cinder.quota [None req-eee351da-d009-4ed5-a424-c2bf21e14fe5 tempest-GroupSnapshotsTest-66536182 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1565539683 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1565539683, it is now deprecated. Please use the default quota class for default quota. Sep 28 09:31:19 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-eee351da-d009-4ed5-a424-c2bf21e14fe5 tempest-GroupSnapshotsTest-66536182 None] Created reservations ['15c5cd5f-a4b4-43a8-a07d-1f1deb6e332a', '73b09384-6daa-47bb-b295-848fb26af408', 'aaa22e6c-2fd2-4086-91ab-abf50ee748af', '431adf75-a13f-48e5-9c6f-4e3118970a5f'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:31:19 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-eee351da-d009-4ed5-a424-c2bf21e14fe5 tempest-GroupSnapshotsTest-66536182 None] group_snapshot 62b11d46-64b6-47bc-9abe-e568e0261fcc: deleted successfully Sep 28 09:31:20 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-af5f55f4-b1b1-4bb5-9e4c-a7921ccfada9 tempest-GroupSnapshotsTest-66536182 None] Acquiring lock "cinder-quobyte-6a720db2-8b46-47f7-a2b3-c5500a89a161" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:31:20 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-af5f55f4-b1b1-4bb5-9e4c-a7921ccfada9 tempest-GroupSnapshotsTest-66536182 None] Lock "cinder-quobyte-6a720db2-8b46-47f7-a2b3-c5500a89a161" acquired by "delete_volume" :: waited 0.029s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:31:20 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ef55c9-d1e6-4bcf-b707-5ca3d5f48072]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:31:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-af5f55f4-b1b1-4bb5-9e4c-a7921ccfada9 tempest-GroupSnapshotsTest-66536182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6a720db2-8b46-47f7-a2b3-c5500a89a161 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:31:20 devstack sudo[98871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6a720db2-8b46-47f7-a2b3-c5500a89a161 Sep 28 09:31:20 devstack sudo[98871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:31:21 devstack sudo[98871]: pam_unix(sudo:session): session closed for user root Sep 28 09:31:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-af5f55f4-b1b1-4bb5-9e4c-a7921ccfada9 tempest-GroupSnapshotsTest-66536182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6a720db2-8b46-47f7-a2b3-c5500a89a161" returned: 0 in 0.664s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:31:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-af5f55f4-b1b1-4bb5-9e4c-a7921ccfada9 tempest-GroupSnapshotsTest-66536182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6a720db2-8b46-47f7-a2b3-c5500a89a161 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:31:21 devstack sudo[98903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6a720db2-8b46-47f7-a2b3-c5500a89a161 Sep 28 09:31:21 devstack sudo[98903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:31:21 devstack sudo[98903]: pam_unix(sudo:session): session closed for user root Sep 28 09:31:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-af5f55f4-b1b1-4bb5-9e4c-a7921ccfada9 tempest-GroupSnapshotsTest-66536182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6a720db2-8b46-47f7-a2b3-c5500a89a161" returned: 0 in 0.328s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:31:21 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-af5f55f4-b1b1-4bb5-9e4c-a7921ccfada9 tempest-GroupSnapshotsTest-66536182 None] Lock "cinder-quobyte-6a720db2-8b46-47f7-a2b3-c5500a89a161" released by "delete_volume" :: held 1.137s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:31:21 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-af5f55f4-b1b1-4bb5-9e4c-a7921ccfada9 tempest-GroupSnapshotsTest-66536182 None] Created reservations ['919429a0-4662-449a-b47d-8b1786fe03d3'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:31:21 devstack cinder-volume[86553]: WARNING cinder.quota [None req-af5f55f4-b1b1-4bb5-9e4c-a7921ccfada9 tempest-GroupSnapshotsTest-66536182 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1565539683 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1565539683, it is now deprecated. Please use the default quota class for default quota. Sep 28 09:31:21 devstack cinder-volume[86553]: DEBUG oslo_service.periodic_task [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86553) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 09:31:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:31:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:31:21 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:31:21 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:31:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:31:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:31:21 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-af5f55f4-b1b1-4bb5-9e4c-a7921ccfada9 tempest-GroupSnapshotsTest-66536182 None] Created reservations ['de402785-683a-4d26-b192-db685ed62379', 'b8e3264d-ef88-4008-a606-1dd66a04273e', 'f6ad273e-47a2-4bcb-bede-a4ed44d17846', '0e073015-66b6-456d-adbf-cee2919ae15d'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:31:21 devstack sudo[98922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:31:21 devstack sudo[98922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:31:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-af5f55f4-b1b1-4bb5-9e4c-a7921ccfada9 tempest-GroupSnapshotsTest-66536182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:31:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-af5f55f4-b1b1-4bb5-9e4c-a7921ccfada9 tempest-GroupSnapshotsTest-66536182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:31:21 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-af5f55f4-b1b1-4bb5-9e4c-a7921ccfada9 tempest-GroupSnapshotsTest-66536182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:31:21 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-af5f55f4-b1b1-4bb5-9e4c-a7921ccfada9 tempest-GroupSnapshotsTest-66536182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:31:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-af5f55f4-b1b1-4bb5-9e4c-a7921ccfada9 tempest-GroupSnapshotsTest-66536182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:31:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-af5f55f4-b1b1-4bb5-9e4c-a7921ccfada9 tempest-GroupSnapshotsTest-66536182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:31:21 devstack sudo[98924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:31:21 devstack sudo[98924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:31:21 devstack sudo[98922]: pam_unix(sudo:session): session closed for user root Sep 28 09:31:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.388s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:31:21 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:31:21 devstack cinder-volume[86553]: DEBUG oslo_service.periodic_task [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Running periodic task VolumeManager._thread_info {{(pid=86553) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 09:31:21 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] thread count: 28 {{(pid=86553) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 09:31:21 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] thread info: [<_MainThread(MainThread, started 134684877779072)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86553) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 09:31:22 devstack sudo[98924]: pam_unix(sudo:session): session closed for user root Sep 28 09:31:22 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-af5f55f4-b1b1-4bb5-9e4c-a7921ccfada9 tempest-GroupSnapshotsTest-66536182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.298s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:31:22 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-af5f55f4-b1b1-4bb5-9e4c-a7921ccfada9 tempest-GroupSnapshotsTest-66536182 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:31:22 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-af5f55f4-b1b1-4bb5-9e4c-a7921ccfada9 tempest-GroupSnapshotsTest-66536182 None] Delete group completed successfully. Sep 28 09:31:24 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-be1c25cf-9f00-4302-ac9d-5c8b7ef71e91 tempest-VolumesActionsTest-1060422934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:31:24 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-be1c25cf-9f00-4302-ac9d-5c8b7ef71e91 tempest-VolumesActionsTest-1060422934 None] Flow 'volume_create_manager' (7c26cca2-f0bf-4e12-b46b-545b83844b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:31:24 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-be1c25cf-9f00-4302-ac9d-5c8b7ef71e91 tempest-VolumesActionsTest-1060422934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (155a780d-0cd3-4623-bee9-74268300fcc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:31:24 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-be1c25cf-9f00-4302-ac9d-5c8b7ef71e91 tempest-VolumesActionsTest-1060422934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (155a780d-0cd3-4623-bee9-74268300fcc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:31:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-550728961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d5edff0-5d92-4fa4-b8ff-4260617f3c7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f0af7d2451c49e79c57feeb377a6899',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:31:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:31:25Z,use_quota=True,user_id='54200af1bd5d458ea43817ab6b22c3f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:31:24 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-be1c25cf-9f00-4302-ac9d-5c8b7ef71e91 tempest-VolumesActionsTest-1060422934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f33977f-6ceb-47b0-a5ba-a38162a82479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:31:24 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-be1c25cf-9f00-4302-ac9d-5c8b7ef71e91 tempest-VolumesActionsTest-1060422934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f33977f-6ceb-47b0-a5ba-a38162a82479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:31:24 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-be1c25cf-9f00-4302-ac9d-5c8b7ef71e91 tempest-VolumesActionsTest-1060422934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ee6fb16-1c10-4731-b94e-ba3d55f70db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:31:24 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-be1c25cf-9f00-4302-ac9d-5c8b7ef71e91 tempest-VolumesActionsTest-1060422934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ee6fb16-1c10-4731-b94e-ba3d55f70db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d5edff0-5d92-4fa4-b8ff-4260617f3c7a', 'volume_name': 'volume-3d5edff0-5d92-4fa4-b8ff-4260617f3c7a', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:31:24 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-be1c25cf-9f00-4302-ac9d-5c8b7ef71e91 tempest-VolumesActionsTest-1060422934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72109c6f-cc18-45e2-91f4-e528f684dfaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:31:24 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-be1c25cf-9f00-4302-ac9d-5c8b7ef71e91 tempest-VolumesActionsTest-1060422934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72109c6f-cc18-45e2-91f4-e528f684dfaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:31:24 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-be1c25cf-9f00-4302-ac9d-5c8b7ef71e91 tempest-VolumesActionsTest-1060422934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (025ed898-174c-46c9-98d2-c3c0c2071424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:31:24 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-be1c25cf-9f00-4302-ac9d-5c8b7ef71e91 tempest-VolumesActionsTest-1060422934 None] Volume 3d5edff0-5d92-4fa4-b8ff-4260617f3c7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d5edff0-5d92-4fa4-b8ff-4260617f3c7a', 'volume_size': 1} Sep 28 09:31:24 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-be1c25cf-9f00-4302-ac9d-5c8b7ef71e91 tempest-VolumesActionsTest-1060422934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:31:24 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-be1c25cf-9f00-4302-ac9d-5c8b7ef71e91 tempest-VolumesActionsTest-1060422934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:31:24 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-be1c25cf-9f00-4302-ac9d-5c8b7ef71e91 tempest-VolumesActionsTest-1060422934 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:31:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-550728961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d5edff0-5d92-4fa4-b8ff-4260617f3c7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f0af7d2451c49e79c57feeb377a6899',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:31:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:31:25Z,use_quota=True,user_id='54200af1bd5d458ea43817ab6b22c3f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:31:24 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-be1c25cf-9f00-4302-ac9d-5c8b7ef71e91 tempest-VolumesActionsTest-1060422934 None] Creating volume 3d5edff0-5d92-4fa4-b8ff-4260617f3c7a {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:31:24 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-be1c25cf-9f00-4302-ac9d-5c8b7ef71e91 tempest-VolumesActionsTest-1060422934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:31:24 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-be1c25cf-9f00-4302-ac9d-5c8b7ef71e91 tempest-VolumesActionsTest-1060422934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:31:24 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-be1c25cf-9f00-4302-ac9d-5c8b7ef71e91 tempest-VolumesActionsTest-1060422934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:31:24 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-be1c25cf-9f00-4302-ac9d-5c8b7ef71e91 tempest-VolumesActionsTest-1060422934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:31:24 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-be1c25cf-9f00-4302-ac9d-5c8b7ef71e91 tempest-VolumesActionsTest-1060422934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:31:24 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-be1c25cf-9f00-4302-ac9d-5c8b7ef71e91 tempest-VolumesActionsTest-1060422934 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:31:24 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-be1c25cf-9f00-4302-ac9d-5c8b7ef71e91 tempest-VolumesActionsTest-1060422934 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:31:24 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-be1c25cf-9f00-4302-ac9d-5c8b7ef71e91 tempest-VolumesActionsTest-1060422934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3d5edff0-5d92-4fa4-b8ff-4260617f3c7a 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:31:24 devstack sudo[98935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3d5edff0-5d92-4fa4-b8ff-4260617f3c7a 1073741824 Sep 28 09:31:24 devstack sudo[98935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:31:25 devstack sudo[98935]: pam_unix(sudo:session): session closed for user root Sep 28 09:31:25 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-be1c25cf-9f00-4302-ac9d-5c8b7ef71e91 tempest-VolumesActionsTest-1060422934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3d5edff0-5d92-4fa4-b8ff-4260617f3c7a 1073741824" returned: 0 in 0.845s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:31:25 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-be1c25cf-9f00-4302-ac9d-5c8b7ef71e91 tempest-VolumesActionsTest-1060422934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3d5edff0-5d92-4fa4-b8ff-4260617f3c7a {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:31:25 devstack sudo[98941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3d5edff0-5d92-4fa4-b8ff-4260617f3c7a Sep 28 09:31:25 devstack sudo[98941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:31:26 devstack sudo[98941]: pam_unix(sudo:session): session closed for user root Sep 28 09:31:26 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-be1c25cf-9f00-4302-ac9d-5c8b7ef71e91 tempest-VolumesActionsTest-1060422934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3d5edff0-5d92-4fa4-b8ff-4260617f3c7a" returned: 0 in 0.383s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:31:26 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-be1c25cf-9f00-4302-ac9d-5c8b7ef71e91 tempest-VolumesActionsTest-1060422934 None] <== create_volume: return (1333ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:31:26 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-be1c25cf-9f00-4302-ac9d-5c8b7ef71e91 tempest-VolumesActionsTest-1060422934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.338s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:31:26 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-be1c25cf-9f00-4302-ac9d-5c8b7ef71e91 tempest-VolumesActionsTest-1060422934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (025ed898-174c-46c9-98d2-c3c0c2071424) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d5edff0-5d92-4fa4-b8ff-4260617f3c7a', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:31:26 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-be1c25cf-9f00-4302-ac9d-5c8b7ef71e91 tempest-VolumesActionsTest-1060422934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c22db2d5-8339-4f5a-b516-966c8432dd99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:31:26 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-be1c25cf-9f00-4302-ac9d-5c8b7ef71e91 tempest-VolumesActionsTest-1060422934 None] Volume volume-3d5edff0-5d92-4fa4-b8ff-4260617f3c7a (3d5edff0-5d92-4fa4-b8ff-4260617f3c7a): created successfully Sep 28 09:31:26 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-be1c25cf-9f00-4302-ac9d-5c8b7ef71e91 tempest-VolumesActionsTest-1060422934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c22db2d5-8339-4f5a-b516-966c8432dd99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:31:26 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-be1c25cf-9f00-4302-ac9d-5c8b7ef71e91 tempest-VolumesActionsTest-1060422934 None] Flow 'volume_create_manager' (7c26cca2-f0bf-4e12-b46b-545b83844b2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:31:26 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-be1c25cf-9f00-4302-ac9d-5c8b7ef71e91 tempest-VolumesActionsTest-1060422934 None] Created volume successfully. Sep 28 09:31:26 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-773765e2-457b-4669-bdd9-966523c64fb9 tempest-VolumesActionsTest-1060422934 None] Acquiring lock "cinder-3d5edff0-5d92-4fa4-b8ff-4260617f3c7a" by "attach_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:31:27 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-773765e2-457b-4669-bdd9-966523c64fb9 tempest-VolumesActionsTest-1060422934 None] Lock "cinder-3d5edff0-5d92-4fa4-b8ff-4260617f3c7a" acquired by "attach_volume" :: waited 0.027s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:31:27 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-773765e2-457b-4669-bdd9-966523c64fb9 tempest-VolumesActionsTest-1060422934 None] Attaching volume 3d5edff0-5d92-4fa4-b8ff-4260617f3c7a to instance 0eb1194f-84df-4f4b-bdbd-f3fd0a6ba6ad at mountpoint /dev/vdb on host None. Sep 28 09:31:27 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-773765e2-457b-4669-bdd9-966523c64fb9 tempest-VolumesActionsTest-1060422934 None] Attach volume completed successfully. Sep 28 09:31:27 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-773765e2-457b-4669-bdd9-966523c64fb9 tempest-VolumesActionsTest-1060422934 None] Lock "cinder-3d5edff0-5d92-4fa4-b8ff-4260617f3c7a" released by "attach_volume" :: held 0.140s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:31:28 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-33a8f7ea-1ce2-44b4-8967-bbe55c79cad6 tempest-VolumesActionsTest-1301638755 None] Terminate volume connection completed successfully. Sep 28 09:31:28 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-33a8f7ea-1ce2-44b4-8967-bbe55c79cad6 tempest-VolumesActionsTest-1301638755 None] Acquiring lock "cinder-3d5edff0-5d92-4fa4-b8ff-4260617f3c7a-detach_volume" by "detach_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:31:28 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-33a8f7ea-1ce2-44b4-8967-bbe55c79cad6 tempest-VolumesActionsTest-1301638755 None] Lock "cinder-3d5edff0-5d92-4fa4-b8ff-4260617f3c7a-detach_volume" acquired by "detach_volume" :: waited 0.032s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:31:28 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-33a8f7ea-1ce2-44b4-8967-bbe55c79cad6 tempest-VolumesActionsTest-1301638755 None] Detaching volume 3d5edff0-5d92-4fa4-b8ff-4260617f3c7a from instance 0eb1194f-84df-4f4b-bdbd-f3fd0a6ba6ad. Sep 28 09:31:28 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-33a8f7ea-1ce2-44b4-8967-bbe55c79cad6 tempest-VolumesActionsTest-1301638755 None] Detach volume completed successfully. Sep 28 09:31:28 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-33a8f7ea-1ce2-44b4-8967-bbe55c79cad6 tempest-VolumesActionsTest-1301638755 None] Lock "cinder-3d5edff0-5d92-4fa4-b8ff-4260617f3c7a-detach_volume" released by "detach_volume" :: held 0.112s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:31:28 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-72a5c258-cf12-4cfa-8bb0-ccb2775981c4 req-a650da03-0769-4cac-bd7b-6247b3255237 tempest-TestInstancesWithCinderVolumes-768341847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:31:28 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-72a5c258-cf12-4cfa-8bb0-ccb2775981c4 req-a650da03-0769-4cac-bd7b-6247b3255237 tempest-TestInstancesWithCinderVolumes-768341847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:31:28 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-72a5c258-cf12-4cfa-8bb0-ccb2775981c4 req-a650da03-0769-4cac-bd7b-6247b3255237 tempest-TestInstancesWithCinderVolumes-768341847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:31:28 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [req-72a5c258-cf12-4cfa-8bb0-ccb2775981c4 req-a650da03-0769-4cac-bd7b-6247b3255237 tempest-TestInstancesWithCinderVolumes-768341847 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d', 'name': 'volume-44c9ccc6-0417-4565-a45e-21b743ec2993', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c5f82b7f-4bee-4dd8-8c6d-d7bf9fc788a6', 'enforce_multipath': True} {{(pid=86553) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 09:31:28 devstack cinder-volume[86553]: INFO cinder.volume.manager [req-72a5c258-cf12-4cfa-8bb0-ccb2775981c4 req-a650da03-0769-4cac-bd7b-6247b3255237 tempest-TestInstancesWithCinderVolumes-768341847 None] attachment_update completed successfully. Sep 28 09:31:28 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-23e76ec8-8f30-4626-a493-32f9e2db8a3d tempest-VolumesActionsTest-1060422934 None] Acquiring lock "cinder-3d5edff0-5d92-4fa4-b8ff-4260617f3c7a-detach_volume" by "detach_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:31:28 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-23e76ec8-8f30-4626-a493-32f9e2db8a3d tempest-VolumesActionsTest-1060422934 None] Lock "cinder-3d5edff0-5d92-4fa4-b8ff-4260617f3c7a-detach_volume" acquired by "detach_volume" :: waited 0.029s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:31:28 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-23e76ec8-8f30-4626-a493-32f9e2db8a3d tempest-VolumesActionsTest-1060422934 None] Volume detach called, but volume not attached. Sep 28 09:31:28 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-23e76ec8-8f30-4626-a493-32f9e2db8a3d tempest-VolumesActionsTest-1060422934 None] Lock "cinder-3d5edff0-5d92-4fa4-b8ff-4260617f3c7a-detach_volume" released by "detach_volume" :: held 0.041s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:31:29 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-a14f36b6-f43e-418d-af0c-cc7a743a2a2a tempest-VolumesActionsTest-1060422934 None] Acquiring lock "cinder-3d5edff0-5d92-4fa4-b8ff-4260617f3c7a-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:31:29 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-a14f36b6-f43e-418d-af0c-cc7a743a2a2a tempest-VolumesActionsTest-1060422934 None] Lock "cinder-3d5edff0-5d92-4fa4-b8ff-4260617f3c7a-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:31:29 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-a14f36b6-f43e-418d-af0c-cc7a743a2a2a tempest-VolumesActionsTest-1060422934 None] Acquiring lock "cinder-quobyte-3d5edff0-5d92-4fa4-b8ff-4260617f3c7a" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:31:29 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-a14f36b6-f43e-418d-af0c-cc7a743a2a2a tempest-VolumesActionsTest-1060422934 None] Lock "cinder-quobyte-3d5edff0-5d92-4fa4-b8ff-4260617f3c7a" acquired by "delete_volume" :: waited 0.039s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:31:29 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a04a812-4724-41bd-82c1-2b60f68af5ac]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:31:29 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a14f36b6-f43e-418d-af0c-cc7a743a2a2a tempest-VolumesActionsTest-1060422934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3d5edff0-5d92-4fa4-b8ff-4260617f3c7a {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:31:29 devstack sudo[98967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3d5edff0-5d92-4fa4-b8ff-4260617f3c7a Sep 28 09:31:29 devstack sudo[98967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:31:30 devstack sudo[98967]: pam_unix(sudo:session): session closed for user root Sep 28 09:31:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a14f36b6-f43e-418d-af0c-cc7a743a2a2a tempest-VolumesActionsTest-1060422934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3d5edff0-5d92-4fa4-b8ff-4260617f3c7a" returned: 0 in 0.804s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:31:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a14f36b6-f43e-418d-af0c-cc7a743a2a2a tempest-VolumesActionsTest-1060422934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3d5edff0-5d92-4fa4-b8ff-4260617f3c7a {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:31:30 devstack sudo[98975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3d5edff0-5d92-4fa4-b8ff-4260617f3c7a Sep 28 09:31:30 devstack sudo[98975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:31:30 devstack sudo[98975]: pam_unix(sudo:session): session closed for user root Sep 28 09:31:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a14f36b6-f43e-418d-af0c-cc7a743a2a2a tempest-VolumesActionsTest-1060422934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3d5edff0-5d92-4fa4-b8ff-4260617f3c7a" returned: 0 in 0.363s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:31:30 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-a14f36b6-f43e-418d-af0c-cc7a743a2a2a tempest-VolumesActionsTest-1060422934 None] Lock "cinder-quobyte-3d5edff0-5d92-4fa4-b8ff-4260617f3c7a" released by "delete_volume" :: held 1.244s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:31:30 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-a14f36b6-f43e-418d-af0c-cc7a743a2a2a tempest-VolumesActionsTest-1060422934 None] Created reservations ['049f3f71-c2b7-48f9-94f8-60c854923cb5', 'bb8993a0-16d6-47fb-917b-8ca3fe3b638b', 'cb2aca9a-2009-4fd8-8949-5aed56d915e2', '2ba6a714-0dc6-427c-b935-b0bfd9c0557f'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:31:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-a14f36b6-f43e-418d-af0c-cc7a743a2a2a tempest-VolumesActionsTest-1060422934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:31:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-a14f36b6-f43e-418d-af0c-cc7a743a2a2a tempest-VolumesActionsTest-1060422934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:31:30 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-a14f36b6-f43e-418d-af0c-cc7a743a2a2a tempest-VolumesActionsTest-1060422934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:31:30 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-a14f36b6-f43e-418d-af0c-cc7a743a2a2a tempest-VolumesActionsTest-1060422934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:31:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-a14f36b6-f43e-418d-af0c-cc7a743a2a2a tempest-VolumesActionsTest-1060422934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:31:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a14f36b6-f43e-418d-af0c-cc7a743a2a2a tempest-VolumesActionsTest-1060422934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:31:30 devstack sudo[98988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:31:30 devstack sudo[98988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:31:31 devstack sudo[98988]: pam_unix(sudo:session): session closed for user root Sep 28 09:31:31 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a14f36b6-f43e-418d-af0c-cc7a743a2a2a tempest-VolumesActionsTest-1060422934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.464s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:31:31 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-a14f36b6-f43e-418d-af0c-cc7a743a2a2a tempest-VolumesActionsTest-1060422934 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:31:31 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-a14f36b6-f43e-418d-af0c-cc7a743a2a2a tempest-VolumesActionsTest-1060422934 None] Deleted volume successfully. Sep 28 09:31:31 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-a14f36b6-f43e-418d-af0c-cc7a743a2a2a tempest-VolumesActionsTest-1060422934 None] Lock "cinder-3d5edff0-5d92-4fa4-b8ff-4260617f3c7a-delete_volume" released by "delete_volume" :: held 2.106s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:31:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-7227bc84-2f31-48aa-b7ad-24653873e490 req-2d736d93-6785-4c66-a96a-5641fc53afb6 tempest-TestInstancesWithCinderVolumes-768341847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:31:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-7227bc84-2f31-48aa-b7ad-24653873e490 req-2d736d93-6785-4c66-a96a-5641fc53afb6 tempest-TestInstancesWithCinderVolumes-768341847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:31:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-7227bc84-2f31-48aa-b7ad-24653873e490 req-2d736d93-6785-4c66-a96a-5641fc53afb6 tempest-TestInstancesWithCinderVolumes-768341847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:31:32 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [req-7227bc84-2f31-48aa-b7ad-24653873e490 req-2d736d93-6785-4c66-a96a-5641fc53afb6 tempest-TestInstancesWithCinderVolumes-768341847 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d', 'name': 'volume-5b769227-250e-4375-881f-be870680efeb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ce19a364-489e-4d98-b91d-3b44ec3b7a1f', 'enforce_multipath': True} {{(pid=86553) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 09:31:32 devstack cinder-volume[86553]: INFO cinder.volume.manager [req-7227bc84-2f31-48aa-b7ad-24653873e490 req-2d736d93-6785-4c66-a96a-5641fc53afb6 tempest-TestInstancesWithCinderVolumes-768341847 None] attachment_update completed successfully. Sep 28 09:31:34 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-2f912175-39bf-468c-b139-09a0ade2fe69 tempest-GroupSnapshotsV319Test-61944231 None] Group tempest-GroupSnapshotsV319Test-Group-882482927: creating Sep 28 09:31:34 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-2f912175-39bf-468c-b139-09a0ade2fe69 tempest-GroupSnapshotsV319Test-61944231 None] Group tempest-GroupSnapshotsV319Test-Group-882482927: created successfully Sep 28 09:31:34 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-2f912175-39bf-468c-b139-09a0ade2fe69 tempest-GroupSnapshotsV319Test-61944231 None] Create group completed successfully. Sep 28 09:31:36 devstack cinder-volume[86553]: DEBUG dbcounter [-] [86553] Writing DB stats cinder:SELECT=133,cinder:UPDATE=111,cinder:INSERT=31,cinder:DELETE=2 {{(pid=86553) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 09:31:36 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-27631879-abe1-4d8b-9b16-961b9e4dd895 tempest-VolumesActionsTest-1060422934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:31:36 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-27631879-abe1-4d8b-9b16-961b9e4dd895 tempest-VolumesActionsTest-1060422934 None] Flow 'volume_create_manager' (57bd770a-3422-410f-a1b7-e856b19adce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:31:36 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-27631879-abe1-4d8b-9b16-961b9e4dd895 tempest-VolumesActionsTest-1060422934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dd8b3ed-84f7-486f-ba65-649497745a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:31:36 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-27631879-abe1-4d8b-9b16-961b9e4dd895 tempest-VolumesActionsTest-1060422934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dd8b3ed-84f7-486f-ba65-649497745a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:31:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-613426410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02d170a4-ffea-455d-9baa-944cdd1c75ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f0af7d2451c49e79c57feeb377a6899',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:31:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:31:36Z,use_quota=True,user_id='54200af1bd5d458ea43817ab6b22c3f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:31:36 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-27631879-abe1-4d8b-9b16-961b9e4dd895 tempest-VolumesActionsTest-1060422934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94684332-e08f-461d-945d-c2a4a581397e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:31:36 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-27631879-abe1-4d8b-9b16-961b9e4dd895 tempest-VolumesActionsTest-1060422934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94684332-e08f-461d-945d-c2a4a581397e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:31:36 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-27631879-abe1-4d8b-9b16-961b9e4dd895 tempest-VolumesActionsTest-1060422934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1f7c3be-7f1c-4286-896d-fb895c527989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:31:36 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-27631879-abe1-4d8b-9b16-961b9e4dd895 tempest-VolumesActionsTest-1060422934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1f7c3be-7f1c-4286-896d-fb895c527989) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02d170a4-ffea-455d-9baa-944cdd1c75ed', 'volume_name': 'volume-02d170a4-ffea-455d-9baa-944cdd1c75ed', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:31:36 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-27631879-abe1-4d8b-9b16-961b9e4dd895 tempest-VolumesActionsTest-1060422934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ac2e0a7-f930-4777-857e-0695a12393b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:31:36 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-27631879-abe1-4d8b-9b16-961b9e4dd895 tempest-VolumesActionsTest-1060422934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ac2e0a7-f930-4777-857e-0695a12393b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:31:36 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-27631879-abe1-4d8b-9b16-961b9e4dd895 tempest-VolumesActionsTest-1060422934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81a16d5e-bc5e-467a-bb01-ec2399b44ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:31:36 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-27631879-abe1-4d8b-9b16-961b9e4dd895 tempest-VolumesActionsTest-1060422934 None] Volume 02d170a4-ffea-455d-9baa-944cdd1c75ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02d170a4-ffea-455d-9baa-944cdd1c75ed', 'volume_size': 1} Sep 28 09:31:36 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-27631879-abe1-4d8b-9b16-961b9e4dd895 tempest-VolumesActionsTest-1060422934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:31:36 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-27631879-abe1-4d8b-9b16-961b9e4dd895 tempest-VolumesActionsTest-1060422934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:31:36 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-27631879-abe1-4d8b-9b16-961b9e4dd895 tempest-VolumesActionsTest-1060422934 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:31:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-613426410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02d170a4-ffea-455d-9baa-944cdd1c75ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f0af7d2451c49e79c57feeb377a6899',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:31:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:31:36Z,use_quota=True,user_id='54200af1bd5d458ea43817ab6b22c3f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:31:36 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-27631879-abe1-4d8b-9b16-961b9e4dd895 tempest-VolumesActionsTest-1060422934 None] Creating volume 02d170a4-ffea-455d-9baa-944cdd1c75ed {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:31:36 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-27631879-abe1-4d8b-9b16-961b9e4dd895 tempest-VolumesActionsTest-1060422934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:31:36 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-27631879-abe1-4d8b-9b16-961b9e4dd895 tempest-VolumesActionsTest-1060422934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:31:36 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-27631879-abe1-4d8b-9b16-961b9e4dd895 tempest-VolumesActionsTest-1060422934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:31:36 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-27631879-abe1-4d8b-9b16-961b9e4dd895 tempest-VolumesActionsTest-1060422934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:31:36 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-27631879-abe1-4d8b-9b16-961b9e4dd895 tempest-VolumesActionsTest-1060422934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:31:36 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-27631879-abe1-4d8b-9b16-961b9e4dd895 tempest-VolumesActionsTest-1060422934 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:31:36 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-27631879-abe1-4d8b-9b16-961b9e4dd895 tempest-VolumesActionsTest-1060422934 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:31:36 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-27631879-abe1-4d8b-9b16-961b9e4dd895 tempest-VolumesActionsTest-1060422934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-02d170a4-ffea-455d-9baa-944cdd1c75ed 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:31:36 devstack sudo[99043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-02d170a4-ffea-455d-9baa-944cdd1c75ed 1073741824 Sep 28 09:31:36 devstack sudo[99043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:31:36 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a3a181a-1e4e-408c-95fe-cba1f6358f08 tempest-GroupSnapshotsV319Test-61944231 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:31:36 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0a3a181a-1e4e-408c-95fe-cba1f6358f08 tempest-GroupSnapshotsV319Test-61944231 None] Flow 'volume_create_manager' (879a1eee-d002-4eb7-91ec-8c2c8e232766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:31:36 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0a3a181a-1e4e-408c-95fe-cba1f6358f08 tempest-GroupSnapshotsV319Test-61944231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (227396d5-876b-473e-afcd-04734bf8d259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:31:36 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0a3a181a-1e4e-408c-95fe-cba1f6358f08 tempest-GroupSnapshotsV319Test-61944231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (227396d5-876b-473e-afcd-04734bf8d259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:31:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-922177503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1eaa60a0-4bec-41c5-b08e-be97ebfbc353,host='devstack@QuobyteHD#QuobyteHD',id=16f5b7f1-9624-4ac7-bfac-527c1ffef04c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e90b0bc780c447cfadb381bd20c7c3e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:31:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:31:36Z,use_quota=True,user_id='087cdea04bd7424795ad6537b023f450',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052a8efc-a879-4715-8942-531947ba7d8f),volume_type_id=052a8efc-a879-4715-8942-531947ba7d8f)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:31:36 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0a3a181a-1e4e-408c-95fe-cba1f6358f08 tempest-GroupSnapshotsV319Test-61944231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f84c1757-10cb-43f5-bdbd-dd04efdfc746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:31:36 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0a3a181a-1e4e-408c-95fe-cba1f6358f08 tempest-GroupSnapshotsV319Test-61944231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f84c1757-10cb-43f5-bdbd-dd04efdfc746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:31:36 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0a3a181a-1e4e-408c-95fe-cba1f6358f08 tempest-GroupSnapshotsV319Test-61944231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d13b9964-47ba-454c-9801-ca06d53cb14b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:31:36 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0a3a181a-1e4e-408c-95fe-cba1f6358f08 tempest-GroupSnapshotsV319Test-61944231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d13b9964-47ba-454c-9801-ca06d53cb14b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16f5b7f1-9624-4ac7-bfac-527c1ffef04c', 'volume_name': 'volume-16f5b7f1-9624-4ac7-bfac-527c1ffef04c', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:31:36 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0a3a181a-1e4e-408c-95fe-cba1f6358f08 tempest-GroupSnapshotsV319Test-61944231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae19c8d2-0901-4187-871c-f23621202787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:31:36 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0a3a181a-1e4e-408c-95fe-cba1f6358f08 tempest-GroupSnapshotsV319Test-61944231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae19c8d2-0901-4187-871c-f23621202787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:31:36 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0a3a181a-1e4e-408c-95fe-cba1f6358f08 tempest-GroupSnapshotsV319Test-61944231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8e27b5b-e652-4d04-8629-8bcc33e5c835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:31:36 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-0a3a181a-1e4e-408c-95fe-cba1f6358f08 tempest-GroupSnapshotsV319Test-61944231 None] Volume 16f5b7f1-9624-4ac7-bfac-527c1ffef04c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16f5b7f1-9624-4ac7-bfac-527c1ffef04c', 'volume_size': 1} Sep 28 09:31:36 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-0a3a181a-1e4e-408c-95fe-cba1f6358f08 tempest-GroupSnapshotsV319Test-61944231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:31:36 devstack sudo[99043]: pam_unix(sudo:session): session closed for user root Sep 28 09:31:36 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-27631879-abe1-4d8b-9b16-961b9e4dd895 tempest-VolumesActionsTest-1060422934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-02d170a4-ffea-455d-9baa-944cdd1c75ed 1073741824" returned: 0 in 0.573s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:31:36 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-27631879-abe1-4d8b-9b16-961b9e4dd895 tempest-VolumesActionsTest-1060422934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-02d170a4-ffea-455d-9baa-944cdd1c75ed {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:31:36 devstack sudo[99049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-02d170a4-ffea-455d-9baa-944cdd1c75ed Sep 28 09:31:36 devstack sudo[99049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:31:37 devstack sudo[99049]: pam_unix(sudo:session): session closed for user root Sep 28 09:31:37 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-27631879-abe1-4d8b-9b16-961b9e4dd895 tempest-VolumesActionsTest-1060422934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-02d170a4-ffea-455d-9baa-944cdd1c75ed" returned: 0 in 0.302s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:31:37 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-27631879-abe1-4d8b-9b16-961b9e4dd895 tempest-VolumesActionsTest-1060422934 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:31:37 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-27631879-abe1-4d8b-9b16-961b9e4dd895 tempest-VolumesActionsTest-1060422934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:31:37 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-0a3a181a-1e4e-408c-95fe-cba1f6358f08 tempest-GroupSnapshotsV319Test-61944231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.812s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:31:37 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-0a3a181a-1e4e-408c-95fe-cba1f6358f08 tempest-GroupSnapshotsV319Test-61944231 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1eaa60a0-4bec-41c5-b08e-be97ebfbc353,created_at=2026-09-28T07:31:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-922177503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1eaa60a0-4bec-41c5-b08e-be97ebfbc353,host='devstack@QuobyteHD#QuobyteHD',id=16f5b7f1-9624-4ac7-bfac-527c1ffef04c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e90b0bc780c447cfadb381bd20c7c3e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:31:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:31:36Z,use_quota=True,user_id='087cdea04bd7424795ad6537b023f450',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052a8efc-a879-4715-8942-531947ba7d8f),volume_type_id=052a8efc-a879-4715-8942-531947ba7d8f)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:31:37 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-0a3a181a-1e4e-408c-95fe-cba1f6358f08 tempest-GroupSnapshotsV319Test-61944231 None] Creating volume 16f5b7f1-9624-4ac7-bfac-527c1ffef04c {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:31:37 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-0a3a181a-1e4e-408c-95fe-cba1f6358f08 tempest-GroupSnapshotsV319Test-61944231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:31:37 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-0a3a181a-1e4e-408c-95fe-cba1f6358f08 tempest-GroupSnapshotsV319Test-61944231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:31:37 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-0a3a181a-1e4e-408c-95fe-cba1f6358f08 tempest-GroupSnapshotsV319Test-61944231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:31:37 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-0a3a181a-1e4e-408c-95fe-cba1f6358f08 tempest-GroupSnapshotsV319Test-61944231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:31:37 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-0a3a181a-1e4e-408c-95fe-cba1f6358f08 tempest-GroupSnapshotsV319Test-61944231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:31:37 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-0a3a181a-1e4e-408c-95fe-cba1f6358f08 tempest-GroupSnapshotsV319Test-61944231 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:31:37 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-0a3a181a-1e4e-408c-95fe-cba1f6358f08 tempest-GroupSnapshotsV319Test-61944231 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:31:37 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0a3a181a-1e4e-408c-95fe-cba1f6358f08 tempest-GroupSnapshotsV319Test-61944231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-16f5b7f1-9624-4ac7-bfac-527c1ffef04c 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:31:37 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-27631879-abe1-4d8b-9b16-961b9e4dd895 tempest-VolumesActionsTest-1060422934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81a16d5e-bc5e-467a-bb01-ec2399b44ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02d170a4-ffea-455d-9baa-944cdd1c75ed', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:31:37 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-27631879-abe1-4d8b-9b16-961b9e4dd895 tempest-VolumesActionsTest-1060422934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29aae615-d9a2-43ef-8460-661ad2402ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:31:37 devstack sudo[99056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-16f5b7f1-9624-4ac7-bfac-527c1ffef04c 1073741824 Sep 28 09:31:37 devstack sudo[99056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:31:37 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-27631879-abe1-4d8b-9b16-961b9e4dd895 tempest-VolumesActionsTest-1060422934 None] Volume volume-02d170a4-ffea-455d-9baa-944cdd1c75ed (02d170a4-ffea-455d-9baa-944cdd1c75ed): created successfully Sep 28 09:31:37 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-27631879-abe1-4d8b-9b16-961b9e4dd895 tempest-VolumesActionsTest-1060422934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29aae615-d9a2-43ef-8460-661ad2402ef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:31:37 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-27631879-abe1-4d8b-9b16-961b9e4dd895 tempest-VolumesActionsTest-1060422934 None] Flow 'volume_create_manager' (57bd770a-3422-410f-a1b7-e856b19adce6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:31:37 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-27631879-abe1-4d8b-9b16-961b9e4dd895 tempest-VolumesActionsTest-1060422934 None] Created volume successfully. Sep 28 09:31:37 devstack sudo[99056]: pam_unix(sudo:session): session closed for user root Sep 28 09:31:37 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0a3a181a-1e4e-408c-95fe-cba1f6358f08 tempest-GroupSnapshotsV319Test-61944231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-16f5b7f1-9624-4ac7-bfac-527c1ffef04c 1073741824" returned: 0 in 0.546s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:31:37 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0a3a181a-1e4e-408c-95fe-cba1f6358f08 tempest-GroupSnapshotsV319Test-61944231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-16f5b7f1-9624-4ac7-bfac-527c1ffef04c {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:31:37 devstack sudo[99070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-16f5b7f1-9624-4ac7-bfac-527c1ffef04c Sep 28 09:31:37 devstack sudo[99070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:31:38 devstack sudo[99070]: pam_unix(sudo:session): session closed for user root Sep 28 09:31:38 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0a3a181a-1e4e-408c-95fe-cba1f6358f08 tempest-GroupSnapshotsV319Test-61944231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-16f5b7f1-9624-4ac7-bfac-527c1ffef04c" returned: 0 in 0.261s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:31:38 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-0a3a181a-1e4e-408c-95fe-cba1f6358f08 tempest-GroupSnapshotsV319Test-61944231 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:31:38 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-0a3a181a-1e4e-408c-95fe-cba1f6358f08 tempest-GroupSnapshotsV319Test-61944231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:31:38 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0a3a181a-1e4e-408c-95fe-cba1f6358f08 tempest-GroupSnapshotsV319Test-61944231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8e27b5b-e652-4d04-8629-8bcc33e5c835) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16f5b7f1-9624-4ac7-bfac-527c1ffef04c', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:31:38 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0a3a181a-1e4e-408c-95fe-cba1f6358f08 tempest-GroupSnapshotsV319Test-61944231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (354e8168-28da-4c75-bdd5-4698ddc87a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:31:38 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-0a3a181a-1e4e-408c-95fe-cba1f6358f08 tempest-GroupSnapshotsV319Test-61944231 None] Volume volume-16f5b7f1-9624-4ac7-bfac-527c1ffef04c (16f5b7f1-9624-4ac7-bfac-527c1ffef04c): created successfully Sep 28 09:31:38 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0a3a181a-1e4e-408c-95fe-cba1f6358f08 tempest-GroupSnapshotsV319Test-61944231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (354e8168-28da-4c75-bdd5-4698ddc87a80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:31:38 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0a3a181a-1e4e-408c-95fe-cba1f6358f08 tempest-GroupSnapshotsV319Test-61944231 None] Flow 'volume_create_manager' (879a1eee-d002-4eb7-91ec-8c2c8e232766) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:31:38 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-0a3a181a-1e4e-408c-95fe-cba1f6358f08 tempest-GroupSnapshotsV319Test-61944231 None] Created volume successfully. Sep 28 09:31:38 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-c8bf3edd-13e1-42f1-97ce-b6b5e810c0e0 tempest-VolumesActionsTest-1301638755 None] Acquiring lock "cinder-02d170a4-ffea-455d-9baa-944cdd1c75ed-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:31:38 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-c8bf3edd-13e1-42f1-97ce-b6b5e810c0e0 tempest-VolumesActionsTest-1301638755 None] Lock "cinder-02d170a4-ffea-455d-9baa-944cdd1c75ed-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:31:38 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-c8bf3edd-13e1-42f1-97ce-b6b5e810c0e0 tempest-VolumesActionsTest-1301638755 None] Acquiring lock "cinder-quobyte-02d170a4-ffea-455d-9baa-944cdd1c75ed" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:31:38 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-c8bf3edd-13e1-42f1-97ce-b6b5e810c0e0 tempest-VolumesActionsTest-1301638755 None] Lock "cinder-quobyte-02d170a4-ffea-455d-9baa-944cdd1c75ed" acquired by "delete_volume" :: waited 0.024s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:31:38 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[166710ee-07ba-4d49-ba9b-0372dac4f3fb]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:31:38 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c8bf3edd-13e1-42f1-97ce-b6b5e810c0e0 tempest-VolumesActionsTest-1301638755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-02d170a4-ffea-455d-9baa-944cdd1c75ed {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:31:38 devstack sudo[99083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-02d170a4-ffea-455d-9baa-944cdd1c75ed Sep 28 09:31:38 devstack sudo[99083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:31:38 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-ad4a11ad-2d64-40e4-bbca-14708a7f8e57 tempest-GroupSnapshotsV319Test-61944231 None] GroupSnapshot 41917112-03cf-42ae-8970-ae95f455236c: creating. Sep 28 09:31:38 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ad4a11ad-2d64-40e4-bbca-14708a7f8e57 tempest-GroupSnapshotsV319Test-61944231 None] Group snapshot 41917112-03cf-42ae-8970-ae95f455236c: creating. {{(pid=86553) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 09:31:38 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ad4a11ad-2d64-40e4-bbca-14708a7f8e57 tempest-GroupSnapshotsV319Test-61944231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:31:38 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ad4a11ad-2d64-40e4-bbca-14708a7f8e57 tempest-GroupSnapshotsV319Test-61944231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:31:38 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-ad4a11ad-2d64-40e4-bbca-14708a7f8e57 tempest-GroupSnapshotsV319Test-61944231 None] Creating offline snapshot c93eb3e7-5eeb-46cc-9c44-7965faadd1ae of volume 16f5b7f1-9624-4ac7-bfac-527c1ffef04c {{(pid=86553) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 09:31:38 devstack sudo[99083]: pam_unix(sudo:session): session closed for user root Sep 28 09:31:38 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c8bf3edd-13e1-42f1-97ce-b6b5e810c0e0 tempest-VolumesActionsTest-1301638755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-02d170a4-ffea-455d-9baa-944cdd1c75ed" returned: 0 in 0.444s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:31:38 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c8bf3edd-13e1-42f1-97ce-b6b5e810c0e0 tempest-VolumesActionsTest-1301638755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-02d170a4-ffea-455d-9baa-944cdd1c75ed {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:31:38 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[3210729c-b984-4271-8be2-bcb3eb304cdd]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:31:38 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ad4a11ad-2d64-40e4-bbca-14708a7f8e57 tempest-GroupSnapshotsV319Test-61944231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-16f5b7f1-9624-4ac7-bfac-527c1ffef04c {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:31:38 devstack sudo[99089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-02d170a4-ffea-455d-9baa-944cdd1c75ed Sep 28 09:31:38 devstack sudo[99089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:31:39 devstack sudo[99090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-16f5b7f1-9624-4ac7-bfac-527c1ffef04c Sep 28 09:31:39 devstack sudo[99090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:31:39 devstack sudo[99089]: pam_unix(sudo:session): session closed for user root Sep 28 09:31:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c8bf3edd-13e1-42f1-97ce-b6b5e810c0e0 tempest-VolumesActionsTest-1301638755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-02d170a4-ffea-455d-9baa-944cdd1c75ed" returned: 0 in 0.335s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:31:39 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-c8bf3edd-13e1-42f1-97ce-b6b5e810c0e0 tempest-VolumesActionsTest-1301638755 None] Lock "cinder-quobyte-02d170a4-ffea-455d-9baa-944cdd1c75ed" released by "delete_volume" :: held 0.860s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:31:39 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-c8bf3edd-13e1-42f1-97ce-b6b5e810c0e0 tempest-VolumesActionsTest-1301638755 None] Created reservations ['aa61f634-5586-42ef-b76e-28ecb5b71f5b', 'd0610f98-73dc-44d8-b7ef-ab56cd979d8c', '6724d123-1975-4225-8b70-2aab765818a5', 'f5918b53-3528-4b55-9495-ff7fa41126ea'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:31:39 devstack sudo[99090]: pam_unix(sudo:session): session closed for user root Sep 28 09:31:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ad4a11ad-2d64-40e4-bbca-14708a7f8e57 tempest-GroupSnapshotsV319Test-61944231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-16f5b7f1-9624-4ac7-bfac-527c1ffef04c" returned: 0 in 0.483s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:31:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ad4a11ad-2d64-40e4-bbca-14708a7f8e57 tempest-GroupSnapshotsV319Test-61944231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-16f5b7f1-9624-4ac7-bfac-527c1ffef04c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-16f5b7f1-9624-4ac7-bfac-527c1ffef04c.c93eb3e7-5eeb-46cc-9c44-7965faadd1ae 1G {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:31:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-c8bf3edd-13e1-42f1-97ce-b6b5e810c0e0 tempest-VolumesActionsTest-1301638755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:31:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-c8bf3edd-13e1-42f1-97ce-b6b5e810c0e0 tempest-VolumesActionsTest-1301638755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:31:39 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-c8bf3edd-13e1-42f1-97ce-b6b5e810c0e0 tempest-VolumesActionsTest-1301638755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:31:39 devstack sudo[99103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-16f5b7f1-9624-4ac7-bfac-527c1ffef04c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-16f5b7f1-9624-4ac7-bfac-527c1ffef04c.c93eb3e7-5eeb-46cc-9c44-7965faadd1ae 1G Sep 28 09:31:39 devstack sudo[99103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:31:39 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-c8bf3edd-13e1-42f1-97ce-b6b5e810c0e0 tempest-VolumesActionsTest-1301638755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:31:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-c8bf3edd-13e1-42f1-97ce-b6b5e810c0e0 tempest-VolumesActionsTest-1301638755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:31:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c8bf3edd-13e1-42f1-97ce-b6b5e810c0e0 tempest-VolumesActionsTest-1301638755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:31:39 devstack cinder-volume[86553]: INFO cinder.volume.manager [req-f7504e7c-fce3-48f6-b8fb-34153232a93f req-253ff12b-53b1-49e0-b494-245f7876edc0 tempest-TestInstancesWithCinderVolumes-768341847 None] Terminate volume connection completed successfully. Sep 28 09:31:39 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [req-f7504e7c-fce3-48f6-b8fb-34153232a93f req-253ff12b-53b1-49e0-b494-245f7876edc0 tempest-TestInstancesWithCinderVolumes-768341847 None] Deleting attachment c5f82b7f-4bee-4dd8-8c6d-d7bf9fc788a6. {{(pid=86553) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 09:31:39 devstack sudo[99105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:31:39 devstack sudo[99105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:31:39 devstack sudo[99105]: pam_unix(sudo:session): session closed for user root Sep 28 09:31:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c8bf3edd-13e1-42f1-97ce-b6b5e810c0e0 tempest-VolumesActionsTest-1301638755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.372s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:31:39 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-c8bf3edd-13e1-42f1-97ce-b6b5e810c0e0 tempest-VolumesActionsTest-1301638755 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:31:39 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-c8bf3edd-13e1-42f1-97ce-b6b5e810c0e0 tempest-VolumesActionsTest-1301638755 None] Deleted volume successfully. Sep 28 09:31:39 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-c8bf3edd-13e1-42f1-97ce-b6b5e810c0e0 tempest-VolumesActionsTest-1301638755 None] Lock "cinder-02d170a4-ffea-455d-9baa-944cdd1c75ed-delete_volume" released by "delete_volume" :: held 1.579s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:31:40 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-d73327d4-0952-4086-b6b5-f76da7bc7e5a tempest-TestInstancesWithCinderVolumes-768341847 None] Acquiring lock "cinder-44c9ccc6-0417-4565-a45e-21b743ec2993-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:31:40 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-d73327d4-0952-4086-b6b5-f76da7bc7e5a tempest-TestInstancesWithCinderVolumes-768341847 None] Lock "cinder-44c9ccc6-0417-4565-a45e-21b743ec2993-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:31:40 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-d73327d4-0952-4086-b6b5-f76da7bc7e5a tempest-TestInstancesWithCinderVolumes-768341847 None] Acquiring lock "cinder-quobyte-44c9ccc6-0417-4565-a45e-21b743ec2993" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:31:40 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-d73327d4-0952-4086-b6b5-f76da7bc7e5a tempest-TestInstancesWithCinderVolumes-768341847 None] Lock "cinder-quobyte-44c9ccc6-0417-4565-a45e-21b743ec2993" acquired by "delete_volume" :: waited 0.023s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:31:40 devstack sudo[99103]: pam_unix(sudo:session): session closed for user root Sep 28 09:31:40 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ad4a11ad-2d64-40e4-bbca-14708a7f8e57 tempest-GroupSnapshotsV319Test-61944231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-16f5b7f1-9624-4ac7-bfac-527c1ffef04c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-16f5b7f1-9624-4ac7-bfac-527c1ffef04c.c93eb3e7-5eeb-46cc-9c44-7965faadd1ae 1G" returned: 0 in 0.736s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:31:40 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ad4a11ad-2d64-40e4-bbca-14708a7f8e57 tempest-GroupSnapshotsV319Test-61944231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16f5b7f1-9624-4ac7-bfac-527c1ffef04c -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-16f5b7f1-9624-4ac7-bfac-527c1ffef04c.c93eb3e7-5eeb-46cc-9c44-7965faadd1ae {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:31:40 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[8278ff2a-003c-4747-b2e2-7109fd3048e6]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:31:40 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-d73327d4-0952-4086-b6b5-f76da7bc7e5a tempest-TestInstancesWithCinderVolumes-768341847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-44c9ccc6-0417-4565-a45e-21b743ec2993 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:31:40 devstack sudo[99121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16f5b7f1-9624-4ac7-bfac-527c1ffef04c -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-16f5b7f1-9624-4ac7-bfac-527c1ffef04c.c93eb3e7-5eeb-46cc-9c44-7965faadd1ae Sep 28 09:31:40 devstack sudo[99121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:31:40 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ed63744-50dc-4aeb-9179-29c1703354b4 tempest-VolumesActionsTest-1060422934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:31:40 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-2ed63744-50dc-4aeb-9179-29c1703354b4 tempest-VolumesActionsTest-1060422934 None] Flow 'volume_create_manager' (1b64758c-7e7a-4dba-b4e1-752981a8d634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:31:40 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-2ed63744-50dc-4aeb-9179-29c1703354b4 tempest-VolumesActionsTest-1060422934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ca6f691-eed1-481c-a060-da65d3d81e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:31:40 devstack sudo[99122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-44c9ccc6-0417-4565-a45e-21b743ec2993 Sep 28 09:31:40 devstack sudo[99122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:31:40 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-2ed63744-50dc-4aeb-9179-29c1703354b4 tempest-VolumesActionsTest-1060422934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ca6f691-eed1-481c-a060-da65d3d81e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:31:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-976602042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24631145-b015-4dd4-ba85-f4dcf3c96fb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f0af7d2451c49e79c57feeb377a6899',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:31:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:31:40Z,use_quota=True,user_id='54200af1bd5d458ea43817ab6b22c3f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:31:40 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-2ed63744-50dc-4aeb-9179-29c1703354b4 tempest-VolumesActionsTest-1060422934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc9cc5b4-2b99-489a-91cf-6c5ddf3bc398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:31:40 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-2ed63744-50dc-4aeb-9179-29c1703354b4 tempest-VolumesActionsTest-1060422934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc9cc5b4-2b99-489a-91cf-6c5ddf3bc398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:31:40 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-2ed63744-50dc-4aeb-9179-29c1703354b4 tempest-VolumesActionsTest-1060422934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aef56d27-f097-4db8-801e-68d961f62391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:31:40 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-2ed63744-50dc-4aeb-9179-29c1703354b4 tempest-VolumesActionsTest-1060422934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aef56d27-f097-4db8-801e-68d961f62391) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24631145-b015-4dd4-ba85-f4dcf3c96fb4', 'volume_name': 'volume-24631145-b015-4dd4-ba85-f4dcf3c96fb4', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:31:40 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-2ed63744-50dc-4aeb-9179-29c1703354b4 tempest-VolumesActionsTest-1060422934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4ec2941-510d-42e6-b0ac-bf68079076ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:31:40 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-2ed63744-50dc-4aeb-9179-29c1703354b4 tempest-VolumesActionsTest-1060422934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4ec2941-510d-42e6-b0ac-bf68079076ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:31:40 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-2ed63744-50dc-4aeb-9179-29c1703354b4 tempest-VolumesActionsTest-1060422934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f68ef53d-c676-4f12-9bb9-8ff3315f2902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:31:40 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-2ed63744-50dc-4aeb-9179-29c1703354b4 tempest-VolumesActionsTest-1060422934 None] Volume 24631145-b015-4dd4-ba85-f4dcf3c96fb4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24631145-b015-4dd4-ba85-f4dcf3c96fb4', 'volume_size': 1} Sep 28 09:31:40 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-2ed63744-50dc-4aeb-9179-29c1703354b4 tempest-VolumesActionsTest-1060422934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:31:40 devstack sudo[99121]: pam_unix(sudo:session): session closed for user root Sep 28 09:31:40 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ad4a11ad-2d64-40e4-bbca-14708a7f8e57 tempest-GroupSnapshotsV319Test-61944231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16f5b7f1-9624-4ac7-bfac-527c1ffef04c -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-16f5b7f1-9624-4ac7-bfac-527c1ffef04c.c93eb3e7-5eeb-46cc-9c44-7965faadd1ae" returned: 0 in 0.402s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:31:40 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-ad4a11ad-2d64-40e4-bbca-14708a7f8e57 tempest-GroupSnapshotsV319Test-61944231 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-16f5b7f1-9624-4ac7-bfac-527c1ffef04c.c93eb3e7-5eeb-46cc-9c44-7965faadd1ae is being set with open permissions: ugo+rw: NotImplementedError Sep 28 09:31:40 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ad4a11ad-2d64-40e4-bbca-14708a7f8e57 tempest-GroupSnapshotsV319Test-61944231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-16f5b7f1-9624-4ac7-bfac-527c1ffef04c.c93eb3e7-5eeb-46cc-9c44-7965faadd1ae {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:31:40 devstack sudo[99128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-16f5b7f1-9624-4ac7-bfac-527c1ffef04c.c93eb3e7-5eeb-46cc-9c44-7965faadd1ae Sep 28 09:31:40 devstack sudo[99128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:31:40 devstack sudo[99122]: pam_unix(sudo:session): session closed for user root Sep 28 09:31:40 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-d73327d4-0952-4086-b6b5-f76da7bc7e5a tempest-TestInstancesWithCinderVolumes-768341847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-44c9ccc6-0417-4565-a45e-21b743ec2993" returned: 0 in 0.545s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:31:40 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-d73327d4-0952-4086-b6b5-f76da7bc7e5a tempest-TestInstancesWithCinderVolumes-768341847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-44c9ccc6-0417-4565-a45e-21b743ec2993 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:31:40 devstack sudo[99134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-44c9ccc6-0417-4565-a45e-21b743ec2993 Sep 28 09:31:40 devstack sudo[99134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:31:40 devstack sudo[99128]: pam_unix(sudo:session): session closed for user root Sep 28 09:31:40 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ad4a11ad-2d64-40e4-bbca-14708a7f8e57 tempest-GroupSnapshotsV319Test-61944231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-16f5b7f1-9624-4ac7-bfac-527c1ffef04c.c93eb3e7-5eeb-46cc-9c44-7965faadd1ae" returned: 0 in 0.325s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:31:40 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ad4a11ad-2d64-40e4-bbca-14708a7f8e57 tempest-GroupSnapshotsV319Test-61944231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-16f5b7f1-9624-4ac7-bfac-527c1ffef04c.info {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:31:40 devstack sudo[99137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-16f5b7f1-9624-4ac7-bfac-527c1ffef04c.info Sep 28 09:31:40 devstack sudo[99137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:31:41 devstack sudo[99134]: pam_unix(sudo:session): session closed for user root Sep 28 09:31:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-d73327d4-0952-4086-b6b5-f76da7bc7e5a tempest-TestInstancesWithCinderVolumes-768341847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-44c9ccc6-0417-4565-a45e-21b743ec2993" returned: 0 in 0.327s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:31:41 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-d73327d4-0952-4086-b6b5-f76da7bc7e5a tempest-TestInstancesWithCinderVolumes-768341847 None] Lock "cinder-quobyte-44c9ccc6-0417-4565-a45e-21b743ec2993" released by "delete_volume" :: held 0.938s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:31:41 devstack cinder-volume[86553]: WARNING cinder.quota [None req-d73327d4-0952-4086-b6b5-f76da7bc7e5a tempest-TestInstancesWithCinderVolumes-768341847 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2022979541-465207878 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2022979541-465207878, it is now deprecated. Please use the default quota class for default quota. Sep 28 09:31:41 devstack cinder-volume[86553]: WARNING cinder.quota [None req-d73327d4-0952-4086-b6b5-f76da7bc7e5a tempest-TestInstancesWithCinderVolumes-768341847 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2022979541-465207878 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2022979541-465207878, it is now deprecated. Please use the default quota class for default quota. Sep 28 09:31:41 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-d73327d4-0952-4086-b6b5-f76da7bc7e5a tempest-TestInstancesWithCinderVolumes-768341847 None] Created reservations ['a6d6a158-ab9b-4110-9aa3-d7829a0d3f2a', '55ec6c1d-44e9-4fe8-9378-abbcb705afd5', '2cceab3e-1f43-49aa-ae1b-1bcbe0abd25d', 'b947e0e2-f5d5-42e8-80b4-f3a6f281b356'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:31:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-d73327d4-0952-4086-b6b5-f76da7bc7e5a tempest-TestInstancesWithCinderVolumes-768341847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:31:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-d73327d4-0952-4086-b6b5-f76da7bc7e5a tempest-TestInstancesWithCinderVolumes-768341847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:31:41 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-d73327d4-0952-4086-b6b5-f76da7bc7e5a tempest-TestInstancesWithCinderVolumes-768341847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:31:41 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-d73327d4-0952-4086-b6b5-f76da7bc7e5a tempest-TestInstancesWithCinderVolumes-768341847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:31:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-d73327d4-0952-4086-b6b5-f76da7bc7e5a tempest-TestInstancesWithCinderVolumes-768341847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:31:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-d73327d4-0952-4086-b6b5-f76da7bc7e5a tempest-TestInstancesWithCinderVolumes-768341847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:31:41 devstack sudo[99137]: pam_unix(sudo:session): session closed for user root Sep 28 09:31:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ad4a11ad-2d64-40e4-bbca-14708a7f8e57 tempest-GroupSnapshotsV319Test-61944231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-16f5b7f1-9624-4ac7-bfac-527c1ffef04c.info" returned: 0 in 0.404s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:31:41 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-ad4a11ad-2d64-40e4-bbca-14708a7f8e57 tempest-GroupSnapshotsV319Test-61944231 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-16f5b7f1-9624-4ac7-bfac-527c1ffef04c.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 09:31:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ad4a11ad-2d64-40e4-bbca-14708a7f8e57 tempest-GroupSnapshotsV319Test-61944231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-16f5b7f1-9624-4ac7-bfac-527c1ffef04c.info {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:31:41 devstack sudo[99141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:31:41 devstack sudo[99141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:31:41 devstack sudo[99142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-16f5b7f1-9624-4ac7-bfac-527c1ffef04c.info Sep 28 09:31:41 devstack sudo[99142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:31:41 devstack sudo[99141]: pam_unix(sudo:session): session closed for user root Sep 28 09:31:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-d73327d4-0952-4086-b6b5-f76da7bc7e5a tempest-TestInstancesWithCinderVolumes-768341847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.298s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:31:41 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-d73327d4-0952-4086-b6b5-f76da7bc7e5a tempest-TestInstancesWithCinderVolumes-768341847 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:31:41 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-d73327d4-0952-4086-b6b5-f76da7bc7e5a tempest-TestInstancesWithCinderVolumes-768341847 None] Deleted volume successfully. Sep 28 09:31:41 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-d73327d4-0952-4086-b6b5-f76da7bc7e5a tempest-TestInstancesWithCinderVolumes-768341847 None] Lock "cinder-44c9ccc6-0417-4565-a45e-21b743ec2993-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:31:41 devstack sudo[99142]: pam_unix(sudo:session): session closed for user root Sep 28 09:31:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ad4a11ad-2d64-40e4-bbca-14708a7f8e57 tempest-GroupSnapshotsV319Test-61944231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-16f5b7f1-9624-4ac7-bfac-527c1ffef04c.info" returned: 0 in 0.330s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:31:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ad4a11ad-2d64-40e4-bbca-14708a7f8e57 tempest-GroupSnapshotsV319Test-61944231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.808s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:31:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-2ed63744-50dc-4aeb-9179-29c1703354b4 tempest-VolumesActionsTest-1060422934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.254s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:31:41 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-2ed63744-50dc-4aeb-9179-29c1703354b4 tempest-VolumesActionsTest-1060422934 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:31:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-976602042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24631145-b015-4dd4-ba85-f4dcf3c96fb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f0af7d2451c49e79c57feeb377a6899',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:31:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:31:40Z,use_quota=True,user_id='54200af1bd5d458ea43817ab6b22c3f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:31:41 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-2ed63744-50dc-4aeb-9179-29c1703354b4 tempest-VolumesActionsTest-1060422934 None] Creating volume 24631145-b015-4dd4-ba85-f4dcf3c96fb4 {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:31:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-2ed63744-50dc-4aeb-9179-29c1703354b4 tempest-VolumesActionsTest-1060422934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:31:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-2ed63744-50dc-4aeb-9179-29c1703354b4 tempest-VolumesActionsTest-1060422934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:31:41 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-2ed63744-50dc-4aeb-9179-29c1703354b4 tempest-VolumesActionsTest-1060422934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:31:41 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-2ed63744-50dc-4aeb-9179-29c1703354b4 tempest-VolumesActionsTest-1060422934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:31:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-2ed63744-50dc-4aeb-9179-29c1703354b4 tempest-VolumesActionsTest-1060422934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:31:41 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-2ed63744-50dc-4aeb-9179-29c1703354b4 tempest-VolumesActionsTest-1060422934 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:31:41 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-2ed63744-50dc-4aeb-9179-29c1703354b4 tempest-VolumesActionsTest-1060422934 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:31:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2ed63744-50dc-4aeb-9179-29c1703354b4 tempest-VolumesActionsTest-1060422934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-24631145-b015-4dd4-ba85-f4dcf3c96fb4 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:31:41 devstack sudo[99147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-24631145-b015-4dd4-ba85-f4dcf3c96fb4 1073741824 Sep 28 09:31:41 devstack sudo[99147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:31:41 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-ad4a11ad-2d64-40e4-bbca-14708a7f8e57 tempest-GroupSnapshotsV319Test-61944231 None] group_snapshot 41917112-03cf-42ae-8970-ae95f455236c: created successfully Sep 28 09:31:42 devstack sudo[99147]: pam_unix(sudo:session): session closed for user root Sep 28 09:31:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2ed63744-50dc-4aeb-9179-29c1703354b4 tempest-VolumesActionsTest-1060422934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-24631145-b015-4dd4-ba85-f4dcf3c96fb4 1073741824" returned: 0 in 0.643s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:31:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2ed63744-50dc-4aeb-9179-29c1703354b4 tempest-VolumesActionsTest-1060422934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-24631145-b015-4dd4-ba85-f4dcf3c96fb4 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:31:42 devstack sudo[99153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-24631145-b015-4dd4-ba85-f4dcf3c96fb4 Sep 28 09:31:42 devstack sudo[99153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:31:42 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-9c42e898-bd70-4c19-965b-a3a6bf1f3276 tempest-GroupSnapshotsV319Test-61944231 None] group_snapshot 41917112-03cf-42ae-8970-ae95f455236c: deleting Sep 28 09:31:42 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-9c42e898-bd70-4c19-965b-a3a6bf1f3276 tempest-GroupSnapshotsV319Test-61944231 None] group_snapshot 41917112-03cf-42ae-8970-ae95f455236c: deleting {{(pid=86553) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 09:31:42 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-9c42e898-bd70-4c19-965b-a3a6bf1f3276 tempest-GroupSnapshotsV319Test-61944231 None] Acquiring lock "cinder-quobyte-16f5b7f1-9624-4ac7-bfac-527c1ffef04c" by "delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:31:42 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-9c42e898-bd70-4c19-965b-a3a6bf1f3276 tempest-GroupSnapshotsV319Test-61944231 None] Lock "cinder-quobyte-16f5b7f1-9624-4ac7-bfac-527c1ffef04c" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:31:42 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-9c42e898-bd70-4c19-965b-a3a6bf1f3276 tempest-GroupSnapshotsV319Test-61944231 None] Acquiring lock "cinder-quobyte-c93eb3e7-5eeb-46cc-9c44-7965faadd1ae" by "_delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:31:42 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-9c42e898-bd70-4c19-965b-a3a6bf1f3276 tempest-GroupSnapshotsV319Test-61944231 None] Lock "cinder-quobyte-c93eb3e7-5eeb-46cc-9c44-7965faadd1ae" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:31:42 devstack sudo[99153]: pam_unix(sudo:session): session closed for user root Sep 28 09:31:42 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-9c42e898-bd70-4c19-965b-a3a6bf1f3276 tempest-GroupSnapshotsV319Test-61944231 None] Deleting offline snapshot c93eb3e7-5eeb-46cc-9c44-7965faadd1ae of volume 16f5b7f1-9624-4ac7-bfac-527c1ffef04c {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 09:31:42 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-9c42e898-bd70-4c19-965b-a3a6bf1f3276 tempest-GroupSnapshotsV319Test-61944231 None] snapshot_file for this snap is: volume-16f5b7f1-9624-4ac7-bfac-527c1ffef04c.c93eb3e7-5eeb-46cc-9c44-7965faadd1ae {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 09:31:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2ed63744-50dc-4aeb-9179-29c1703354b4 tempest-VolumesActionsTest-1060422934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-24631145-b015-4dd4-ba85-f4dcf3c96fb4" returned: 0 in 0.406s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:31:42 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-2ed63744-50dc-4aeb-9179-29c1703354b4 tempest-VolumesActionsTest-1060422934 None] <== create_volume: return (1101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:31:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-2ed63744-50dc-4aeb-9179-29c1703354b4 tempest-VolumesActionsTest-1060422934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.105s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:31:42 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-2ed63744-50dc-4aeb-9179-29c1703354b4 tempest-VolumesActionsTest-1060422934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f68ef53d-c676-4f12-9bb9-8ff3315f2902) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24631145-b015-4dd4-ba85-f4dcf3c96fb4', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:31:42 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-2ed63744-50dc-4aeb-9179-29c1703354b4 tempest-VolumesActionsTest-1060422934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0e25765-4335-4bfa-aae5-cbd83fa9b162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:31:42 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c336dd-9439-4426-b03d-32341745466c]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:31:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-9c42e898-bd70-4c19-965b-a3a6bf1f3276 tempest-GroupSnapshotsV319Test-61944231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-16f5b7f1-9624-4ac7-bfac-527c1ffef04c.c93eb3e7-5eeb-46cc-9c44-7965faadd1ae {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:31:42 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-2ed63744-50dc-4aeb-9179-29c1703354b4 tempest-VolumesActionsTest-1060422934 None] Volume volume-24631145-b015-4dd4-ba85-f4dcf3c96fb4 (24631145-b015-4dd4-ba85-f4dcf3c96fb4): created successfully Sep 28 09:31:42 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-2ed63744-50dc-4aeb-9179-29c1703354b4 tempest-VolumesActionsTest-1060422934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0e25765-4335-4bfa-aae5-cbd83fa9b162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:31:42 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-2ed63744-50dc-4aeb-9179-29c1703354b4 tempest-VolumesActionsTest-1060422934 None] Flow 'volume_create_manager' (1b64758c-7e7a-4dba-b4e1-752981a8d634) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:31:42 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-2ed63744-50dc-4aeb-9179-29c1703354b4 tempest-VolumesActionsTest-1060422934 None] Created volume successfully. Sep 28 09:31:43 devstack sudo[99160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-16f5b7f1-9624-4ac7-bfac-527c1ffef04c.c93eb3e7-5eeb-46cc-9c44-7965faadd1ae Sep 28 09:31:43 devstack sudo[99160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:31:43 devstack sudo[99160]: pam_unix(sudo:session): session closed for user root Sep 28 09:31:43 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-9c42e898-bd70-4c19-965b-a3a6bf1f3276 tempest-GroupSnapshotsV319Test-61944231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-16f5b7f1-9624-4ac7-bfac-527c1ffef04c.c93eb3e7-5eeb-46cc-9c44-7965faadd1ae" returned: 0 in 0.449s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:31:43 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-9c42e898-bd70-4c19-965b-a3a6bf1f3276 tempest-GroupSnapshotsV319Test-61944231 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16f5b7f1-9624-4ac7-bfac-527c1ffef04c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86553) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 09:31:43 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a8b634-0ace-4122-b7f7-efd5f2a533de]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:31:43 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-9c42e898-bd70-4c19-965b-a3a6bf1f3276 tempest-GroupSnapshotsV319Test-61944231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-16f5b7f1-9624-4ac7-bfac-527c1ffef04c {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:31:43 devstack sudo[99176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-16f5b7f1-9624-4ac7-bfac-527c1ffef04c Sep 28 09:31:43 devstack sudo[99176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:31:43 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-299dfc0b-8a93-4daf-a52f-4ca9076573e6 tempest-VolumesActionsTest-1301638755 None] Acquiring lock "cinder-24631145-b015-4dd4-ba85-f4dcf3c96fb4-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:31:43 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-299dfc0b-8a93-4daf-a52f-4ca9076573e6 tempest-VolumesActionsTest-1301638755 None] Lock "cinder-24631145-b015-4dd4-ba85-f4dcf3c96fb4-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:31:43 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-299dfc0b-8a93-4daf-a52f-4ca9076573e6 tempest-VolumesActionsTest-1301638755 None] Acquiring lock "cinder-quobyte-24631145-b015-4dd4-ba85-f4dcf3c96fb4" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:31:43 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-299dfc0b-8a93-4daf-a52f-4ca9076573e6 tempest-VolumesActionsTest-1301638755 None] Lock "cinder-quobyte-24631145-b015-4dd4-ba85-f4dcf3c96fb4" acquired by "delete_volume" :: waited 0.017s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:31:43 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be576a2-7df7-4182-95c0-dc5776e90e83]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:31:43 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-299dfc0b-8a93-4daf-a52f-4ca9076573e6 tempest-VolumesActionsTest-1301638755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-24631145-b015-4dd4-ba85-f4dcf3c96fb4 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:31:43 devstack sudo[99176]: pam_unix(sudo:session): session closed for user root Sep 28 09:31:43 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-9c42e898-bd70-4c19-965b-a3a6bf1f3276 tempest-GroupSnapshotsV319Test-61944231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-16f5b7f1-9624-4ac7-bfac-527c1ffef04c" returned: 0 in 0.522s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:31:43 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-9c42e898-bd70-4c19-965b-a3a6bf1f3276 tempest-GroupSnapshotsV319Test-61944231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-16f5b7f1-9624-4ac7-bfac-527c1ffef04c.c93eb3e7-5eeb-46cc-9c44-7965faadd1ae {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:31:43 devstack sudo[99188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-16f5b7f1-9624-4ac7-bfac-527c1ffef04c.c93eb3e7-5eeb-46cc-9c44-7965faadd1ae Sep 28 09:31:43 devstack sudo[99188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:31:43 devstack sudo[99187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-24631145-b015-4dd4-ba85-f4dcf3c96fb4 Sep 28 09:31:43 devstack sudo[99187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:31:44 devstack sudo[99188]: pam_unix(sudo:session): session closed for user root Sep 28 09:31:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-9c42e898-bd70-4c19-965b-a3a6bf1f3276 tempest-GroupSnapshotsV319Test-61944231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-16f5b7f1-9624-4ac7-bfac-527c1ffef04c.c93eb3e7-5eeb-46cc-9c44-7965faadd1ae" returned: 0 in 0.429s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:31:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-9c42e898-bd70-4c19-965b-a3a6bf1f3276 tempest-GroupSnapshotsV319Test-61944231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-16f5b7f1-9624-4ac7-bfac-527c1ffef04c.c93eb3e7-5eeb-46cc-9c44-7965faadd1ae {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:31:44 devstack sudo[99197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-16f5b7f1-9624-4ac7-bfac-527c1ffef04c.c93eb3e7-5eeb-46cc-9c44-7965faadd1ae Sep 28 09:31:44 devstack sudo[99197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:31:44 devstack sudo[99187]: pam_unix(sudo:session): session closed for user root Sep 28 09:31:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-299dfc0b-8a93-4daf-a52f-4ca9076573e6 tempest-VolumesActionsTest-1301638755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-24631145-b015-4dd4-ba85-f4dcf3c96fb4" returned: 0 in 0.509s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:31:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-299dfc0b-8a93-4daf-a52f-4ca9076573e6 tempest-VolumesActionsTest-1301638755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-24631145-b015-4dd4-ba85-f4dcf3c96fb4 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:31:44 devstack sudo[99199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-24631145-b015-4dd4-ba85-f4dcf3c96fb4 Sep 28 09:31:44 devstack sudo[99199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:31:44 devstack sudo[99197]: pam_unix(sudo:session): session closed for user root Sep 28 09:31:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-9c42e898-bd70-4c19-965b-a3a6bf1f3276 tempest-GroupSnapshotsV319Test-61944231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-16f5b7f1-9624-4ac7-bfac-527c1ffef04c.c93eb3e7-5eeb-46cc-9c44-7965faadd1ae" returned: 0 in 0.308s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:31:44 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-9c42e898-bd70-4c19-965b-a3a6bf1f3276 tempest-GroupSnapshotsV319Test-61944231 None] Lock "cinder-quobyte-c93eb3e7-5eeb-46cc-9c44-7965faadd1ae" released by "_delete_snapshot" :: held 1.884s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:31:44 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-9c42e898-bd70-4c19-965b-a3a6bf1f3276 tempest-GroupSnapshotsV319Test-61944231 None] Lock "cinder-quobyte-16f5b7f1-9624-4ac7-bfac-527c1ffef04c" released by "delete_snapshot" :: held 1.939s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:31:44 devstack sudo[99199]: pam_unix(sudo:session): session closed for user root Sep 28 09:31:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-299dfc0b-8a93-4daf-a52f-4ca9076573e6 tempest-VolumesActionsTest-1301638755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-24631145-b015-4dd4-ba85-f4dcf3c96fb4" returned: 0 in 0.342s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:31:44 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-299dfc0b-8a93-4daf-a52f-4ca9076573e6 tempest-VolumesActionsTest-1301638755 None] Lock "cinder-quobyte-24631145-b015-4dd4-ba85-f4dcf3c96fb4" released by "delete_volume" :: held 0.917s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:31:44 devstack cinder-volume[86553]: WARNING cinder.quota [None req-9c42e898-bd70-4c19-965b-a3a6bf1f3276 tempest-GroupSnapshotsV319Test-61944231 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1031079160 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1031079160, it is now deprecated. Please use the default quota class for default quota. Sep 28 09:31:44 devstack cinder-volume[86553]: WARNING cinder.quota [None req-9c42e898-bd70-4c19-965b-a3a6bf1f3276 tempest-GroupSnapshotsV319Test-61944231 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1031079160 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1031079160, it is now deprecated. Please use the default quota class for default quota. Sep 28 09:31:44 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-9c42e898-bd70-4c19-965b-a3a6bf1f3276 tempest-GroupSnapshotsV319Test-61944231 None] Created reservations ['e8995bbe-525e-4ce6-97ef-b91d08f5236d', '9029ef5c-8f0e-424f-82bc-904cb4e053d5', '5cff5a80-4466-4056-9fe1-048410f912e7', '389cf406-7e9e-4481-beb1-6d6e9b1bf932'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:31:44 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-299dfc0b-8a93-4daf-a52f-4ca9076573e6 tempest-VolumesActionsTest-1301638755 None] Created reservations ['da5fb370-7b1e-4c0d-8389-112b8e2b041e', 'b6c09d6d-bfce-4966-bbe3-ad3739569027', '54d9289e-87b8-4107-a7cb-b2138570711e', '9432c93e-f51a-426e-827e-a032c58d4653'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:31:44 devstack cinder-volume[86553]: INFO cinder.volume.manager [req-024b94f4-492a-4ef9-9705-0034d8863e29 req-a75e5aee-8d73-49cc-82fe-07c8af249a39 tempest-TestInstancesWithCinderVolumes-768341847 None] Terminate volume connection completed successfully. Sep 28 09:31:44 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [req-024b94f4-492a-4ef9-9705-0034d8863e29 req-a75e5aee-8d73-49cc-82fe-07c8af249a39 tempest-TestInstancesWithCinderVolumes-768341847 None] Deleting attachment ce19a364-489e-4d98-b91d-3b44ec3b7a1f. {{(pid=86553) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 09:31:44 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-9c42e898-bd70-4c19-965b-a3a6bf1f3276 tempest-GroupSnapshotsV319Test-61944231 None] group_snapshot 41917112-03cf-42ae-8970-ae95f455236c: deleted successfully Sep 28 09:31:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-299dfc0b-8a93-4daf-a52f-4ca9076573e6 tempest-VolumesActionsTest-1301638755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:31:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-299dfc0b-8a93-4daf-a52f-4ca9076573e6 tempest-VolumesActionsTest-1301638755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:31:44 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-299dfc0b-8a93-4daf-a52f-4ca9076573e6 tempest-VolumesActionsTest-1301638755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:31:44 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-299dfc0b-8a93-4daf-a52f-4ca9076573e6 tempest-VolumesActionsTest-1301638755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:31:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-299dfc0b-8a93-4daf-a52f-4ca9076573e6 tempest-VolumesActionsTest-1301638755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:31:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-299dfc0b-8a93-4daf-a52f-4ca9076573e6 tempest-VolumesActionsTest-1301638755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:31:44 devstack sudo[99208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:31:44 devstack sudo[99208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:31:45 devstack sudo[99208]: pam_unix(sudo:session): session closed for user root Sep 28 09:31:45 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-299dfc0b-8a93-4daf-a52f-4ca9076573e6 tempest-VolumesActionsTest-1301638755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.423s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:31:45 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-299dfc0b-8a93-4daf-a52f-4ca9076573e6 tempest-VolumesActionsTest-1301638755 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:31:45 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-8dae91fc-2a84-4e01-8586-8627081538d1 tempest-GroupSnapshotsV319Test-61944231 None] Acquiring lock "cinder-quobyte-16f5b7f1-9624-4ac7-bfac-527c1ffef04c" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:31:45 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-299dfc0b-8a93-4daf-a52f-4ca9076573e6 tempest-VolumesActionsTest-1301638755 None] Deleted volume successfully. Sep 28 09:31:45 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-9dacc954-6bca-422f-8076-7d9c2c20dc5d tempest-TestInstancesWithCinderVolumes-768341847 None] Acquiring lock "cinder-5b769227-250e-4375-881f-be870680efeb-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:31:45 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-8dae91fc-2a84-4e01-8586-8627081538d1 tempest-GroupSnapshotsV319Test-61944231 None] Lock "cinder-quobyte-16f5b7f1-9624-4ac7-bfac-527c1ffef04c" acquired by "delete_volume" :: waited 0.048s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:31:45 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-9dacc954-6bca-422f-8076-7d9c2c20dc5d tempest-TestInstancesWithCinderVolumes-768341847 None] Lock "cinder-5b769227-250e-4375-881f-be870680efeb-delete_volume" acquired by "delete_volume" :: waited 0.096s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:31:45 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-299dfc0b-8a93-4daf-a52f-4ca9076573e6 tempest-VolumesActionsTest-1301638755 None] Lock "cinder-24631145-b015-4dd4-ba85-f4dcf3c96fb4-delete_volume" released by "delete_volume" :: held 1.766s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:31:45 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c119612-b31a-45a5-8781-eb5139597ebb]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:31:45 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-8dae91fc-2a84-4e01-8586-8627081538d1 tempest-GroupSnapshotsV319Test-61944231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-16f5b7f1-9624-4ac7-bfac-527c1ffef04c {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:31:45 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-9dacc954-6bca-422f-8076-7d9c2c20dc5d tempest-TestInstancesWithCinderVolumes-768341847 None] Acquiring lock "cinder-quobyte-5b769227-250e-4375-881f-be870680efeb" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:31:45 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-9dacc954-6bca-422f-8076-7d9c2c20dc5d tempest-TestInstancesWithCinderVolumes-768341847 None] Lock "cinder-quobyte-5b769227-250e-4375-881f-be870680efeb" acquired by "delete_volume" :: waited 0.031s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:31:45 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ecab3f0-8ffa-43e5-a431-ecc8c49b8183]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:31:45 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-9dacc954-6bca-422f-8076-7d9c2c20dc5d tempest-TestInstancesWithCinderVolumes-768341847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-5b769227-250e-4375-881f-be870680efeb {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:31:45 devstack sudo[99211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-16f5b7f1-9624-4ac7-bfac-527c1ffef04c Sep 28 09:31:45 devstack sudo[99211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:31:45 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-beb65613-0ff4-4098-952f-2e8f6b38bebd tempest-VolumesActionsTest-1060422934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:31:45 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-beb65613-0ff4-4098-952f-2e8f6b38bebd tempest-VolumesActionsTest-1060422934 None] Flow 'volume_create_manager' (806651b0-2233-49ab-9728-ea9714880691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:31:45 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-beb65613-0ff4-4098-952f-2e8f6b38bebd tempest-VolumesActionsTest-1060422934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f761fe0a-af51-4208-bbb7-66a5b7cca4d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:31:45 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-beb65613-0ff4-4098-952f-2e8f6b38bebd tempest-VolumesActionsTest-1060422934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f761fe0a-af51-4208-bbb7-66a5b7cca4d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:31:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-401532554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abd8e68c-e69a-45c8-812a-0b282600dc3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f0af7d2451c49e79c57feeb377a6899',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:31:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:31:46Z,use_quota=True,user_id='54200af1bd5d458ea43817ab6b22c3f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:31:45 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-beb65613-0ff4-4098-952f-2e8f6b38bebd tempest-VolumesActionsTest-1060422934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5cbf623-41f7-4063-bf65-1cd2d9854379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:31:45 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-beb65613-0ff4-4098-952f-2e8f6b38bebd tempest-VolumesActionsTest-1060422934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5cbf623-41f7-4063-bf65-1cd2d9854379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:31:45 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-beb65613-0ff4-4098-952f-2e8f6b38bebd tempest-VolumesActionsTest-1060422934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fe01d2b-a6cd-4da8-a8ac-a3473cf8a6b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:31:45 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-beb65613-0ff4-4098-952f-2e8f6b38bebd tempest-VolumesActionsTest-1060422934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fe01d2b-a6cd-4da8-a8ac-a3473cf8a6b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abd8e68c-e69a-45c8-812a-0b282600dc3d', 'volume_name': 'volume-abd8e68c-e69a-45c8-812a-0b282600dc3d', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:31:45 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-beb65613-0ff4-4098-952f-2e8f6b38bebd tempest-VolumesActionsTest-1060422934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5be434f-e3c8-4a53-8f44-c74e7dd4b0b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:31:45 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-beb65613-0ff4-4098-952f-2e8f6b38bebd tempest-VolumesActionsTest-1060422934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5be434f-e3c8-4a53-8f44-c74e7dd4b0b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:31:45 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-beb65613-0ff4-4098-952f-2e8f6b38bebd tempest-VolumesActionsTest-1060422934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5010d4f-a8b0-46df-abe6-0eb8d5fda258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:31:45 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-beb65613-0ff4-4098-952f-2e8f6b38bebd tempest-VolumesActionsTest-1060422934 None] Volume abd8e68c-e69a-45c8-812a-0b282600dc3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abd8e68c-e69a-45c8-812a-0b282600dc3d', 'volume_size': 1} Sep 28 09:31:45 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-beb65613-0ff4-4098-952f-2e8f6b38bebd tempest-VolumesActionsTest-1060422934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:31:45 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-beb65613-0ff4-4098-952f-2e8f6b38bebd tempest-VolumesActionsTest-1060422934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:31:45 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-beb65613-0ff4-4098-952f-2e8f6b38bebd tempest-VolumesActionsTest-1060422934 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:31:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-401532554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abd8e68c-e69a-45c8-812a-0b282600dc3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f0af7d2451c49e79c57feeb377a6899',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:31:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:31:46Z,use_quota=True,user_id='54200af1bd5d458ea43817ab6b22c3f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:31:45 devstack sudo[99212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-5b769227-250e-4375-881f-be870680efeb Sep 28 09:31:45 devstack sudo[99212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:31:45 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-beb65613-0ff4-4098-952f-2e8f6b38bebd tempest-VolumesActionsTest-1060422934 None] Creating volume abd8e68c-e69a-45c8-812a-0b282600dc3d {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:31:45 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-beb65613-0ff4-4098-952f-2e8f6b38bebd tempest-VolumesActionsTest-1060422934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:31:45 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-beb65613-0ff4-4098-952f-2e8f6b38bebd tempest-VolumesActionsTest-1060422934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:31:45 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-beb65613-0ff4-4098-952f-2e8f6b38bebd tempest-VolumesActionsTest-1060422934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:31:45 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-beb65613-0ff4-4098-952f-2e8f6b38bebd tempest-VolumesActionsTest-1060422934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:31:45 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-beb65613-0ff4-4098-952f-2e8f6b38bebd tempest-VolumesActionsTest-1060422934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:31:45 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-beb65613-0ff4-4098-952f-2e8f6b38bebd tempest-VolumesActionsTest-1060422934 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:31:45 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-beb65613-0ff4-4098-952f-2e8f6b38bebd tempest-VolumesActionsTest-1060422934 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:31:45 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-beb65613-0ff4-4098-952f-2e8f6b38bebd tempest-VolumesActionsTest-1060422934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-abd8e68c-e69a-45c8-812a-0b282600dc3d 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:31:45 devstack sudo[99215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-abd8e68c-e69a-45c8-812a-0b282600dc3d 1073741824 Sep 28 09:31:45 devstack sudo[99215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:31:46 devstack sudo[99211]: pam_unix(sudo:session): session closed for user root Sep 28 09:31:46 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-8dae91fc-2a84-4e01-8586-8627081538d1 tempest-GroupSnapshotsV319Test-61944231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-16f5b7f1-9624-4ac7-bfac-527c1ffef04c" returned: 0 in 0.580s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:31:46 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-8dae91fc-2a84-4e01-8586-8627081538d1 tempest-GroupSnapshotsV319Test-61944231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-16f5b7f1-9624-4ac7-bfac-527c1ffef04c {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:31:46 devstack sudo[99222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-16f5b7f1-9624-4ac7-bfac-527c1ffef04c Sep 28 09:31:46 devstack sudo[99222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:31:46 devstack sudo[99212]: pam_unix(sudo:session): session closed for user root Sep 28 09:31:46 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-9dacc954-6bca-422f-8076-7d9c2c20dc5d tempest-TestInstancesWithCinderVolumes-768341847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-5b769227-250e-4375-881f-be870680efeb" returned: 0 in 0.544s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:31:46 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-9dacc954-6bca-422f-8076-7d9c2c20dc5d tempest-TestInstancesWithCinderVolumes-768341847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-5b769227-250e-4375-881f-be870680efeb {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:31:46 devstack sudo[99228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-5b769227-250e-4375-881f-be870680efeb Sep 28 09:31:46 devstack sudo[99228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:31:46 devstack sudo[99215]: pam_unix(sudo:session): session closed for user root Sep 28 09:31:46 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-beb65613-0ff4-4098-952f-2e8f6b38bebd tempest-VolumesActionsTest-1060422934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-abd8e68c-e69a-45c8-812a-0b282600dc3d 1073741824" returned: 0 in 0.643s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:31:46 devstack sudo[99222]: pam_unix(sudo:session): session closed for user root Sep 28 09:31:46 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-8dae91fc-2a84-4e01-8586-8627081538d1 tempest-GroupSnapshotsV319Test-61944231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-16f5b7f1-9624-4ac7-bfac-527c1ffef04c" returned: 0 in 0.423s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:31:46 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-8dae91fc-2a84-4e01-8586-8627081538d1 tempest-GroupSnapshotsV319Test-61944231 None] Lock "cinder-quobyte-16f5b7f1-9624-4ac7-bfac-527c1ffef04c" released by "delete_volume" :: held 1.154s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:31:46 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-beb65613-0ff4-4098-952f-2e8f6b38bebd tempest-VolumesActionsTest-1060422934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-abd8e68c-e69a-45c8-812a-0b282600dc3d {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:31:46 devstack sudo[99228]: pam_unix(sudo:session): session closed for user root Sep 28 09:31:46 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-9dacc954-6bca-422f-8076-7d9c2c20dc5d tempest-TestInstancesWithCinderVolumes-768341847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-5b769227-250e-4375-881f-be870680efeb" returned: 0 in 0.413s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:31:46 devstack sudo[99234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-abd8e68c-e69a-45c8-812a-0b282600dc3d Sep 28 09:31:46 devstack sudo[99234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:31:46 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-9dacc954-6bca-422f-8076-7d9c2c20dc5d tempest-TestInstancesWithCinderVolumes-768341847 None] Lock "cinder-quobyte-5b769227-250e-4375-881f-be870680efeb" released by "delete_volume" :: held 1.052s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:31:46 devstack cinder-volume[86553]: WARNING cinder.quota [None req-9dacc954-6bca-422f-8076-7d9c2c20dc5d tempest-TestInstancesWithCinderVolumes-768341847 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-267559324-1397741629 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-267559324-1397741629, it is now deprecated. Please use the default quota class for default quota. Sep 28 09:31:46 devstack cinder-volume[86553]: WARNING cinder.quota [None req-9dacc954-6bca-422f-8076-7d9c2c20dc5d tempest-TestInstancesWithCinderVolumes-768341847 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-267559324-1397741629 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-267559324-1397741629, it is now deprecated. Please use the default quota class for default quota. Sep 28 09:31:46 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-8dae91fc-2a84-4e01-8586-8627081538d1 tempest-GroupSnapshotsV319Test-61944231 None] Created reservations ['9b2a682b-c226-4672-9923-cbcaed7f4aa8'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:31:46 devstack cinder-volume[86553]: WARNING cinder.quota [None req-8dae91fc-2a84-4e01-8586-8627081538d1 tempest-GroupSnapshotsV319Test-61944231 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1031079160 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1031079160, it is now deprecated. Please use the default quota class for default quota. Sep 28 09:31:46 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-9dacc954-6bca-422f-8076-7d9c2c20dc5d tempest-TestInstancesWithCinderVolumes-768341847 None] Created reservations ['069e26ad-1ebc-4174-9ac8-e694e9421f4f', 'bac00553-4cd4-4627-989a-80e5a04ae0b5', '11f3f7c2-e958-44e5-81d9-1ed784ec1ce4', 'd36c59b1-3ea2-4e32-84bf-9b5016ace601'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:31:46 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-8dae91fc-2a84-4e01-8586-8627081538d1 tempest-GroupSnapshotsV319Test-61944231 None] Created reservations ['cb7ad356-abe8-4b4b-b838-27506c957e43', '82307c50-3ef1-4ad8-bff0-b257160044b2', '31d25e4d-2f8d-464b-b91e-a6b4cb498f7a', 'db56916b-18df-44fb-b9f7-0e67d5cf0957'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:31:46 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-9dacc954-6bca-422f-8076-7d9c2c20dc5d tempest-TestInstancesWithCinderVolumes-768341847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:31:46 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-9dacc954-6bca-422f-8076-7d9c2c20dc5d tempest-TestInstancesWithCinderVolumes-768341847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:31:46 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-9dacc954-6bca-422f-8076-7d9c2c20dc5d tempest-TestInstancesWithCinderVolumes-768341847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:31:46 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-9dacc954-6bca-422f-8076-7d9c2c20dc5d tempest-TestInstancesWithCinderVolumes-768341847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:31:46 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-9dacc954-6bca-422f-8076-7d9c2c20dc5d tempest-TestInstancesWithCinderVolumes-768341847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:31:46 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-9dacc954-6bca-422f-8076-7d9c2c20dc5d tempest-TestInstancesWithCinderVolumes-768341847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:31:46 devstack sudo[99234]: pam_unix(sudo:session): session closed for user root Sep 28 09:31:47 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-beb65613-0ff4-4098-952f-2e8f6b38bebd tempest-VolumesActionsTest-1060422934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-abd8e68c-e69a-45c8-812a-0b282600dc3d" returned: 0 in 0.389s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:31:47 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-beb65613-0ff4-4098-952f-2e8f6b38bebd tempest-VolumesActionsTest-1060422934 None] <== create_volume: return (1151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:31:47 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-beb65613-0ff4-4098-952f-2e8f6b38bebd tempest-VolumesActionsTest-1060422934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.155s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:31:47 devstack sudo[99237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:31:47 devstack sudo[99237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:31:47 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-beb65613-0ff4-4098-952f-2e8f6b38bebd tempest-VolumesActionsTest-1060422934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5010d4f-a8b0-46df-abe6-0eb8d5fda258) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abd8e68c-e69a-45c8-812a-0b282600dc3d', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:31:47 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-beb65613-0ff4-4098-952f-2e8f6b38bebd tempest-VolumesActionsTest-1060422934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c82d84e-42be-4a96-b587-0fc963be6577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:31:47 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-beb65613-0ff4-4098-952f-2e8f6b38bebd tempest-VolumesActionsTest-1060422934 None] Volume volume-abd8e68c-e69a-45c8-812a-0b282600dc3d (abd8e68c-e69a-45c8-812a-0b282600dc3d): created successfully Sep 28 09:31:47 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-beb65613-0ff4-4098-952f-2e8f6b38bebd tempest-VolumesActionsTest-1060422934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c82d84e-42be-4a96-b587-0fc963be6577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:31:47 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-beb65613-0ff4-4098-952f-2e8f6b38bebd tempest-VolumesActionsTest-1060422934 None] Flow 'volume_create_manager' (806651b0-2233-49ab-9728-ea9714880691) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:31:47 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-beb65613-0ff4-4098-952f-2e8f6b38bebd tempest-VolumesActionsTest-1060422934 None] Created volume successfully. Sep 28 09:31:47 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-8dae91fc-2a84-4e01-8586-8627081538d1 tempest-GroupSnapshotsV319Test-61944231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:31:47 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-8dae91fc-2a84-4e01-8586-8627081538d1 tempest-GroupSnapshotsV319Test-61944231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:31:47 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-8dae91fc-2a84-4e01-8586-8627081538d1 tempest-GroupSnapshotsV319Test-61944231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:31:47 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-8dae91fc-2a84-4e01-8586-8627081538d1 tempest-GroupSnapshotsV319Test-61944231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:31:47 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-8dae91fc-2a84-4e01-8586-8627081538d1 tempest-GroupSnapshotsV319Test-61944231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:31:47 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-8dae91fc-2a84-4e01-8586-8627081538d1 tempest-GroupSnapshotsV319Test-61944231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:31:47 devstack sudo[99239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:31:47 devstack sudo[99239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:31:47 devstack sudo[99237]: pam_unix(sudo:session): session closed for user root Sep 28 09:31:47 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-9dacc954-6bca-422f-8076-7d9c2c20dc5d tempest-TestInstancesWithCinderVolumes-768341847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.418s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:31:47 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-9dacc954-6bca-422f-8076-7d9c2c20dc5d tempest-TestInstancesWithCinderVolumes-768341847 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:31:47 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-9dacc954-6bca-422f-8076-7d9c2c20dc5d tempest-TestInstancesWithCinderVolumes-768341847 None] Deleted volume successfully. Sep 28 09:31:47 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-9dacc954-6bca-422f-8076-7d9c2c20dc5d tempest-TestInstancesWithCinderVolumes-768341847 None] Lock "cinder-5b769227-250e-4375-881f-be870680efeb-delete_volume" released by "delete_volume" :: held 1.959s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:31:47 devstack sudo[99239]: pam_unix(sudo:session): session closed for user root Sep 28 09:31:47 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-8dae91fc-2a84-4e01-8586-8627081538d1 tempest-GroupSnapshotsV319Test-61944231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.361s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:31:47 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-8dae91fc-2a84-4e01-8586-8627081538d1 tempest-GroupSnapshotsV319Test-61944231 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:31:47 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-8dae91fc-2a84-4e01-8586-8627081538d1 tempest-GroupSnapshotsV319Test-61944231 None] Delete group completed successfully. Sep 28 09:31:48 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-d0dec851-03f7-4aa2-9ba4-17e2502ff247 tempest-VolumesActionsTest-1301638755 None] Acquiring lock "cinder-abd8e68c-e69a-45c8-812a-0b282600dc3d-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:31:48 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-d0dec851-03f7-4aa2-9ba4-17e2502ff247 tempest-VolumesActionsTest-1301638755 None] Lock "cinder-abd8e68c-e69a-45c8-812a-0b282600dc3d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:31:48 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-517bb34f-8f3a-4ab0-b0cf-a620c05a4b6e tempest-VolumesServicesTestJSON-755939763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:31:48 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-517bb34f-8f3a-4ab0-b0cf-a620c05a4b6e tempest-VolumesServicesTestJSON-755939763 None] Flow 'volume_create_manager' (4987a03a-0d33-40c2-97d4-bcc8ed90d0a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:31:48 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-517bb34f-8f3a-4ab0-b0cf-a620c05a4b6e tempest-VolumesServicesTestJSON-755939763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7f3e0ef-59e8-4643-a3b6-0bf794aa9eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:31:48 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-517bb34f-8f3a-4ab0-b0cf-a620c05a4b6e tempest-VolumesServicesTestJSON-755939763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7f3e0ef-59e8-4643-a3b6-0bf794aa9eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:31:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1578271605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cbad8e4-7f21-4c2d-9d03-cbe10abf111b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fafe7b7c15741368a028d88ad2693a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:31:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:31:48Z,use_quota=True,user_id='07221dd1467346ffbe503f256e0a24db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:31:48 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-517bb34f-8f3a-4ab0-b0cf-a620c05a4b6e tempest-VolumesServicesTestJSON-755939763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60672a8c-e23a-4e42-9b1e-cbf921b955a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:31:48 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-517bb34f-8f3a-4ab0-b0cf-a620c05a4b6e tempest-VolumesServicesTestJSON-755939763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60672a8c-e23a-4e42-9b1e-cbf921b955a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:31:48 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-517bb34f-8f3a-4ab0-b0cf-a620c05a4b6e tempest-VolumesServicesTestJSON-755939763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0484e765-d33e-4149-be54-8e51b63a8ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:31:48 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-517bb34f-8f3a-4ab0-b0cf-a620c05a4b6e tempest-VolumesServicesTestJSON-755939763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0484e765-d33e-4149-be54-8e51b63a8ad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cbad8e4-7f21-4c2d-9d03-cbe10abf111b', 'volume_name': 'volume-6cbad8e4-7f21-4c2d-9d03-cbe10abf111b', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:31:48 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-517bb34f-8f3a-4ab0-b0cf-a620c05a4b6e tempest-VolumesServicesTestJSON-755939763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e87a1857-2c55-4cb4-ba4b-21712062d421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:31:48 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-517bb34f-8f3a-4ab0-b0cf-a620c05a4b6e tempest-VolumesServicesTestJSON-755939763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e87a1857-2c55-4cb4-ba4b-21712062d421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:31:48 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-517bb34f-8f3a-4ab0-b0cf-a620c05a4b6e tempest-VolumesServicesTestJSON-755939763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfbddbc2-3687-4589-b38f-3ee5694c25a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:31:48 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-517bb34f-8f3a-4ab0-b0cf-a620c05a4b6e tempest-VolumesServicesTestJSON-755939763 None] Volume 6cbad8e4-7f21-4c2d-9d03-cbe10abf111b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cbad8e4-7f21-4c2d-9d03-cbe10abf111b', 'volume_size': 1} Sep 28 09:31:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-517bb34f-8f3a-4ab0-b0cf-a620c05a4b6e tempest-VolumesServicesTestJSON-755939763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:31:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-517bb34f-8f3a-4ab0-b0cf-a620c05a4b6e tempest-VolumesServicesTestJSON-755939763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:31:48 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-517bb34f-8f3a-4ab0-b0cf-a620c05a4b6e tempest-VolumesServicesTestJSON-755939763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:31:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1578271605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cbad8e4-7f21-4c2d-9d03-cbe10abf111b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fafe7b7c15741368a028d88ad2693a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:31:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:31:48Z,use_quota=True,user_id='07221dd1467346ffbe503f256e0a24db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:31:48 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-517bb34f-8f3a-4ab0-b0cf-a620c05a4b6e tempest-VolumesServicesTestJSON-755939763 None] Creating volume 6cbad8e4-7f21-4c2d-9d03-cbe10abf111b {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:31:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-517bb34f-8f3a-4ab0-b0cf-a620c05a4b6e tempest-VolumesServicesTestJSON-755939763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:31:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-517bb34f-8f3a-4ab0-b0cf-a620c05a4b6e tempest-VolumesServicesTestJSON-755939763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:31:48 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-517bb34f-8f3a-4ab0-b0cf-a620c05a4b6e tempest-VolumesServicesTestJSON-755939763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:31:48 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-517bb34f-8f3a-4ab0-b0cf-a620c05a4b6e tempest-VolumesServicesTestJSON-755939763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:31:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-517bb34f-8f3a-4ab0-b0cf-a620c05a4b6e tempest-VolumesServicesTestJSON-755939763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:31:48 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-517bb34f-8f3a-4ab0-b0cf-a620c05a4b6e tempest-VolumesServicesTestJSON-755939763 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:31:48 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-517bb34f-8f3a-4ab0-b0cf-a620c05a4b6e tempest-VolumesServicesTestJSON-755939763 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:31:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-517bb34f-8f3a-4ab0-b0cf-a620c05a4b6e tempest-VolumesServicesTestJSON-755939763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6cbad8e4-7f21-4c2d-9d03-cbe10abf111b 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:31:48 devstack sudo[99245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6cbad8e4-7f21-4c2d-9d03-cbe10abf111b 1073741824 Sep 28 09:31:48 devstack sudo[99245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:31:48 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-d0dec851-03f7-4aa2-9ba4-17e2502ff247 tempest-VolumesActionsTest-1301638755 None] Acquiring lock "cinder-quobyte-abd8e68c-e69a-45c8-812a-0b282600dc3d" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:31:48 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-d0dec851-03f7-4aa2-9ba4-17e2502ff247 tempest-VolumesActionsTest-1301638755 None] Lock "cinder-quobyte-abd8e68c-e69a-45c8-812a-0b282600dc3d" acquired by "delete_volume" :: waited 0.025s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:31:48 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe20c41c-43ee-440e-ab99-c4b98b0c6532]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:31:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-d0dec851-03f7-4aa2-9ba4-17e2502ff247 tempest-VolumesActionsTest-1301638755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-abd8e68c-e69a-45c8-812a-0b282600dc3d {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:31:48 devstack sudo[99247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-abd8e68c-e69a-45c8-812a-0b282600dc3d Sep 28 09:31:48 devstack sudo[99247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:31:49 devstack sudo[99245]: pam_unix(sudo:session): session closed for user root Sep 28 09:31:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-517bb34f-8f3a-4ab0-b0cf-a620c05a4b6e tempest-VolumesServicesTestJSON-755939763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6cbad8e4-7f21-4c2d-9d03-cbe10abf111b 1073741824" returned: 0 in 0.673s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:31:49 devstack sudo[99247]: pam_unix(sudo:session): session closed for user root Sep 28 09:31:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-517bb34f-8f3a-4ab0-b0cf-a620c05a4b6e tempest-VolumesServicesTestJSON-755939763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6cbad8e4-7f21-4c2d-9d03-cbe10abf111b {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:31:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-d0dec851-03f7-4aa2-9ba4-17e2502ff247 tempest-VolumesActionsTest-1301638755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-abd8e68c-e69a-45c8-812a-0b282600dc3d" returned: 0 in 0.670s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:31:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-d0dec851-03f7-4aa2-9ba4-17e2502ff247 tempest-VolumesActionsTest-1301638755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-abd8e68c-e69a-45c8-812a-0b282600dc3d {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:31:49 devstack sudo[99258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6cbad8e4-7f21-4c2d-9d03-cbe10abf111b Sep 28 09:31:49 devstack sudo[99258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:31:49 devstack sudo[99259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-abd8e68c-e69a-45c8-812a-0b282600dc3d Sep 28 09:31:49 devstack sudo[99259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:31:49 devstack sudo[99259]: pam_unix(sudo:session): session closed for user root Sep 28 09:31:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-d0dec851-03f7-4aa2-9ba4-17e2502ff247 tempest-VolumesActionsTest-1301638755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-abd8e68c-e69a-45c8-812a-0b282600dc3d" returned: 0 in 0.329s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:31:49 devstack sudo[99258]: pam_unix(sudo:session): session closed for user root Sep 28 09:31:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-517bb34f-8f3a-4ab0-b0cf-a620c05a4b6e tempest-VolumesServicesTestJSON-755939763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6cbad8e4-7f21-4c2d-9d03-cbe10abf111b" returned: 0 in 0.381s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:31:49 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-517bb34f-8f3a-4ab0-b0cf-a620c05a4b6e tempest-VolumesServicesTestJSON-755939763 None] <== create_volume: return (1155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:31:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-517bb34f-8f3a-4ab0-b0cf-a620c05a4b6e tempest-VolumesServicesTestJSON-755939763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.157s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:31:49 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-d0dec851-03f7-4aa2-9ba4-17e2502ff247 tempest-VolumesActionsTest-1301638755 None] Lock "cinder-quobyte-abd8e68c-e69a-45c8-812a-0b282600dc3d" released by "delete_volume" :: held 1.086s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:31:49 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-517bb34f-8f3a-4ab0-b0cf-a620c05a4b6e tempest-VolumesServicesTestJSON-755939763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfbddbc2-3687-4589-b38f-3ee5694c25a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cbad8e4-7f21-4c2d-9d03-cbe10abf111b', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:31:49 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-517bb34f-8f3a-4ab0-b0cf-a620c05a4b6e tempest-VolumesServicesTestJSON-755939763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12ecac10-48a8-474d-87c0-303075845dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:31:49 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-517bb34f-8f3a-4ab0-b0cf-a620c05a4b6e tempest-VolumesServicesTestJSON-755939763 None] Volume volume-6cbad8e4-7f21-4c2d-9d03-cbe10abf111b (6cbad8e4-7f21-4c2d-9d03-cbe10abf111b): created successfully Sep 28 09:31:49 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-517bb34f-8f3a-4ab0-b0cf-a620c05a4b6e tempest-VolumesServicesTestJSON-755939763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12ecac10-48a8-474d-87c0-303075845dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:31:49 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-517bb34f-8f3a-4ab0-b0cf-a620c05a4b6e tempest-VolumesServicesTestJSON-755939763 None] Flow 'volume_create_manager' (4987a03a-0d33-40c2-97d4-bcc8ed90d0a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:31:49 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-517bb34f-8f3a-4ab0-b0cf-a620c05a4b6e tempest-VolumesServicesTestJSON-755939763 None] Created volume successfully. Sep 28 09:31:49 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-d0dec851-03f7-4aa2-9ba4-17e2502ff247 tempest-VolumesActionsTest-1301638755 None] Created reservations ['e3482f36-c6f1-48f4-be07-1ebfdd722259', '0b296b4a-acdb-42fb-acb3-14e98eae110c', 'b52300c2-f7a1-4f48-b9b1-fd43623cb9e4', 'f09a645f-5325-422a-b920-1c370a213a3b'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:31:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-d0dec851-03f7-4aa2-9ba4-17e2502ff247 tempest-VolumesActionsTest-1301638755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:31:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-d0dec851-03f7-4aa2-9ba4-17e2502ff247 tempest-VolumesActionsTest-1301638755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:31:49 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-d0dec851-03f7-4aa2-9ba4-17e2502ff247 tempest-VolumesActionsTest-1301638755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:31:49 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-d0dec851-03f7-4aa2-9ba4-17e2502ff247 tempest-VolumesActionsTest-1301638755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:31:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-d0dec851-03f7-4aa2-9ba4-17e2502ff247 tempest-VolumesActionsTest-1301638755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:31:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-d0dec851-03f7-4aa2-9ba4-17e2502ff247 tempest-VolumesActionsTest-1301638755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:31:49 devstack sudo[99282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:31:49 devstack sudo[99282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:31:50 devstack sudo[99282]: pam_unix(sudo:session): session closed for user root Sep 28 09:31:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-d0dec851-03f7-4aa2-9ba4-17e2502ff247 tempest-VolumesActionsTest-1301638755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.295s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:31:50 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-d0dec851-03f7-4aa2-9ba4-17e2502ff247 tempest-VolumesActionsTest-1301638755 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:31:50 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-d0dec851-03f7-4aa2-9ba4-17e2502ff247 tempest-VolumesActionsTest-1301638755 None] Deleted volume successfully. Sep 28 09:31:50 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-d0dec851-03f7-4aa2-9ba4-17e2502ff247 tempest-VolumesActionsTest-1301638755 None] Lock "cinder-abd8e68c-e69a-45c8-812a-0b282600dc3d-delete_volume" released by "delete_volume" :: held 1.971s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:31:50 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-cd22ae5f-38fa-4010-bdab-4aa6829ee93a tempest-VolumesServicesTestJSON-755939763 None] Acquiring lock "cinder-6cbad8e4-7f21-4c2d-9d03-cbe10abf111b-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:31:50 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-cd22ae5f-38fa-4010-bdab-4aa6829ee93a tempest-VolumesServicesTestJSON-755939763 None] Lock "cinder-6cbad8e4-7f21-4c2d-9d03-cbe10abf111b-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:31:50 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-cd22ae5f-38fa-4010-bdab-4aa6829ee93a tempest-VolumesServicesTestJSON-755939763 None] Acquiring lock "cinder-quobyte-6cbad8e4-7f21-4c2d-9d03-cbe10abf111b" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:31:50 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-cd22ae5f-38fa-4010-bdab-4aa6829ee93a tempest-VolumesServicesTestJSON-755939763 None] Lock "cinder-quobyte-6cbad8e4-7f21-4c2d-9d03-cbe10abf111b" acquired by "delete_volume" :: waited 0.037s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:31:50 devstack cinder-volume[86553]: INFO cinder.volume.manager [req-fbe2a529-1572-4987-84f5-647c0318e94b req-6b6eabdc-1bb5-48b7-afc8-f3a8fb31a928 tempest-TestInstancesWithCinderVolumes-768341847 None] Terminate volume connection completed successfully. Sep 28 09:31:50 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [req-fbe2a529-1572-4987-84f5-647c0318e94b req-6b6eabdc-1bb5-48b7-afc8-f3a8fb31a928 tempest-TestInstancesWithCinderVolumes-768341847 None] Deleting attachment d603fb3c-7cf1-4c74-b004-623998f795df. {{(pid=86553) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 09:31:50 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a9399b-c90a-458b-9b38-aebfbf15f521]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:31:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-cd22ae5f-38fa-4010-bdab-4aa6829ee93a tempest-VolumesServicesTestJSON-755939763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6cbad8e4-7f21-4c2d-9d03-cbe10abf111b {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:31:50 devstack sudo[99292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6cbad8e4-7f21-4c2d-9d03-cbe10abf111b Sep 28 09:31:50 devstack sudo[99292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:31:51 devstack sudo[99292]: pam_unix(sudo:session): session closed for user root Sep 28 09:31:51 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-12e38b64-c036-4de9-a0ce-8cf4e055d8ae tempest-VolumesActionsTest-1060422934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:31:51 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-12e38b64-c036-4de9-a0ce-8cf4e055d8ae tempest-VolumesActionsTest-1060422934 None] Flow 'volume_create_manager' (80b0d61f-1491-4f3d-9abc-e6284937e8ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:31:51 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-12e38b64-c036-4de9-a0ce-8cf4e055d8ae tempest-VolumesActionsTest-1060422934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3417bd9-8969-424e-ad11-5418cd7c04de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:31:51 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-cd22ae5f-38fa-4010-bdab-4aa6829ee93a tempest-VolumesServicesTestJSON-755939763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6cbad8e4-7f21-4c2d-9d03-cbe10abf111b" returned: 0 in 0.615s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:31:51 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-cd22ae5f-38fa-4010-bdab-4aa6829ee93a tempest-VolumesServicesTestJSON-755939763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6cbad8e4-7f21-4c2d-9d03-cbe10abf111b {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:31:51 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-12e38b64-c036-4de9-a0ce-8cf4e055d8ae tempest-VolumesActionsTest-1060422934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3417bd9-8969-424e-ad11-5418cd7c04de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:31:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-162824391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f454f55b-29fc-4dd4-9761-860e2b5df1fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f0af7d2451c49e79c57feeb377a6899',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:31:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:31:51Z,use_quota=True,user_id='54200af1bd5d458ea43817ab6b22c3f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:31:51 devstack sudo[99298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6cbad8e4-7f21-4c2d-9d03-cbe10abf111b Sep 28 09:31:51 devstack sudo[99298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:31:51 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-12e38b64-c036-4de9-a0ce-8cf4e055d8ae tempest-VolumesActionsTest-1060422934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fce3cf1a-2288-4339-baa7-f4a122aef243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:31:51 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-12e38b64-c036-4de9-a0ce-8cf4e055d8ae tempest-VolumesActionsTest-1060422934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fce3cf1a-2288-4339-baa7-f4a122aef243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:31:51 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-12e38b64-c036-4de9-a0ce-8cf4e055d8ae tempest-VolumesActionsTest-1060422934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cc62d66-41ec-421c-ad7f-78daa2ad03ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:31:51 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-12e38b64-c036-4de9-a0ce-8cf4e055d8ae tempest-VolumesActionsTest-1060422934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cc62d66-41ec-421c-ad7f-78daa2ad03ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f454f55b-29fc-4dd4-9761-860e2b5df1fd', 'volume_name': 'volume-f454f55b-29fc-4dd4-9761-860e2b5df1fd', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:31:51 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-12e38b64-c036-4de9-a0ce-8cf4e055d8ae tempest-VolumesActionsTest-1060422934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fe06645-5341-4b6a-8917-af98fcee346d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:31:51 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-12e38b64-c036-4de9-a0ce-8cf4e055d8ae tempest-VolumesActionsTest-1060422934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fe06645-5341-4b6a-8917-af98fcee346d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:31:51 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-12e38b64-c036-4de9-a0ce-8cf4e055d8ae tempest-VolumesActionsTest-1060422934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6697d13c-67a8-4939-bf8d-948aa6bd3903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:31:51 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-12e38b64-c036-4de9-a0ce-8cf4e055d8ae tempest-VolumesActionsTest-1060422934 None] Volume f454f55b-29fc-4dd4-9761-860e2b5df1fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f454f55b-29fc-4dd4-9761-860e2b5df1fd', 'volume_size': 1} Sep 28 09:31:51 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-12e38b64-c036-4de9-a0ce-8cf4e055d8ae tempest-VolumesActionsTest-1060422934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:31:51 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-12e38b64-c036-4de9-a0ce-8cf4e055d8ae tempest-VolumesActionsTest-1060422934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:31:51 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-12e38b64-c036-4de9-a0ce-8cf4e055d8ae tempest-VolumesActionsTest-1060422934 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:31:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-162824391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f454f55b-29fc-4dd4-9761-860e2b5df1fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f0af7d2451c49e79c57feeb377a6899',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:31:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:31:51Z,use_quota=True,user_id='54200af1bd5d458ea43817ab6b22c3f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:31:51 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-12e38b64-c036-4de9-a0ce-8cf4e055d8ae tempest-VolumesActionsTest-1060422934 None] Creating volume f454f55b-29fc-4dd4-9761-860e2b5df1fd {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:31:51 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-12e38b64-c036-4de9-a0ce-8cf4e055d8ae tempest-VolumesActionsTest-1060422934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:31:51 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-12e38b64-c036-4de9-a0ce-8cf4e055d8ae tempest-VolumesActionsTest-1060422934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:31:51 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-12e38b64-c036-4de9-a0ce-8cf4e055d8ae tempest-VolumesActionsTest-1060422934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:31:51 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-12e38b64-c036-4de9-a0ce-8cf4e055d8ae tempest-VolumesActionsTest-1060422934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:31:51 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-12e38b64-c036-4de9-a0ce-8cf4e055d8ae tempest-VolumesActionsTest-1060422934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:31:51 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-12e38b64-c036-4de9-a0ce-8cf4e055d8ae tempest-VolumesActionsTest-1060422934 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:31:51 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-12e38b64-c036-4de9-a0ce-8cf4e055d8ae tempest-VolumesActionsTest-1060422934 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:31:51 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-12e38b64-c036-4de9-a0ce-8cf4e055d8ae tempest-VolumesActionsTest-1060422934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f454f55b-29fc-4dd4-9761-860e2b5df1fd 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:31:51 devstack sudo[99300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f454f55b-29fc-4dd4-9761-860e2b5df1fd 1073741824 Sep 28 09:31:51 devstack sudo[99300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:31:51 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-a30b8dda-18eb-4a9e-99b1-9a9f88f62da3 tempest-TestInstancesWithCinderVolumes-768341847 None] Acquiring lock "cinder-3f00318e-6c8c-415b-a51a-08197b883b08-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:31:51 devstack sudo[99298]: pam_unix(sudo:session): session closed for user root Sep 28 09:31:51 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-cd22ae5f-38fa-4010-bdab-4aa6829ee93a tempest-VolumesServicesTestJSON-755939763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6cbad8e4-7f21-4c2d-9d03-cbe10abf111b" returned: 0 in 0.370s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:31:51 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-a30b8dda-18eb-4a9e-99b1-9a9f88f62da3 tempest-TestInstancesWithCinderVolumes-768341847 None] Lock "cinder-3f00318e-6c8c-415b-a51a-08197b883b08-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:31:51 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-cd22ae5f-38fa-4010-bdab-4aa6829ee93a tempest-VolumesServicesTestJSON-755939763 None] Lock "cinder-quobyte-6cbad8e4-7f21-4c2d-9d03-cbe10abf111b" released by "delete_volume" :: held 1.062s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:31:51 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-a30b8dda-18eb-4a9e-99b1-9a9f88f62da3 tempest-TestInstancesWithCinderVolumes-768341847 None] Acquiring lock "cinder-quobyte-3f00318e-6c8c-415b-a51a-08197b883b08" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:31:51 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-a30b8dda-18eb-4a9e-99b1-9a9f88f62da3 tempest-TestInstancesWithCinderVolumes-768341847 None] Lock "cinder-quobyte-3f00318e-6c8c-415b-a51a-08197b883b08" acquired by "delete_volume" :: waited 0.028s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:31:51 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[3995c7c7-046b-46d6-98ab-fe6ea7dbfebc]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:31:51 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a30b8dda-18eb-4a9e-99b1-9a9f88f62da3 tempest-TestInstancesWithCinderVolumes-768341847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3f00318e-6c8c-415b-a51a-08197b883b08 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:31:51 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-cd22ae5f-38fa-4010-bdab-4aa6829ee93a tempest-VolumesServicesTestJSON-755939763 None] Created reservations ['b119b671-40ba-4813-9235-0dfeb2c87c38', 'c8918e28-4deb-4c59-b786-2c50131f4b2a', '7623af2d-bf74-4e84-9cc0-bb18cb83599d', '6aa25e8e-e19c-4b3a-a9bf-50c7a00430b7'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:31:52 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-cd22ae5f-38fa-4010-bdab-4aa6829ee93a tempest-VolumesServicesTestJSON-755939763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:31:52 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-cd22ae5f-38fa-4010-bdab-4aa6829ee93a tempest-VolumesServicesTestJSON-755939763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:31:52 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-cd22ae5f-38fa-4010-bdab-4aa6829ee93a tempest-VolumesServicesTestJSON-755939763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:31:52 devstack sudo[99306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3f00318e-6c8c-415b-a51a-08197b883b08 Sep 28 09:31:52 devstack sudo[99306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:31:52 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-cd22ae5f-38fa-4010-bdab-4aa6829ee93a tempest-VolumesServicesTestJSON-755939763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:31:52 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-cd22ae5f-38fa-4010-bdab-4aa6829ee93a tempest-VolumesServicesTestJSON-755939763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:31:52 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-cd22ae5f-38fa-4010-bdab-4aa6829ee93a tempest-VolumesServicesTestJSON-755939763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:31:52 devstack sudo[99309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:31:52 devstack sudo[99309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:31:52 devstack sudo[99300]: pam_unix(sudo:session): session closed for user root Sep 28 09:31:52 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-12e38b64-c036-4de9-a0ce-8cf4e055d8ae tempest-VolumesActionsTest-1060422934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f454f55b-29fc-4dd4-9761-860e2b5df1fd 1073741824" returned: 0 in 0.678s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:31:52 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-12e38b64-c036-4de9-a0ce-8cf4e055d8ae tempest-VolumesActionsTest-1060422934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f454f55b-29fc-4dd4-9761-860e2b5df1fd {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:31:52 devstack sudo[99311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f454f55b-29fc-4dd4-9761-860e2b5df1fd Sep 28 09:31:52 devstack sudo[99311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:31:52 devstack sudo[99309]: pam_unix(sudo:session): session closed for user root Sep 28 09:31:52 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-cd22ae5f-38fa-4010-bdab-4aa6829ee93a tempest-VolumesServicesTestJSON-755939763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.307s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:31:52 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-cd22ae5f-38fa-4010-bdab-4aa6829ee93a tempest-VolumesServicesTestJSON-755939763 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:31:52 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-cd22ae5f-38fa-4010-bdab-4aa6829ee93a tempest-VolumesServicesTestJSON-755939763 None] Deleted volume successfully. Sep 28 09:31:52 devstack sudo[99306]: pam_unix(sudo:session): session closed for user root Sep 28 09:31:52 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a30b8dda-18eb-4a9e-99b1-9a9f88f62da3 tempest-TestInstancesWithCinderVolumes-768341847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3f00318e-6c8c-415b-a51a-08197b883b08" returned: 0 in 0.523s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:31:52 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a30b8dda-18eb-4a9e-99b1-9a9f88f62da3 tempest-TestInstancesWithCinderVolumes-768341847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3f00318e-6c8c-415b-a51a-08197b883b08 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:31:52 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-cd22ae5f-38fa-4010-bdab-4aa6829ee93a tempest-VolumesServicesTestJSON-755939763 None] Lock "cinder-6cbad8e4-7f21-4c2d-9d03-cbe10abf111b-delete_volume" released by "delete_volume" :: held 1.851s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:31:52 devstack sudo[99318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3f00318e-6c8c-415b-a51a-08197b883b08 Sep 28 09:31:52 devstack sudo[99318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:31:52 devstack sudo[99311]: pam_unix(sudo:session): session closed for user root Sep 28 09:31:52 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-12e38b64-c036-4de9-a0ce-8cf4e055d8ae tempest-VolumesActionsTest-1060422934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f454f55b-29fc-4dd4-9761-860e2b5df1fd" returned: 0 in 0.317s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:31:52 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-12e38b64-c036-4de9-a0ce-8cf4e055d8ae tempest-VolumesActionsTest-1060422934 None] <== create_volume: return (1046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:31:52 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-12e38b64-c036-4de9-a0ce-8cf4e055d8ae tempest-VolumesActionsTest-1060422934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:31:52 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-12e38b64-c036-4de9-a0ce-8cf4e055d8ae tempest-VolumesActionsTest-1060422934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6697d13c-67a8-4939-bf8d-948aa6bd3903) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f454f55b-29fc-4dd4-9761-860e2b5df1fd', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:31:52 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-12e38b64-c036-4de9-a0ce-8cf4e055d8ae tempest-VolumesActionsTest-1060422934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (664afae3-7be9-4297-b1f1-c70e090f0913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:31:52 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-12e38b64-c036-4de9-a0ce-8cf4e055d8ae tempest-VolumesActionsTest-1060422934 None] Volume volume-f454f55b-29fc-4dd4-9761-860e2b5df1fd (f454f55b-29fc-4dd4-9761-860e2b5df1fd): created successfully Sep 28 09:31:52 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-12e38b64-c036-4de9-a0ce-8cf4e055d8ae tempest-VolumesActionsTest-1060422934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (664afae3-7be9-4297-b1f1-c70e090f0913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:31:52 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-12e38b64-c036-4de9-a0ce-8cf4e055d8ae tempest-VolumesActionsTest-1060422934 None] Flow 'volume_create_manager' (80b0d61f-1491-4f3d-9abc-e6284937e8ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:31:52 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-12e38b64-c036-4de9-a0ce-8cf4e055d8ae tempest-VolumesActionsTest-1060422934 None] Created volume successfully. Sep 28 09:31:52 devstack sudo[99318]: pam_unix(sudo:session): session closed for user root Sep 28 09:31:52 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a30b8dda-18eb-4a9e-99b1-9a9f88f62da3 tempest-TestInstancesWithCinderVolumes-768341847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3f00318e-6c8c-415b-a51a-08197b883b08" returned: 0 in 0.294s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:31:52 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-a30b8dda-18eb-4a9e-99b1-9a9f88f62da3 tempest-TestInstancesWithCinderVolumes-768341847 None] Lock "cinder-quobyte-3f00318e-6c8c-415b-a51a-08197b883b08" released by "delete_volume" :: held 0.872s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:31:52 devstack cinder-volume[86553]: WARNING cinder.quota [None req-a30b8dda-18eb-4a9e-99b1-9a9f88f62da3 tempest-TestInstancesWithCinderVolumes-768341847 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1792618817-578927494 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1792618817-578927494, it is now deprecated. Please use the default quota class for default quota. Sep 28 09:31:52 devstack cinder-volume[86553]: WARNING cinder.quota [None req-a30b8dda-18eb-4a9e-99b1-9a9f88f62da3 tempest-TestInstancesWithCinderVolumes-768341847 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1792618817-578927494 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1792618817-578927494, it is now deprecated. Please use the default quota class for default quota. Sep 28 09:31:52 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-a30b8dda-18eb-4a9e-99b1-9a9f88f62da3 tempest-TestInstancesWithCinderVolumes-768341847 None] Created reservations ['afb341fa-019b-4df5-9c5b-0084193a258a', 'b8cf9b41-67e1-4219-a796-4d61f6b33bf9', 'b1ab9ce0-3f88-4e1c-807c-4e3ecb1abce3', 'a31b11c0-f459-415b-b164-07133a101cd5'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:31:52 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-a30b8dda-18eb-4a9e-99b1-9a9f88f62da3 tempest-TestInstancesWithCinderVolumes-768341847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:31:52 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-a30b8dda-18eb-4a9e-99b1-9a9f88f62da3 tempest-TestInstancesWithCinderVolumes-768341847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:31:52 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-a30b8dda-18eb-4a9e-99b1-9a9f88f62da3 tempest-TestInstancesWithCinderVolumes-768341847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:31:52 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-a30b8dda-18eb-4a9e-99b1-9a9f88f62da3 tempest-TestInstancesWithCinderVolumes-768341847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:31:52 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-a30b8dda-18eb-4a9e-99b1-9a9f88f62da3 tempest-TestInstancesWithCinderVolumes-768341847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:31:52 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a30b8dda-18eb-4a9e-99b1-9a9f88f62da3 tempest-TestInstancesWithCinderVolumes-768341847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:31:52 devstack sudo[99322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:31:52 devstack sudo[99322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:31:53 devstack sudo[99322]: pam_unix(sudo:session): session closed for user root Sep 28 09:31:53 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a30b8dda-18eb-4a9e-99b1-9a9f88f62da3 tempest-TestInstancesWithCinderVolumes-768341847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.330s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:31:53 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-a30b8dda-18eb-4a9e-99b1-9a9f88f62da3 tempest-TestInstancesWithCinderVolumes-768341847 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:31:53 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-a30b8dda-18eb-4a9e-99b1-9a9f88f62da3 tempest-TestInstancesWithCinderVolumes-768341847 None] Deleted volume successfully. Sep 28 09:31:53 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-a30b8dda-18eb-4a9e-99b1-9a9f88f62da3 tempest-TestInstancesWithCinderVolumes-768341847 None] Lock "cinder-3f00318e-6c8c-415b-a51a-08197b883b08-delete_volume" released by "delete_volume" :: held 1.506s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:31:53 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-d698a0dd-3b9c-4371-bc0a-cd14f9085401 tempest-VolumesActionsTest-1301638755 None] Acquiring lock "cinder-f454f55b-29fc-4dd4-9761-860e2b5df1fd-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:31:53 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-d698a0dd-3b9c-4371-bc0a-cd14f9085401 tempest-VolumesActionsTest-1301638755 None] Lock "cinder-f454f55b-29fc-4dd4-9761-860e2b5df1fd-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:31:53 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-d698a0dd-3b9c-4371-bc0a-cd14f9085401 tempest-VolumesActionsTest-1301638755 None] Acquiring lock "cinder-quobyte-f454f55b-29fc-4dd4-9761-860e2b5df1fd" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:31:53 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-d698a0dd-3b9c-4371-bc0a-cd14f9085401 tempest-VolumesActionsTest-1301638755 None] Lock "cinder-quobyte-f454f55b-29fc-4dd4-9761-860e2b5df1fd" acquired by "delete_volume" :: waited 0.024s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:31:53 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e2c2cf6-f1aa-4d1a-8561-475cefe69cab]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:31:53 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-d698a0dd-3b9c-4371-bc0a-cd14f9085401 tempest-VolumesActionsTest-1301638755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f454f55b-29fc-4dd4-9761-860e2b5df1fd {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:31:53 devstack sudo[99325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f454f55b-29fc-4dd4-9761-860e2b5df1fd Sep 28 09:31:53 devstack sudo[99325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:31:54 devstack sudo[99325]: pam_unix(sudo:session): session closed for user root Sep 28 09:31:54 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-d698a0dd-3b9c-4371-bc0a-cd14f9085401 tempest-VolumesActionsTest-1301638755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f454f55b-29fc-4dd4-9761-860e2b5df1fd" returned: 0 in 0.470s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:31:54 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-d698a0dd-3b9c-4371-bc0a-cd14f9085401 tempest-VolumesActionsTest-1301638755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f454f55b-29fc-4dd4-9761-860e2b5df1fd {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:31:54 devstack sudo[99330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f454f55b-29fc-4dd4-9761-860e2b5df1fd Sep 28 09:31:54 devstack sudo[99330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:31:54 devstack sudo[99330]: pam_unix(sudo:session): session closed for user root Sep 28 09:31:54 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-d698a0dd-3b9c-4371-bc0a-cd14f9085401 tempest-VolumesActionsTest-1301638755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f454f55b-29fc-4dd4-9761-860e2b5df1fd" returned: 0 in 0.303s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:31:54 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-d698a0dd-3b9c-4371-bc0a-cd14f9085401 tempest-VolumesActionsTest-1301638755 None] Lock "cinder-quobyte-f454f55b-29fc-4dd4-9761-860e2b5df1fd" released by "delete_volume" :: held 0.852s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:31:54 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-d698a0dd-3b9c-4371-bc0a-cd14f9085401 tempest-VolumesActionsTest-1301638755 None] Created reservations ['3bee018c-1916-4c36-b518-1dc301ef8b31', '75e325aa-0d01-4075-8a93-e19dd64c247b', '0e328da5-ce35-492a-b26c-63d2abd38ab9', '21272e41-a673-420c-96df-08f985bca8aa'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:31:54 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-d698a0dd-3b9c-4371-bc0a-cd14f9085401 tempest-VolumesActionsTest-1301638755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:31:54 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-d698a0dd-3b9c-4371-bc0a-cd14f9085401 tempest-VolumesActionsTest-1301638755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:31:54 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-d698a0dd-3b9c-4371-bc0a-cd14f9085401 tempest-VolumesActionsTest-1301638755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:31:54 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-d698a0dd-3b9c-4371-bc0a-cd14f9085401 tempest-VolumesActionsTest-1301638755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:31:54 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-d698a0dd-3b9c-4371-bc0a-cd14f9085401 tempest-VolumesActionsTest-1301638755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:31:54 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-d698a0dd-3b9c-4371-bc0a-cd14f9085401 tempest-VolumesActionsTest-1301638755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:31:54 devstack sudo[99333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:31:54 devstack sudo[99333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:31:55 devstack sudo[99333]: pam_unix(sudo:session): session closed for user root Sep 28 09:31:55 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-d698a0dd-3b9c-4371-bc0a-cd14f9085401 tempest-VolumesActionsTest-1301638755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.418s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:31:55 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-d698a0dd-3b9c-4371-bc0a-cd14f9085401 tempest-VolumesActionsTest-1301638755 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:31:55 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-d698a0dd-3b9c-4371-bc0a-cd14f9085401 tempest-VolumesActionsTest-1301638755 None] Deleted volume successfully. Sep 28 09:31:55 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-d698a0dd-3b9c-4371-bc0a-cd14f9085401 tempest-VolumesActionsTest-1301638755 None] Lock "cinder-f454f55b-29fc-4dd4-9761-860e2b5df1fd-delete_volume" released by "delete_volume" :: held 1.613s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:31:55 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-c47f6c0e-a4af-43c8-8eca-7efef31c926d tempest-VolumesActionsTest-1060422934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:31:55 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-c47f6c0e-a4af-43c8-8eca-7efef31c926d tempest-VolumesActionsTest-1060422934 None] Flow 'volume_create_manager' (c80dd643-14fd-4e59-bd9a-14d6338b62b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:31:55 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-c47f6c0e-a4af-43c8-8eca-7efef31c926d tempest-VolumesActionsTest-1060422934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (befed33b-c9ee-4b15-af0d-13156b582d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:31:55 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-c47f6c0e-a4af-43c8-8eca-7efef31c926d tempest-VolumesActionsTest-1060422934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (befed33b-c9ee-4b15-af0d-13156b582d95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:31:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1732809792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d2214a0-267e-4d3e-849a-1459d12563a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f0af7d2451c49e79c57feeb377a6899',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:31:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:31:56Z,use_quota=True,user_id='54200af1bd5d458ea43817ab6b22c3f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:31:55 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-c47f6c0e-a4af-43c8-8eca-7efef31c926d tempest-VolumesActionsTest-1060422934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d041b6ff-66b2-4c8d-9cf9-707ff5c0ca93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:31:55 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-c47f6c0e-a4af-43c8-8eca-7efef31c926d tempest-VolumesActionsTest-1060422934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d041b6ff-66b2-4c8d-9cf9-707ff5c0ca93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:31:55 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-c47f6c0e-a4af-43c8-8eca-7efef31c926d tempest-VolumesActionsTest-1060422934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0b2b1d9-08fd-4c4e-ac5f-05756a03d334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:31:55 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-c47f6c0e-a4af-43c8-8eca-7efef31c926d tempest-VolumesActionsTest-1060422934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0b2b1d9-08fd-4c4e-ac5f-05756a03d334) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d2214a0-267e-4d3e-849a-1459d12563a3', 'volume_name': 'volume-2d2214a0-267e-4d3e-849a-1459d12563a3', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:31:55 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-c47f6c0e-a4af-43c8-8eca-7efef31c926d tempest-VolumesActionsTest-1060422934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c41b2e1f-84ef-459c-bd9f-04cf5e2803e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:31:55 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-c47f6c0e-a4af-43c8-8eca-7efef31c926d tempest-VolumesActionsTest-1060422934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c41b2e1f-84ef-459c-bd9f-04cf5e2803e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:31:55 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-c47f6c0e-a4af-43c8-8eca-7efef31c926d tempest-VolumesActionsTest-1060422934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c354c80-9f08-4e60-a592-27e8e2e57565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:31:55 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-c47f6c0e-a4af-43c8-8eca-7efef31c926d tempest-VolumesActionsTest-1060422934 None] Volume 2d2214a0-267e-4d3e-849a-1459d12563a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d2214a0-267e-4d3e-849a-1459d12563a3', 'volume_size': 1} Sep 28 09:31:55 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-c47f6c0e-a4af-43c8-8eca-7efef31c926d tempest-VolumesActionsTest-1060422934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:31:55 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-c47f6c0e-a4af-43c8-8eca-7efef31c926d tempest-VolumesActionsTest-1060422934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:31:55 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-c47f6c0e-a4af-43c8-8eca-7efef31c926d tempest-VolumesActionsTest-1060422934 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:31:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1732809792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d2214a0-267e-4d3e-849a-1459d12563a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f0af7d2451c49e79c57feeb377a6899',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:31:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:31:56Z,use_quota=True,user_id='54200af1bd5d458ea43817ab6b22c3f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:31:55 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-c47f6c0e-a4af-43c8-8eca-7efef31c926d tempest-VolumesActionsTest-1060422934 None] Creating volume 2d2214a0-267e-4d3e-849a-1459d12563a3 {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:31:55 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-c47f6c0e-a4af-43c8-8eca-7efef31c926d tempest-VolumesActionsTest-1060422934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:31:55 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-c47f6c0e-a4af-43c8-8eca-7efef31c926d tempest-VolumesActionsTest-1060422934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:31:55 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-c47f6c0e-a4af-43c8-8eca-7efef31c926d tempest-VolumesActionsTest-1060422934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:31:55 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-c47f6c0e-a4af-43c8-8eca-7efef31c926d tempest-VolumesActionsTest-1060422934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:31:55 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-c47f6c0e-a4af-43c8-8eca-7efef31c926d tempest-VolumesActionsTest-1060422934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:31:55 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-c47f6c0e-a4af-43c8-8eca-7efef31c926d tempest-VolumesActionsTest-1060422934 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:31:55 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-c47f6c0e-a4af-43c8-8eca-7efef31c926d tempest-VolumesActionsTest-1060422934 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:31:55 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c47f6c0e-a4af-43c8-8eca-7efef31c926d tempest-VolumesActionsTest-1060422934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-2d2214a0-267e-4d3e-849a-1459d12563a3 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:31:55 devstack sudo[99336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-2d2214a0-267e-4d3e-849a-1459d12563a3 1073741824 Sep 28 09:31:55 devstack sudo[99336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:31:56 devstack sudo[99336]: pam_unix(sudo:session): session closed for user root Sep 28 09:31:56 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c47f6c0e-a4af-43c8-8eca-7efef31c926d tempest-VolumesActionsTest-1060422934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-2d2214a0-267e-4d3e-849a-1459d12563a3 1073741824" returned: 0 in 0.565s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:31:56 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c47f6c0e-a4af-43c8-8eca-7efef31c926d tempest-VolumesActionsTest-1060422934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-2d2214a0-267e-4d3e-849a-1459d12563a3 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:31:56 devstack sudo[99343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-2d2214a0-267e-4d3e-849a-1459d12563a3 Sep 28 09:31:56 devstack sudo[99343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:31:56 devstack sudo[99343]: pam_unix(sudo:session): session closed for user root Sep 28 09:31:56 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c47f6c0e-a4af-43c8-8eca-7efef31c926d tempest-VolumesActionsTest-1060422934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-2d2214a0-267e-4d3e-849a-1459d12563a3" returned: 0 in 0.387s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:31:56 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-c47f6c0e-a4af-43c8-8eca-7efef31c926d tempest-VolumesActionsTest-1060422934 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:31:56 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-c47f6c0e-a4af-43c8-8eca-7efef31c926d tempest-VolumesActionsTest-1060422934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:31:56 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-c47f6c0e-a4af-43c8-8eca-7efef31c926d tempest-VolumesActionsTest-1060422934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c354c80-9f08-4e60-a592-27e8e2e57565) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d2214a0-267e-4d3e-849a-1459d12563a3', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:31:56 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-c47f6c0e-a4af-43c8-8eca-7efef31c926d tempest-VolumesActionsTest-1060422934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c337067-65ca-4e15-9e00-2498d907c82f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:31:56 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-c47f6c0e-a4af-43c8-8eca-7efef31c926d tempest-VolumesActionsTest-1060422934 None] Volume volume-2d2214a0-267e-4d3e-849a-1459d12563a3 (2d2214a0-267e-4d3e-849a-1459d12563a3): created successfully Sep 28 09:31:56 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-c47f6c0e-a4af-43c8-8eca-7efef31c926d tempest-VolumesActionsTest-1060422934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c337067-65ca-4e15-9e00-2498d907c82f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:31:56 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-c47f6c0e-a4af-43c8-8eca-7efef31c926d tempest-VolumesActionsTest-1060422934 None] Flow 'volume_create_manager' (c80dd643-14fd-4e59-bd9a-14d6338b62b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:31:56 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-c47f6c0e-a4af-43c8-8eca-7efef31c926d tempest-VolumesActionsTest-1060422934 None] Created volume successfully. Sep 28 09:31:58 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-e4d1467d-c3ae-4ae3-bd5e-0a71edb77a76 tempest-VolumesActionsTest-1060422934 None] Acquiring lock "cinder-2d2214a0-267e-4d3e-849a-1459d12563a3-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:31:58 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-e4d1467d-c3ae-4ae3-bd5e-0a71edb77a76 tempest-VolumesActionsTest-1060422934 None] Lock "cinder-2d2214a0-267e-4d3e-849a-1459d12563a3-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:31:58 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-e4d1467d-c3ae-4ae3-bd5e-0a71edb77a76 tempest-VolumesActionsTest-1060422934 None] Acquiring lock "cinder-quobyte-2d2214a0-267e-4d3e-849a-1459d12563a3" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:31:58 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-e4d1467d-c3ae-4ae3-bd5e-0a71edb77a76 tempest-VolumesActionsTest-1060422934 None] Lock "cinder-quobyte-2d2214a0-267e-4d3e-849a-1459d12563a3" acquired by "delete_volume" :: waited 0.023s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:31:58 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e55992d-4f0f-47a9-9954-daf73f2b2cba]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:31:58 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e4d1467d-c3ae-4ae3-bd5e-0a71edb77a76 tempest-VolumesActionsTest-1060422934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-2d2214a0-267e-4d3e-849a-1459d12563a3 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:31:58 devstack sudo[99348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-2d2214a0-267e-4d3e-849a-1459d12563a3 Sep 28 09:31:58 devstack sudo[99348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:31:59 devstack sudo[99348]: pam_unix(sudo:session): session closed for user root Sep 28 09:31:59 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e4d1467d-c3ae-4ae3-bd5e-0a71edb77a76 tempest-VolumesActionsTest-1060422934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-2d2214a0-267e-4d3e-849a-1459d12563a3" returned: 0 in 0.569s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:31:59 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e4d1467d-c3ae-4ae3-bd5e-0a71edb77a76 tempest-VolumesActionsTest-1060422934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-2d2214a0-267e-4d3e-849a-1459d12563a3 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:31:59 devstack sudo[99353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-2d2214a0-267e-4d3e-849a-1459d12563a3 Sep 28 09:31:59 devstack sudo[99353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:31:59 devstack sudo[99353]: pam_unix(sudo:session): session closed for user root Sep 28 09:31:59 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e4d1467d-c3ae-4ae3-bd5e-0a71edb77a76 tempest-VolumesActionsTest-1060422934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-2d2214a0-267e-4d3e-849a-1459d12563a3" returned: 0 in 0.349s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:31:59 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-e4d1467d-c3ae-4ae3-bd5e-0a71edb77a76 tempest-VolumesActionsTest-1060422934 None] Lock "cinder-quobyte-2d2214a0-267e-4d3e-849a-1459d12563a3" released by "delete_volume" :: held 0.984s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:31:59 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-e4d1467d-c3ae-4ae3-bd5e-0a71edb77a76 tempest-VolumesActionsTest-1060422934 None] Created reservations ['745d256a-d53b-44fe-8348-a79642eb7076', 'a1217bc7-eb0c-4f11-8f3a-ac418a7a7551', '98121dd4-a344-483e-90f1-889d94d4fa13', '34d443e7-78c6-4d7d-974e-3082b04bf3fe'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:31:59 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-e4d1467d-c3ae-4ae3-bd5e-0a71edb77a76 tempest-VolumesActionsTest-1060422934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:31:59 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-e4d1467d-c3ae-4ae3-bd5e-0a71edb77a76 tempest-VolumesActionsTest-1060422934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:31:59 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-e4d1467d-c3ae-4ae3-bd5e-0a71edb77a76 tempest-VolumesActionsTest-1060422934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:31:59 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-e4d1467d-c3ae-4ae3-bd5e-0a71edb77a76 tempest-VolumesActionsTest-1060422934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:31:59 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-e4d1467d-c3ae-4ae3-bd5e-0a71edb77a76 tempest-VolumesActionsTest-1060422934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:31:59 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e4d1467d-c3ae-4ae3-bd5e-0a71edb77a76 tempest-VolumesActionsTest-1060422934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:31:59 devstack sudo[99357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:31:59 devstack sudo[99357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:32:00 devstack sudo[99357]: pam_unix(sudo:session): session closed for user root Sep 28 09:32:00 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e4d1467d-c3ae-4ae3-bd5e-0a71edb77a76 tempest-VolumesActionsTest-1060422934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.354s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:32:00 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-e4d1467d-c3ae-4ae3-bd5e-0a71edb77a76 tempest-VolumesActionsTest-1060422934 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:32:00 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-e4d1467d-c3ae-4ae3-bd5e-0a71edb77a76 tempest-VolumesActionsTest-1060422934 None] Deleted volume successfully. Sep 28 09:32:00 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-e4d1467d-c3ae-4ae3-bd5e-0a71edb77a76 tempest-VolumesActionsTest-1060422934 None] Lock "cinder-2d2214a0-267e-4d3e-849a-1459d12563a3-delete_volume" released by "delete_volume" :: held 1.701s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:32:02 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-f82f79a9-dc09-47cf-8821-f6d8f9c8fc5c tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:32:02 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-f82f79a9-dc09-47cf-8821-f6d8f9c8fc5c tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] Flow 'volume_create_manager' (5006f063-443a-4775-8c66-77c657397fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:32:02 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-f82f79a9-dc09-47cf-8821-f6d8f9c8fc5c tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4fe2b36-d2db-4ce6-acb8-74ebc79f416f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:32:02 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-f82f79a9-dc09-47cf-8821-f6d8f9c8fc5c tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4fe2b36-d2db-4ce6-acb8-74ebc79f416f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:32:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1827044716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cd02e97-585d-40ee-9a73-4024af9b64ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0772e8961ded4bc9a378c264ec83b684',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:32:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:32:02Z,use_quota=True,user_id='6eee5e87a29e4a85803d1452cde1a8e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:32:02 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-f82f79a9-dc09-47cf-8821-f6d8f9c8fc5c tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f9d4ef5-91d3-4148-ad85-bb1ce2ccfa38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:32:02 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-f82f79a9-dc09-47cf-8821-f6d8f9c8fc5c tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f9d4ef5-91d3-4148-ad85-bb1ce2ccfa38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:32:02 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-f82f79a9-dc09-47cf-8821-f6d8f9c8fc5c tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fff9db0-2a8e-41dd-b572-f5bc16a7673b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:32:02 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-f82f79a9-dc09-47cf-8821-f6d8f9c8fc5c tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fff9db0-2a8e-41dd-b572-f5bc16a7673b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3cd02e97-585d-40ee-9a73-4024af9b64ec', 'volume_name': 'volume-3cd02e97-585d-40ee-9a73-4024af9b64ec', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:32:02 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-f82f79a9-dc09-47cf-8821-f6d8f9c8fc5c tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1dab1d2-5615-4e52-b913-1444eec08b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:32:02 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-f82f79a9-dc09-47cf-8821-f6d8f9c8fc5c tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1dab1d2-5615-4e52-b913-1444eec08b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:32:02 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-f82f79a9-dc09-47cf-8821-f6d8f9c8fc5c tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9181e330-bb46-4fd6-a0f2-0bc8dc18ebbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:32:02 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-f82f79a9-dc09-47cf-8821-f6d8f9c8fc5c tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] Volume 3cd02e97-585d-40ee-9a73-4024af9b64ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3cd02e97-585d-40ee-9a73-4024af9b64ec', 'volume_size': 1} Sep 28 09:32:02 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-f82f79a9-dc09-47cf-8821-f6d8f9c8fc5c tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:32:02 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-f82f79a9-dc09-47cf-8821-f6d8f9c8fc5c tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:32:02 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-f82f79a9-dc09-47cf-8821-f6d8f9c8fc5c tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:32:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1827044716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cd02e97-585d-40ee-9a73-4024af9b64ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0772e8961ded4bc9a378c264ec83b684',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:32:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:32:02Z,use_quota=True,user_id='6eee5e87a29e4a85803d1452cde1a8e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:32:02 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-f82f79a9-dc09-47cf-8821-f6d8f9c8fc5c tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] Creating volume 3cd02e97-585d-40ee-9a73-4024af9b64ec {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:32:02 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-f82f79a9-dc09-47cf-8821-f6d8f9c8fc5c tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:32:02 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-f82f79a9-dc09-47cf-8821-f6d8f9c8fc5c tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:32:02 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-f82f79a9-dc09-47cf-8821-f6d8f9c8fc5c tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:32:02 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-f82f79a9-dc09-47cf-8821-f6d8f9c8fc5c tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:32:02 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-f82f79a9-dc09-47cf-8821-f6d8f9c8fc5c tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:32:02 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-f82f79a9-dc09-47cf-8821-f6d8f9c8fc5c tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:32:02 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-f82f79a9-dc09-47cf-8821-f6d8f9c8fc5c tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:32:02 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f82f79a9-dc09-47cf-8821-f6d8f9c8fc5c tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3cd02e97-585d-40ee-9a73-4024af9b64ec 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:32:02 devstack sudo[99363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3cd02e97-585d-40ee-9a73-4024af9b64ec 1073741824 Sep 28 09:32:02 devstack sudo[99363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:32:02 devstack sudo[99363]: pam_unix(sudo:session): session closed for user root Sep 28 09:32:03 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f82f79a9-dc09-47cf-8821-f6d8f9c8fc5c tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3cd02e97-585d-40ee-9a73-4024af9b64ec 1073741824" returned: 0 in 0.625s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:32:03 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f82f79a9-dc09-47cf-8821-f6d8f9c8fc5c tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3cd02e97-585d-40ee-9a73-4024af9b64ec {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:32:03 devstack sudo[99370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3cd02e97-585d-40ee-9a73-4024af9b64ec Sep 28 09:32:03 devstack sudo[99370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:32:03 devstack sudo[99370]: pam_unix(sudo:session): session closed for user root Sep 28 09:32:03 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f82f79a9-dc09-47cf-8821-f6d8f9c8fc5c tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3cd02e97-585d-40ee-9a73-4024af9b64ec" returned: 0 in 0.297s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:32:03 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-f82f79a9-dc09-47cf-8821-f6d8f9c8fc5c tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:32:03 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-f82f79a9-dc09-47cf-8821-f6d8f9c8fc5c tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:32:03 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-f82f79a9-dc09-47cf-8821-f6d8f9c8fc5c tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9181e330-bb46-4fd6-a0f2-0bc8dc18ebbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cd02e97-585d-40ee-9a73-4024af9b64ec', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:32:03 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-f82f79a9-dc09-47cf-8821-f6d8f9c8fc5c tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (130bfe5d-1ea9-4ca4-ba65-9b178900127f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:32:03 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-f82f79a9-dc09-47cf-8821-f6d8f9c8fc5c tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] Volume volume-3cd02e97-585d-40ee-9a73-4024af9b64ec (3cd02e97-585d-40ee-9a73-4024af9b64ec): created successfully Sep 28 09:32:03 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-f82f79a9-dc09-47cf-8821-f6d8f9c8fc5c tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (130bfe5d-1ea9-4ca4-ba65-9b178900127f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:32:03 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-f82f79a9-dc09-47cf-8821-f6d8f9c8fc5c tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] Flow 'volume_create_manager' (5006f063-443a-4775-8c66-77c657397fcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:32:03 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-f82f79a9-dc09-47cf-8821-f6d8f9c8fc5c tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] Created volume successfully. Sep 28 09:32:04 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-f1049301-9b33-4c71-817b-ac5968ed6780 tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:32:04 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-f1049301-9b33-4c71-817b-ac5968ed6780 tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:32:04 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-f1049301-9b33-4c71-817b-ac5968ed6780 tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] Creating offline snapshot b69dd0c9-ba31-402c-8341-59ac4b106896 of volume 3cd02e97-585d-40ee-9a73-4024af9b64ec {{(pid=86553) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 09:32:04 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a330e3-cf3a-4adb-b5e7-5dc39efcb91c]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:32:04 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f1049301-9b33-4c71-817b-ac5968ed6780 tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3cd02e97-585d-40ee-9a73-4024af9b64ec {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:32:04 devstack sudo[99373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3cd02e97-585d-40ee-9a73-4024af9b64ec Sep 28 09:32:04 devstack sudo[99373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:32:05 devstack sudo[99373]: pam_unix(sudo:session): session closed for user root Sep 28 09:32:05 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f1049301-9b33-4c71-817b-ac5968ed6780 tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3cd02e97-585d-40ee-9a73-4024af9b64ec" returned: 0 in 0.506s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:32:05 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f1049301-9b33-4c71-817b-ac5968ed6780 tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3cd02e97-585d-40ee-9a73-4024af9b64ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3cd02e97-585d-40ee-9a73-4024af9b64ec.b69dd0c9-ba31-402c-8341-59ac4b106896 1G {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:32:05 devstack sudo[99378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3cd02e97-585d-40ee-9a73-4024af9b64ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3cd02e97-585d-40ee-9a73-4024af9b64ec.b69dd0c9-ba31-402c-8341-59ac4b106896 1G Sep 28 09:32:05 devstack sudo[99378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:32:05 devstack sudo[99378]: pam_unix(sudo:session): session closed for user root Sep 28 09:32:05 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f1049301-9b33-4c71-817b-ac5968ed6780 tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3cd02e97-585d-40ee-9a73-4024af9b64ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3cd02e97-585d-40ee-9a73-4024af9b64ec.b69dd0c9-ba31-402c-8341-59ac4b106896 1G" returned: 0 in 0.640s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:32:05 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f1049301-9b33-4c71-817b-ac5968ed6780 tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3cd02e97-585d-40ee-9a73-4024af9b64ec -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3cd02e97-585d-40ee-9a73-4024af9b64ec.b69dd0c9-ba31-402c-8341-59ac4b106896 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:32:05 devstack sudo[99385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3cd02e97-585d-40ee-9a73-4024af9b64ec -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3cd02e97-585d-40ee-9a73-4024af9b64ec.b69dd0c9-ba31-402c-8341-59ac4b106896 Sep 28 09:32:05 devstack sudo[99385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:32:06 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-39d1b33d-1697-415a-b38b-98dc48e550b0 tempest-GroupsTest-925794044 None] Group tempest-Group1-1030032499: creating Sep 28 09:32:06 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-39d1b33d-1697-415a-b38b-98dc48e550b0 tempest-GroupsTest-925794044 None] Group tempest-Group1-1030032499: created successfully Sep 28 09:32:06 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-39d1b33d-1697-415a-b38b-98dc48e550b0 tempest-GroupsTest-925794044 None] Create group completed successfully. Sep 28 09:32:06 devstack sudo[99385]: pam_unix(sudo:session): session closed for user root Sep 28 09:32:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f1049301-9b33-4c71-817b-ac5968ed6780 tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3cd02e97-585d-40ee-9a73-4024af9b64ec -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3cd02e97-585d-40ee-9a73-4024af9b64ec.b69dd0c9-ba31-402c-8341-59ac4b106896" returned: 0 in 0.387s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:32:06 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-f1049301-9b33-4c71-817b-ac5968ed6780 tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3cd02e97-585d-40ee-9a73-4024af9b64ec.b69dd0c9-ba31-402c-8341-59ac4b106896 is being set with open permissions: ugo+rw Sep 28 09:32:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f1049301-9b33-4c71-817b-ac5968ed6780 tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3cd02e97-585d-40ee-9a73-4024af9b64ec.b69dd0c9-ba31-402c-8341-59ac4b106896 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:32:06 devstack sudo[99391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3cd02e97-585d-40ee-9a73-4024af9b64ec.b69dd0c9-ba31-402c-8341-59ac4b106896 Sep 28 09:32:06 devstack sudo[99391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:32:06 devstack sudo[99391]: pam_unix(sudo:session): session closed for user root Sep 28 09:32:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f1049301-9b33-4c71-817b-ac5968ed6780 tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3cd02e97-585d-40ee-9a73-4024af9b64ec.b69dd0c9-ba31-402c-8341-59ac4b106896" returned: 0 in 0.352s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:32:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f1049301-9b33-4c71-817b-ac5968ed6780 tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3cd02e97-585d-40ee-9a73-4024af9b64ec.info {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:32:06 devstack sudo[99394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3cd02e97-585d-40ee-9a73-4024af9b64ec.info Sep 28 09:32:06 devstack sudo[99394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:32:06 devstack sudo[99394]: pam_unix(sudo:session): session closed for user root Sep 28 09:32:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f1049301-9b33-4c71-817b-ac5968ed6780 tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3cd02e97-585d-40ee-9a73-4024af9b64ec.info" returned: 0 in 0.293s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:32:06 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-f1049301-9b33-4c71-817b-ac5968ed6780 tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3cd02e97-585d-40ee-9a73-4024af9b64ec.info is being set with open permissions: ugo+rw Sep 28 09:32:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f1049301-9b33-4c71-817b-ac5968ed6780 tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3cd02e97-585d-40ee-9a73-4024af9b64ec.info {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:32:06 devstack sudo[99397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3cd02e97-585d-40ee-9a73-4024af9b64ec.info Sep 28 09:32:06 devstack sudo[99397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:32:07 devstack sudo[99397]: pam_unix(sudo:session): session closed for user root Sep 28 09:32:07 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-303d14d2-ec7f-4ff6-b6af-663c13869c47 tempest-GroupsTest-925794044 None] Group tempest-Group2-446052324: creating Sep 28 09:32:07 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f1049301-9b33-4c71-817b-ac5968ed6780 tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3cd02e97-585d-40ee-9a73-4024af9b64ec.info" returned: 0 in 0.387s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:32:07 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-f1049301-9b33-4c71-817b-ac5968ed6780 tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.699s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:32:07 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-f1049301-9b33-4c71-817b-ac5968ed6780 tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] Create snapshot completed successfully Sep 28 09:32:07 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-303d14d2-ec7f-4ff6-b6af-663c13869c47 tempest-GroupsTest-925794044 None] Group tempest-Group2-446052324: created successfully Sep 28 09:32:07 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-303d14d2-ec7f-4ff6-b6af-663c13869c47 tempest-GroupsTest-925794044 None] Create group completed successfully. Sep 28 09:32:08 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-cb5e5ee2-3953-4aa3-8291-e7abae1a7f0c tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] Acquiring lock "cinder-b69dd0c9-ba31-402c-8341-59ac4b106896-delete_snapshot" by "delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:32:08 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-cb5e5ee2-3953-4aa3-8291-e7abae1a7f0c tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] Lock "cinder-b69dd0c9-ba31-402c-8341-59ac4b106896-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:32:08 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-cb5e5ee2-3953-4aa3-8291-e7abae1a7f0c tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] Acquiring lock "cinder-quobyte-3cd02e97-585d-40ee-9a73-4024af9b64ec" by "delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:32:08 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-cb5e5ee2-3953-4aa3-8291-e7abae1a7f0c tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] Lock "cinder-quobyte-3cd02e97-585d-40ee-9a73-4024af9b64ec" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:32:08 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-cb5e5ee2-3953-4aa3-8291-e7abae1a7f0c tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] Acquiring lock "cinder-quobyte-b69dd0c9-ba31-402c-8341-59ac4b106896" by "_delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:32:08 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-cb5e5ee2-3953-4aa3-8291-e7abae1a7f0c tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] Lock "cinder-quobyte-b69dd0c9-ba31-402c-8341-59ac4b106896" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:32:08 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-cb5e5ee2-3953-4aa3-8291-e7abae1a7f0c tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] Deleting offline snapshot b69dd0c9-ba31-402c-8341-59ac4b106896 of volume 3cd02e97-585d-40ee-9a73-4024af9b64ec {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 09:32:08 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-cb5e5ee2-3953-4aa3-8291-e7abae1a7f0c tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] snapshot_file for this snap is: volume-3cd02e97-585d-40ee-9a73-4024af9b64ec.b69dd0c9-ba31-402c-8341-59ac4b106896 {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 09:32:08 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[60cfbfbb-b323-4be7-961a-069b2075e572]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:32:08 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-cb5e5ee2-3953-4aa3-8291-e7abae1a7f0c tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3cd02e97-585d-40ee-9a73-4024af9b64ec.b69dd0c9-ba31-402c-8341-59ac4b106896 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:32:08 devstack sudo[99402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3cd02e97-585d-40ee-9a73-4024af9b64ec.b69dd0c9-ba31-402c-8341-59ac4b106896 Sep 28 09:32:08 devstack sudo[99402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:32:09 devstack sudo[99402]: pam_unix(sudo:session): session closed for user root Sep 28 09:32:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-cb5e5ee2-3953-4aa3-8291-e7abae1a7f0c tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3cd02e97-585d-40ee-9a73-4024af9b64ec.b69dd0c9-ba31-402c-8341-59ac4b106896" returned: 0 in 0.586s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:32:09 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-cb5e5ee2-3953-4aa3-8291-e7abae1a7f0c tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3cd02e97-585d-40ee-9a73-4024af9b64ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86553) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 09:32:09 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dfc55f0-8e04-40d0-908b-4db721d3c83b]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:32:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-cb5e5ee2-3953-4aa3-8291-e7abae1a7f0c tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3cd02e97-585d-40ee-9a73-4024af9b64ec {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:32:09 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c5c5fd6-9d50-4460-a74f-ef83287f5b1e tempest-GroupsTest-925794044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:32:09 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0c5c5fd6-9d50-4460-a74f-ef83287f5b1e tempest-GroupsTest-925794044 None] Flow 'volume_create_manager' (5db201b1-7e36-45b9-a818-2afd58b05be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:32:09 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0c5c5fd6-9d50-4460-a74f-ef83287f5b1e tempest-GroupsTest-925794044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32a75cef-a98f-4893-beef-ececb50bc433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:32:09 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0c5c5fd6-9d50-4460-a74f-ef83287f5b1e tempest-GroupsTest-925794044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32a75cef-a98f-4893-beef-ececb50bc433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:32:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1570969501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2f1a68c5-e22d-4b91-9204-674d4f84d7f6,host='devstack@QuobyteHD#QuobyteHD',id=938be0ce-2211-49bc-a65b-503ca426ea37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cb18acc59a34a4c9d076d1aa7831f31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:32:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:32:09Z,use_quota=True,user_id='ebae3788f5024be785a5685dbb1de5d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(28bfb29c-acc1-4735-804e-a0d46d009191),volume_type_id=28bfb29c-acc1-4735-804e-a0d46d009191)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:32:09 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0c5c5fd6-9d50-4460-a74f-ef83287f5b1e tempest-GroupsTest-925794044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29806862-ad3c-46f4-9c95-bd2c9b823173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:32:09 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0c5c5fd6-9d50-4460-a74f-ef83287f5b1e tempest-GroupsTest-925794044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29806862-ad3c-46f4-9c95-bd2c9b823173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:32:09 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0c5c5fd6-9d50-4460-a74f-ef83287f5b1e tempest-GroupsTest-925794044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0cd5505-1ede-487f-9c0b-ff3aea221d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:32:09 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0c5c5fd6-9d50-4460-a74f-ef83287f5b1e tempest-GroupsTest-925794044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0cd5505-1ede-487f-9c0b-ff3aea221d75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '938be0ce-2211-49bc-a65b-503ca426ea37', 'volume_name': 'volume-938be0ce-2211-49bc-a65b-503ca426ea37', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:32:09 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0c5c5fd6-9d50-4460-a74f-ef83287f5b1e tempest-GroupsTest-925794044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (429373ed-661b-4409-9fb9-68552ad12f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:32:09 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0c5c5fd6-9d50-4460-a74f-ef83287f5b1e tempest-GroupsTest-925794044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (429373ed-661b-4409-9fb9-68552ad12f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:32:09 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0c5c5fd6-9d50-4460-a74f-ef83287f5b1e tempest-GroupsTest-925794044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8199b7e1-2ae0-42c5-9b02-5560d68dedd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:32:09 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-0c5c5fd6-9d50-4460-a74f-ef83287f5b1e tempest-GroupsTest-925794044 None] Volume 938be0ce-2211-49bc-a65b-503ca426ea37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-938be0ce-2211-49bc-a65b-503ca426ea37', 'volume_size': 1} Sep 28 09:32:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-0c5c5fd6-9d50-4460-a74f-ef83287f5b1e tempest-GroupsTest-925794044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:32:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-0c5c5fd6-9d50-4460-a74f-ef83287f5b1e tempest-GroupsTest-925794044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:32:09 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-0c5c5fd6-9d50-4460-a74f-ef83287f5b1e tempest-GroupsTest-925794044 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2f1a68c5-e22d-4b91-9204-674d4f84d7f6,created_at=2026-09-28T07:32:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1570969501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2f1a68c5-e22d-4b91-9204-674d4f84d7f6,host='devstack@QuobyteHD#QuobyteHD',id=938be0ce-2211-49bc-a65b-503ca426ea37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cb18acc59a34a4c9d076d1aa7831f31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:32:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:32:09Z,use_quota=True,user_id='ebae3788f5024be785a5685dbb1de5d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(28bfb29c-acc1-4735-804e-a0d46d009191),volume_type_id=28bfb29c-acc1-4735-804e-a0d46d009191)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:32:09 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-0c5c5fd6-9d50-4460-a74f-ef83287f5b1e tempest-GroupsTest-925794044 None] Creating volume 938be0ce-2211-49bc-a65b-503ca426ea37 {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:32:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-0c5c5fd6-9d50-4460-a74f-ef83287f5b1e tempest-GroupsTest-925794044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:32:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-0c5c5fd6-9d50-4460-a74f-ef83287f5b1e tempest-GroupsTest-925794044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:32:09 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-0c5c5fd6-9d50-4460-a74f-ef83287f5b1e tempest-GroupsTest-925794044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:32:09 devstack sudo[99407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3cd02e97-585d-40ee-9a73-4024af9b64ec Sep 28 09:32:09 devstack sudo[99407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:32:09 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-0c5c5fd6-9d50-4460-a74f-ef83287f5b1e tempest-GroupsTest-925794044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:32:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-0c5c5fd6-9d50-4460-a74f-ef83287f5b1e tempest-GroupsTest-925794044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:32:09 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-0c5c5fd6-9d50-4460-a74f-ef83287f5b1e tempest-GroupsTest-925794044 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:32:09 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-0c5c5fd6-9d50-4460-a74f-ef83287f5b1e tempest-GroupsTest-925794044 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:32:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0c5c5fd6-9d50-4460-a74f-ef83287f5b1e tempest-GroupsTest-925794044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-938be0ce-2211-49bc-a65b-503ca426ea37 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:32:09 devstack sudo[99409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-938be0ce-2211-49bc-a65b-503ca426ea37 1073741824 Sep 28 09:32:09 devstack sudo[99409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:32:09 devstack sudo[99407]: pam_unix(sudo:session): session closed for user root Sep 28 09:32:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-cb5e5ee2-3953-4aa3-8291-e7abae1a7f0c tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3cd02e97-585d-40ee-9a73-4024af9b64ec" returned: 0 in 0.492s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:32:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-cb5e5ee2-3953-4aa3-8291-e7abae1a7f0c tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3cd02e97-585d-40ee-9a73-4024af9b64ec.b69dd0c9-ba31-402c-8341-59ac4b106896 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:32:09 devstack sudo[99417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3cd02e97-585d-40ee-9a73-4024af9b64ec.b69dd0c9-ba31-402c-8341-59ac4b106896 Sep 28 09:32:09 devstack sudo[99417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:32:09 devstack sudo[99409]: pam_unix(sudo:session): session closed for user root Sep 28 09:32:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0c5c5fd6-9d50-4460-a74f-ef83287f5b1e tempest-GroupsTest-925794044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-938be0ce-2211-49bc-a65b-503ca426ea37 1073741824" returned: 0 in 0.588s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:32:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0c5c5fd6-9d50-4460-a74f-ef83287f5b1e tempest-GroupsTest-925794044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-938be0ce-2211-49bc-a65b-503ca426ea37 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:32:09 devstack sudo[99422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-938be0ce-2211-49bc-a65b-503ca426ea37 Sep 28 09:32:09 devstack sudo[99422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:32:10 devstack sudo[99417]: pam_unix(sudo:session): session closed for user root Sep 28 09:32:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-cb5e5ee2-3953-4aa3-8291-e7abae1a7f0c tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3cd02e97-585d-40ee-9a73-4024af9b64ec.b69dd0c9-ba31-402c-8341-59ac4b106896" returned: 0 in 0.418s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:32:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-cb5e5ee2-3953-4aa3-8291-e7abae1a7f0c tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3cd02e97-585d-40ee-9a73-4024af9b64ec.b69dd0c9-ba31-402c-8341-59ac4b106896 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:32:10 devstack sudo[99426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3cd02e97-585d-40ee-9a73-4024af9b64ec.b69dd0c9-ba31-402c-8341-59ac4b106896 Sep 28 09:32:10 devstack sudo[99426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:32:10 devstack sudo[99422]: pam_unix(sudo:session): session closed for user root Sep 28 09:32:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0c5c5fd6-9d50-4460-a74f-ef83287f5b1e tempest-GroupsTest-925794044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-938be0ce-2211-49bc-a65b-503ca426ea37" returned: 0 in 0.291s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:32:10 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-0c5c5fd6-9d50-4460-a74f-ef83287f5b1e tempest-GroupsTest-925794044 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:32:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-0c5c5fd6-9d50-4460-a74f-ef83287f5b1e tempest-GroupsTest-925794044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:32:10 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0c5c5fd6-9d50-4460-a74f-ef83287f5b1e tempest-GroupsTest-925794044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8199b7e1-2ae0-42c5-9b02-5560d68dedd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-938be0ce-2211-49bc-a65b-503ca426ea37', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:32:10 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0c5c5fd6-9d50-4460-a74f-ef83287f5b1e tempest-GroupsTest-925794044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e24d7627-b195-4a34-9c41-a5925df4a9ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:32:10 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-0c5c5fd6-9d50-4460-a74f-ef83287f5b1e tempest-GroupsTest-925794044 None] Volume volume-938be0ce-2211-49bc-a65b-503ca426ea37 (938be0ce-2211-49bc-a65b-503ca426ea37): created successfully Sep 28 09:32:10 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0c5c5fd6-9d50-4460-a74f-ef83287f5b1e tempest-GroupsTest-925794044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e24d7627-b195-4a34-9c41-a5925df4a9ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:32:10 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0c5c5fd6-9d50-4460-a74f-ef83287f5b1e tempest-GroupsTest-925794044 None] Flow 'volume_create_manager' (5db201b1-7e36-45b9-a818-2afd58b05be7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:32:10 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-0c5c5fd6-9d50-4460-a74f-ef83287f5b1e tempest-GroupsTest-925794044 None] Created volume successfully. Sep 28 09:32:10 devstack sudo[99426]: pam_unix(sudo:session): session closed for user root Sep 28 09:32:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-cb5e5ee2-3953-4aa3-8291-e7abae1a7f0c tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3cd02e97-585d-40ee-9a73-4024af9b64ec.b69dd0c9-ba31-402c-8341-59ac4b106896" returned: 0 in 0.329s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:32:10 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-cb5e5ee2-3953-4aa3-8291-e7abae1a7f0c tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] Lock "cinder-quobyte-b69dd0c9-ba31-402c-8341-59ac4b106896" released by "_delete_snapshot" :: held 1.993s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:32:10 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-cb5e5ee2-3953-4aa3-8291-e7abae1a7f0c tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] Lock "cinder-quobyte-3cd02e97-585d-40ee-9a73-4024af9b64ec" released by "delete_snapshot" :: held 2.021s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:32:10 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-cb5e5ee2-3953-4aa3-8291-e7abae1a7f0c tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] Created reservations ['d7031557-a027-4f02-8728-6c507574ca9f', '97120503-8229-44a4-92cf-c8fd4043ae54', '4dcac3b8-c707-48bf-a0bd-606204c8b5fe', '6a7cb624-a7f6-48d5-b349-7589c247802d'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:32:10 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-cb5e5ee2-3953-4aa3-8291-e7abae1a7f0c tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] Delete snapshot completed successfully. Sep 28 09:32:10 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-cb5e5ee2-3953-4aa3-8291-e7abae1a7f0c tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] Lock "cinder-b69dd0c9-ba31-402c-8341-59ac4b106896-delete_snapshot" released by "delete_snapshot" :: held 2.276s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:32:11 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-1f24bf07-2c1d-4f67-ae5d-965ba5096d48 tempest-GroupsTest-925794044 None] Acquiring lock "cinder-quobyte-938be0ce-2211-49bc-a65b-503ca426ea37" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:32:11 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-1f24bf07-2c1d-4f67-ae5d-965ba5096d48 tempest-GroupsTest-925794044 None] Lock "cinder-quobyte-938be0ce-2211-49bc-a65b-503ca426ea37" acquired by "delete_volume" :: waited 0.027s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:32:11 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[d62e30af-58d9-4bf7-aeb3-520487a47481]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:32:11 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1f24bf07-2c1d-4f67-ae5d-965ba5096d48 tempest-GroupsTest-925794044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-938be0ce-2211-49bc-a65b-503ca426ea37 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:32:11 devstack sudo[99430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-938be0ce-2211-49bc-a65b-503ca426ea37 Sep 28 09:32:11 devstack sudo[99430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:32:11 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-b5d37ad2-0287-49b2-930c-f16b09f9c6de tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] Acquiring lock "cinder-3cd02e97-585d-40ee-9a73-4024af9b64ec-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:32:11 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-b5d37ad2-0287-49b2-930c-f16b09f9c6de tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] Lock "cinder-3cd02e97-585d-40ee-9a73-4024af9b64ec-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:32:11 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-b5d37ad2-0287-49b2-930c-f16b09f9c6de tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] Acquiring lock "cinder-quobyte-3cd02e97-585d-40ee-9a73-4024af9b64ec" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:32:11 devstack sudo[99430]: pam_unix(sudo:session): session closed for user root Sep 28 09:32:11 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1f24bf07-2c1d-4f67-ae5d-965ba5096d48 tempest-GroupsTest-925794044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-938be0ce-2211-49bc-a65b-503ca426ea37" returned: 0 in 0.610s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:32:11 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1f24bf07-2c1d-4f67-ae5d-965ba5096d48 tempest-GroupsTest-925794044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-938be0ce-2211-49bc-a65b-503ca426ea37 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:32:11 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-b5d37ad2-0287-49b2-930c-f16b09f9c6de tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] Lock "cinder-quobyte-3cd02e97-585d-40ee-9a73-4024af9b64ec" acquired by "delete_volume" :: waited 0.034s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:32:11 devstack sudo[99436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-938be0ce-2211-49bc-a65b-503ca426ea37 Sep 28 09:32:11 devstack sudo[99436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:32:11 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[f08604fd-ac8e-4dae-9a27-1e7a93da5264]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:32:11 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b5d37ad2-0287-49b2-930c-f16b09f9c6de tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3cd02e97-585d-40ee-9a73-4024af9b64ec {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:32:12 devstack sudo[99438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3cd02e97-585d-40ee-9a73-4024af9b64ec Sep 28 09:32:12 devstack sudo[99438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:32:12 devstack sudo[99436]: pam_unix(sudo:session): session closed for user root Sep 28 09:32:12 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1f24bf07-2c1d-4f67-ae5d-965ba5096d48 tempest-GroupsTest-925794044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-938be0ce-2211-49bc-a65b-503ca426ea37" returned: 0 in 0.305s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:32:12 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-1f24bf07-2c1d-4f67-ae5d-965ba5096d48 tempest-GroupsTest-925794044 None] Lock "cinder-quobyte-938be0ce-2211-49bc-a65b-503ca426ea37" released by "delete_volume" :: held 0.972s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:32:12 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-1f24bf07-2c1d-4f67-ae5d-965ba5096d48 tempest-GroupsTest-925794044 None] Created reservations ['e56af818-9f8f-4687-8fa2-84b2026ff515'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:32:12 devstack cinder-volume[86553]: WARNING cinder.quota [None req-1f24bf07-2c1d-4f67-ae5d-965ba5096d48 tempest-GroupsTest-925794044 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-264257572 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-264257572, it is now deprecated. Please use the default quota class for default quota. Sep 28 09:32:12 devstack cinder-volume[86553]: WARNING cinder.quota [None req-1f24bf07-2c1d-4f67-ae5d-965ba5096d48 tempest-GroupsTest-925794044 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-264257572 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-264257572, it is now deprecated. Please use the default quota class for default quota. Sep 28 09:32:12 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-1f24bf07-2c1d-4f67-ae5d-965ba5096d48 tempest-GroupsTest-925794044 None] Created reservations ['2c5b1699-f002-49e4-aaf5-24790167442e', '3f92edb7-5bd2-46ba-8021-08868f4dcabc', '165a2a57-324e-4edf-8a31-3052c4b46d7b', '57ae6b29-bfb1-4b86-a635-a7f7a0fa868f'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:32:12 devstack sudo[99438]: pam_unix(sudo:session): session closed for user root Sep 28 09:32:12 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b5d37ad2-0287-49b2-930c-f16b09f9c6de tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3cd02e97-585d-40ee-9a73-4024af9b64ec" returned: 0 in 0.488s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:32:12 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b5d37ad2-0287-49b2-930c-f16b09f9c6de tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3cd02e97-585d-40ee-9a73-4024af9b64ec {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:32:12 devstack sudo[99444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3cd02e97-585d-40ee-9a73-4024af9b64ec Sep 28 09:32:12 devstack sudo[99444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:32:12 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-1f24bf07-2c1d-4f67-ae5d-965ba5096d48 tempest-GroupsTest-925794044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:32:12 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-1f24bf07-2c1d-4f67-ae5d-965ba5096d48 tempest-GroupsTest-925794044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:32:12 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-1f24bf07-2c1d-4f67-ae5d-965ba5096d48 tempest-GroupsTest-925794044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:32:12 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-1f24bf07-2c1d-4f67-ae5d-965ba5096d48 tempest-GroupsTest-925794044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:32:12 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-1f24bf07-2c1d-4f67-ae5d-965ba5096d48 tempest-GroupsTest-925794044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:32:12 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1f24bf07-2c1d-4f67-ae5d-965ba5096d48 tempest-GroupsTest-925794044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:32:12 devstack sudo[99446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:32:12 devstack sudo[99446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:32:12 devstack sudo[99444]: pam_unix(sudo:session): session closed for user root Sep 28 09:32:12 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b5d37ad2-0287-49b2-930c-f16b09f9c6de tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3cd02e97-585d-40ee-9a73-4024af9b64ec" returned: 0 in 0.366s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:32:12 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-b5d37ad2-0287-49b2-930c-f16b09f9c6de tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] Lock "cinder-quobyte-3cd02e97-585d-40ee-9a73-4024af9b64ec" released by "delete_volume" :: held 0.951s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:32:12 devstack sudo[99446]: pam_unix(sudo:session): session closed for user root Sep 28 09:32:12 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1f24bf07-2c1d-4f67-ae5d-965ba5096d48 tempest-GroupsTest-925794044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.365s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:32:12 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-1f24bf07-2c1d-4f67-ae5d-965ba5096d48 tempest-GroupsTest-925794044 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:32:12 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-1f24bf07-2c1d-4f67-ae5d-965ba5096d48 tempest-GroupsTest-925794044 None] Delete group completed successfully. Sep 28 09:32:13 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-b5d37ad2-0287-49b2-930c-f16b09f9c6de tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] Created reservations ['89594e10-f14e-421e-88f9-96e96f3f8abb', '171e7b4a-1142-4329-b99a-aa3b4af8b852', '34bc3784-e077-48e6-88d1-ed7cc6f50b7e', '1a643bba-d9bd-47ac-8d1c-7287d66ed8f2'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:32:13 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-b5d37ad2-0287-49b2-930c-f16b09f9c6de tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:32:13 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-b5d37ad2-0287-49b2-930c-f16b09f9c6de tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:32:13 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-b5d37ad2-0287-49b2-930c-f16b09f9c6de tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:32:13 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-b5d37ad2-0287-49b2-930c-f16b09f9c6de tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:32:13 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-b5d37ad2-0287-49b2-930c-f16b09f9c6de tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:32:13 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b5d37ad2-0287-49b2-930c-f16b09f9c6de tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:32:13 devstack sudo[99450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:32:13 devstack sudo[99450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:32:13 devstack sudo[99450]: pam_unix(sudo:session): session closed for user root Sep 28 09:32:13 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b5d37ad2-0287-49b2-930c-f16b09f9c6de tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.281s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:32:13 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-b5d37ad2-0287-49b2-930c-f16b09f9c6de tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:32:13 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-b5d37ad2-0287-49b2-930c-f16b09f9c6de tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] Deleted volume successfully. Sep 28 09:32:13 devstack cinder-volume[86553]: DEBUG dbcounter [-] [86553] Writing DB stats cinder:SELECT=172,cinder:UPDATE=188,cinder:INSERT=47,cinder:DELETE=14 {{(pid=86553) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 09:32:13 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-b5d37ad2-0287-49b2-930c-f16b09f9c6de tempest-VolumeSnapshotQuotasNegativeTestJSON-443940119 None] Lock "cinder-3cd02e97-585d-40ee-9a73-4024af9b64ec-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:32:13 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-5ad0b679-9c5b-40a1-bc07-a71c247fddaa tempest-GroupsTest-925794044 None] Created reservations ['9ac0f2dc-aa31-4330-bc74-4bedb682f6bd'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:32:13 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-5ad0b679-9c5b-40a1-bc07-a71c247fddaa tempest-GroupsTest-925794044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:32:13 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-5ad0b679-9c5b-40a1-bc07-a71c247fddaa tempest-GroupsTest-925794044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:32:13 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-5ad0b679-9c5b-40a1-bc07-a71c247fddaa tempest-GroupsTest-925794044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:32:13 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-5ad0b679-9c5b-40a1-bc07-a71c247fddaa tempest-GroupsTest-925794044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:32:13 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-5ad0b679-9c5b-40a1-bc07-a71c247fddaa tempest-GroupsTest-925794044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:32:13 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-5ad0b679-9c5b-40a1-bc07-a71c247fddaa tempest-GroupsTest-925794044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:32:13 devstack sudo[99453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:32:13 devstack sudo[99453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:32:14 devstack sudo[99453]: pam_unix(sudo:session): session closed for user root Sep 28 09:32:14 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-5ad0b679-9c5b-40a1-bc07-a71c247fddaa tempest-GroupsTest-925794044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.339s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:32:14 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-5ad0b679-9c5b-40a1-bc07-a71c247fddaa tempest-GroupsTest-925794044 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:32:14 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-5ad0b679-9c5b-40a1-bc07-a71c247fddaa tempest-GroupsTest-925794044 None] Delete group completed successfully. Sep 28 09:32:15 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-539e46f5-6b36-4835-8fff-b38c6a5da4eb tempest-GroupsTest-925794044 None] Group tempest-GroupsTest-Group-347793498: creating Sep 28 09:32:15 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-539e46f5-6b36-4835-8fff-b38c6a5da4eb tempest-GroupsTest-925794044 None] Group tempest-GroupsTest-Group-347793498: created successfully Sep 28 09:32:15 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-539e46f5-6b36-4835-8fff-b38c6a5da4eb tempest-GroupsTest-925794044 None] Create group completed successfully. Sep 28 09:32:17 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5fa3593-a995-4b1f-9a34-8dceeb6c5ce6 tempest-GroupsTest-925794044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:32:17 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-f5fa3593-a995-4b1f-9a34-8dceeb6c5ce6 tempest-GroupsTest-925794044 None] Flow 'volume_create_manager' (bcf20790-0bbc-47d1-a2e4-8f29e269aff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:32:17 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-f5fa3593-a995-4b1f-9a34-8dceeb6c5ce6 tempest-GroupsTest-925794044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6efa572a-fee6-4dbe-b399-8ad1b149ef88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:32:17 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-f5fa3593-a995-4b1f-9a34-8dceeb6c5ce6 tempest-GroupsTest-925794044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6efa572a-fee6-4dbe-b399-8ad1b149ef88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:32:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2020552706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2f059ffd-cad2-4387-a956-df92bf1471aa,host='devstack@QuobyteHD#QuobyteHD',id=56799e3c-86a0-4f74-aa42-ab406b616e56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cb18acc59a34a4c9d076d1aa7831f31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:32:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:32:17Z,use_quota=True,user_id='ebae3788f5024be785a5685dbb1de5d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07d3f8b8-fdad-4444-aa08-af2f5f332b5c),volume_type_id=07d3f8b8-fdad-4444-aa08-af2f5f332b5c)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:32:17 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-f5fa3593-a995-4b1f-9a34-8dceeb6c5ce6 tempest-GroupsTest-925794044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (538fbba2-56c9-4484-8822-edef3251834c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:32:17 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-f5fa3593-a995-4b1f-9a34-8dceeb6c5ce6 tempest-GroupsTest-925794044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (538fbba2-56c9-4484-8822-edef3251834c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:32:17 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-f5fa3593-a995-4b1f-9a34-8dceeb6c5ce6 tempest-GroupsTest-925794044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51d02fd9-a6a9-4ba9-9f65-d1ee5ce2bf8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:32:17 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-f5fa3593-a995-4b1f-9a34-8dceeb6c5ce6 tempest-GroupsTest-925794044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51d02fd9-a6a9-4ba9-9f65-d1ee5ce2bf8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56799e3c-86a0-4f74-aa42-ab406b616e56', 'volume_name': 'volume-56799e3c-86a0-4f74-aa42-ab406b616e56', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:32:17 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-f5fa3593-a995-4b1f-9a34-8dceeb6c5ce6 tempest-GroupsTest-925794044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b79907cd-218a-4422-870d-acc68f990d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:32:17 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-f5fa3593-a995-4b1f-9a34-8dceeb6c5ce6 tempest-GroupsTest-925794044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b79907cd-218a-4422-870d-acc68f990d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:32:17 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-f5fa3593-a995-4b1f-9a34-8dceeb6c5ce6 tempest-GroupsTest-925794044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbbd96ef-5e5c-4911-8c99-8a45f98dbb6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:32:17 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-f5fa3593-a995-4b1f-9a34-8dceeb6c5ce6 tempest-GroupsTest-925794044 None] Volume 56799e3c-86a0-4f74-aa42-ab406b616e56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56799e3c-86a0-4f74-aa42-ab406b616e56', 'volume_size': 1} Sep 28 09:32:17 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-f5fa3593-a995-4b1f-9a34-8dceeb6c5ce6 tempest-GroupsTest-925794044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:32:17 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-f5fa3593-a995-4b1f-9a34-8dceeb6c5ce6 tempest-GroupsTest-925794044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:32:17 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-f5fa3593-a995-4b1f-9a34-8dceeb6c5ce6 tempest-GroupsTest-925794044 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2f059ffd-cad2-4387-a956-df92bf1471aa,created_at=2026-09-28T07:32:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2020552706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2f059ffd-cad2-4387-a956-df92bf1471aa,host='devstack@QuobyteHD#QuobyteHD',id=56799e3c-86a0-4f74-aa42-ab406b616e56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cb18acc59a34a4c9d076d1aa7831f31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:32:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:32:17Z,use_quota=True,user_id='ebae3788f5024be785a5685dbb1de5d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07d3f8b8-fdad-4444-aa08-af2f5f332b5c),volume_type_id=07d3f8b8-fdad-4444-aa08-af2f5f332b5c)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:32:17 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-f5fa3593-a995-4b1f-9a34-8dceeb6c5ce6 tempest-GroupsTest-925794044 None] Creating volume 56799e3c-86a0-4f74-aa42-ab406b616e56 {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:32:17 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-f5fa3593-a995-4b1f-9a34-8dceeb6c5ce6 tempest-GroupsTest-925794044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:32:17 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-f5fa3593-a995-4b1f-9a34-8dceeb6c5ce6 tempest-GroupsTest-925794044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:32:17 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-f5fa3593-a995-4b1f-9a34-8dceeb6c5ce6 tempest-GroupsTest-925794044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:32:17 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-f5fa3593-a995-4b1f-9a34-8dceeb6c5ce6 tempest-GroupsTest-925794044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:32:17 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-f5fa3593-a995-4b1f-9a34-8dceeb6c5ce6 tempest-GroupsTest-925794044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:32:17 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-f5fa3593-a995-4b1f-9a34-8dceeb6c5ce6 tempest-GroupsTest-925794044 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:32:17 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-f5fa3593-a995-4b1f-9a34-8dceeb6c5ce6 tempest-GroupsTest-925794044 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:32:17 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f5fa3593-a995-4b1f-9a34-8dceeb6c5ce6 tempest-GroupsTest-925794044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-56799e3c-86a0-4f74-aa42-ab406b616e56 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:32:17 devstack sudo[99456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-56799e3c-86a0-4f74-aa42-ab406b616e56 1073741824 Sep 28 09:32:17 devstack sudo[99456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:32:18 devstack sudo[99456]: pam_unix(sudo:session): session closed for user root Sep 28 09:32:18 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f5fa3593-a995-4b1f-9a34-8dceeb6c5ce6 tempest-GroupsTest-925794044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-56799e3c-86a0-4f74-aa42-ab406b616e56 1073741824" returned: 0 in 0.619s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:32:18 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f5fa3593-a995-4b1f-9a34-8dceeb6c5ce6 tempest-GroupsTest-925794044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-56799e3c-86a0-4f74-aa42-ab406b616e56 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:32:18 devstack sudo[99479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-56799e3c-86a0-4f74-aa42-ab406b616e56 Sep 28 09:32:18 devstack sudo[99479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:32:18 devstack sudo[99479]: pam_unix(sudo:session): session closed for user root Sep 28 09:32:18 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f5fa3593-a995-4b1f-9a34-8dceeb6c5ce6 tempest-GroupsTest-925794044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-56799e3c-86a0-4f74-aa42-ab406b616e56" returned: 0 in 0.434s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:32:18 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-f5fa3593-a995-4b1f-9a34-8dceeb6c5ce6 tempest-GroupsTest-925794044 None] <== create_volume: return (1135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:32:18 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-f5fa3593-a995-4b1f-9a34-8dceeb6c5ce6 tempest-GroupsTest-925794044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.137s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:32:18 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-f5fa3593-a995-4b1f-9a34-8dceeb6c5ce6 tempest-GroupsTest-925794044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbbd96ef-5e5c-4911-8c99-8a45f98dbb6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56799e3c-86a0-4f74-aa42-ab406b616e56', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:32:18 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-f5fa3593-a995-4b1f-9a34-8dceeb6c5ce6 tempest-GroupsTest-925794044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e64d1a3-3668-4c0a-948f-4ae0c65bebb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:32:18 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-f5fa3593-a995-4b1f-9a34-8dceeb6c5ce6 tempest-GroupsTest-925794044 None] Volume volume-56799e3c-86a0-4f74-aa42-ab406b616e56 (56799e3c-86a0-4f74-aa42-ab406b616e56): created successfully Sep 28 09:32:18 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-f5fa3593-a995-4b1f-9a34-8dceeb6c5ce6 tempest-GroupsTest-925794044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e64d1a3-3668-4c0a-948f-4ae0c65bebb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:32:18 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-f5fa3593-a995-4b1f-9a34-8dceeb6c5ce6 tempest-GroupsTest-925794044 None] Flow 'volume_create_manager' (bcf20790-0bbc-47d1-a2e4-8f29e269aff0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:32:18 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-f5fa3593-a995-4b1f-9a34-8dceeb6c5ce6 tempest-GroupsTest-925794044 None] Created volume successfully. Sep 28 09:32:20 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e3be2b6-bce2-4484-b39b-d9f0210d3661 tempest-GroupsTest-925794044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:32:20 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7e3be2b6-bce2-4484-b39b-d9f0210d3661 tempest-GroupsTest-925794044 None] Flow 'volume_create_manager' (d58a74a7-0d30-4f94-92a4-0456d7b39409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:32:20 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7e3be2b6-bce2-4484-b39b-d9f0210d3661 tempest-GroupsTest-925794044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7aacc2c9-9362-4c2e-ad59-789e9e0e8896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:32:20 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7e3be2b6-bce2-4484-b39b-d9f0210d3661 tempest-GroupsTest-925794044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7aacc2c9-9362-4c2e-ad59-789e9e0e8896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:32:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1311095765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2f059ffd-cad2-4387-a956-df92bf1471aa,host='devstack@QuobyteHD#QuobyteHD',id=3a031c73-849f-4095-9108-cccdac533d52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cb18acc59a34a4c9d076d1aa7831f31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:32:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:32:21Z,use_quota=True,user_id='ebae3788f5024be785a5685dbb1de5d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07d3f8b8-fdad-4444-aa08-af2f5f332b5c),volume_type_id=07d3f8b8-fdad-4444-aa08-af2f5f332b5c)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:32:20 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7e3be2b6-bce2-4484-b39b-d9f0210d3661 tempest-GroupsTest-925794044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ab8515d-78b6-4ed6-9864-30cafe67d006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:32:20 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7e3be2b6-bce2-4484-b39b-d9f0210d3661 tempest-GroupsTest-925794044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ab8515d-78b6-4ed6-9864-30cafe67d006) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:32:20 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7e3be2b6-bce2-4484-b39b-d9f0210d3661 tempest-GroupsTest-925794044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04f85b71-8878-4413-82ff-0646cbcaf05d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:32:20 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7e3be2b6-bce2-4484-b39b-d9f0210d3661 tempest-GroupsTest-925794044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04f85b71-8878-4413-82ff-0646cbcaf05d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a031c73-849f-4095-9108-cccdac533d52', 'volume_name': 'volume-3a031c73-849f-4095-9108-cccdac533d52', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:32:20 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7e3be2b6-bce2-4484-b39b-d9f0210d3661 tempest-GroupsTest-925794044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f830a505-9937-47ca-9475-a02ae8fcb174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:32:20 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7e3be2b6-bce2-4484-b39b-d9f0210d3661 tempest-GroupsTest-925794044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f830a505-9937-47ca-9475-a02ae8fcb174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:32:20 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7e3be2b6-bce2-4484-b39b-d9f0210d3661 tempest-GroupsTest-925794044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7a2bc9f-e2e4-4d3b-939a-7a230b330756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:32:20 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-7e3be2b6-bce2-4484-b39b-d9f0210d3661 tempest-GroupsTest-925794044 None] Volume 3a031c73-849f-4095-9108-cccdac533d52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a031c73-849f-4095-9108-cccdac533d52', 'volume_size': 1} Sep 28 09:32:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-7e3be2b6-bce2-4484-b39b-d9f0210d3661 tempest-GroupsTest-925794044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:32:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-7e3be2b6-bce2-4484-b39b-d9f0210d3661 tempest-GroupsTest-925794044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:32:20 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-7e3be2b6-bce2-4484-b39b-d9f0210d3661 tempest-GroupsTest-925794044 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2f059ffd-cad2-4387-a956-df92bf1471aa,created_at=2026-09-28T07:32:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1311095765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2f059ffd-cad2-4387-a956-df92bf1471aa,host='devstack@QuobyteHD#QuobyteHD',id=3a031c73-849f-4095-9108-cccdac533d52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cb18acc59a34a4c9d076d1aa7831f31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:32:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:32:21Z,use_quota=True,user_id='ebae3788f5024be785a5685dbb1de5d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07d3f8b8-fdad-4444-aa08-af2f5f332b5c),volume_type_id=07d3f8b8-fdad-4444-aa08-af2f5f332b5c)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:32:20 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-7e3be2b6-bce2-4484-b39b-d9f0210d3661 tempest-GroupsTest-925794044 None] Creating volume 3a031c73-849f-4095-9108-cccdac533d52 {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:32:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-7e3be2b6-bce2-4484-b39b-d9f0210d3661 tempest-GroupsTest-925794044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:32:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-7e3be2b6-bce2-4484-b39b-d9f0210d3661 tempest-GroupsTest-925794044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:32:20 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-7e3be2b6-bce2-4484-b39b-d9f0210d3661 tempest-GroupsTest-925794044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:32:20 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-7e3be2b6-bce2-4484-b39b-d9f0210d3661 tempest-GroupsTest-925794044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:32:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-7e3be2b6-bce2-4484-b39b-d9f0210d3661 tempest-GroupsTest-925794044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:32:20 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-7e3be2b6-bce2-4484-b39b-d9f0210d3661 tempest-GroupsTest-925794044 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:32:20 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-7e3be2b6-bce2-4484-b39b-d9f0210d3661 tempest-GroupsTest-925794044 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:32:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-7e3be2b6-bce2-4484-b39b-d9f0210d3661 tempest-GroupsTest-925794044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3a031c73-849f-4095-9108-cccdac533d52 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:32:20 devstack sudo[99504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3a031c73-849f-4095-9108-cccdac533d52 1073741824 Sep 28 09:32:20 devstack sudo[99504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:32:21 devstack sudo[99504]: pam_unix(sudo:session): session closed for user root Sep 28 09:32:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-7e3be2b6-bce2-4484-b39b-d9f0210d3661 tempest-GroupsTest-925794044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3a031c73-849f-4095-9108-cccdac533d52 1073741824" returned: 0 in 0.622s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:32:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-7e3be2b6-bce2-4484-b39b-d9f0210d3661 tempest-GroupsTest-925794044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3a031c73-849f-4095-9108-cccdac533d52 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:32:21 devstack sudo[99510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3a031c73-849f-4095-9108-cccdac533d52 Sep 28 09:32:21 devstack sudo[99510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:32:21 devstack cinder-volume[86553]: DEBUG oslo_service.periodic_task [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86553) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 09:32:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:32:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:32:21 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:32:21 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:32:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:32:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:32:21 devstack sudo[99512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:32:21 devstack sudo[99512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:32:21 devstack sudo[99510]: pam_unix(sudo:session): session closed for user root Sep 28 09:32:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-7e3be2b6-bce2-4484-b39b-d9f0210d3661 tempest-GroupsTest-925794044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3a031c73-849f-4095-9108-cccdac533d52" returned: 0 in 0.432s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:32:21 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-7e3be2b6-bce2-4484-b39b-d9f0210d3661 tempest-GroupsTest-925794044 None] <== create_volume: return (1110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:32:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-7e3be2b6-bce2-4484-b39b-d9f0210d3661 tempest-GroupsTest-925794044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.113s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:32:21 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7e3be2b6-bce2-4484-b39b-d9f0210d3661 tempest-GroupsTest-925794044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7a2bc9f-e2e4-4d3b-939a-7a230b330756) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a031c73-849f-4095-9108-cccdac533d52', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:32:21 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7e3be2b6-bce2-4484-b39b-d9f0210d3661 tempest-GroupsTest-925794044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd2a4d66-6100-4262-a792-1f1d76d48a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:32:21 devstack sudo[99512]: pam_unix(sudo:session): session closed for user root Sep 28 09:32:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.380s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:32:21 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:32:21 devstack cinder-volume[86553]: DEBUG oslo_service.periodic_task [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Running periodic task VolumeManager._thread_info {{(pid=86553) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 09:32:21 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] thread count: 28 {{(pid=86553) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 09:32:21 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] thread info: [<_MainThread(MainThread, started 134684877779072)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86553) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 09:32:21 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-7e3be2b6-bce2-4484-b39b-d9f0210d3661 tempest-GroupsTest-925794044 None] Volume volume-3a031c73-849f-4095-9108-cccdac533d52 (3a031c73-849f-4095-9108-cccdac533d52): created successfully Sep 28 09:32:21 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7e3be2b6-bce2-4484-b39b-d9f0210d3661 tempest-GroupsTest-925794044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd2a4d66-6100-4262-a792-1f1d76d48a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:32:21 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7e3be2b6-bce2-4484-b39b-d9f0210d3661 tempest-GroupsTest-925794044 None] Flow 'volume_create_manager' (d58a74a7-0d30-4f94-92a4-0456d7b39409) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:32:22 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-7e3be2b6-bce2-4484-b39b-d9f0210d3661 tempest-GroupsTest-925794044 None] Created volume successfully. Sep 28 09:32:23 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-7872275e-9915-4436-8be9-ad5a7602207e tempest-GroupsTest-925794044 None] Update group completed successfully. Sep 28 09:32:23 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6f19b2d-6bac-4012-b11a-81eff0773366 tempest-VolumesImageMetadata-37211285 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:32:23 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-f6f19b2d-6bac-4012-b11a-81eff0773366 tempest-VolumesImageMetadata-37211285 None] Flow 'volume_create_manager' (26ef326f-bf27-440e-a04b-edd69527b8bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:32:23 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-f6f19b2d-6bac-4012-b11a-81eff0773366 tempest-VolumesImageMetadata-37211285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80b2d3f5-598f-45f8-abce-cdd6720dc68d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:32:23 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-f6f19b2d-6bac-4012-b11a-81eff0773366 tempest-VolumesImageMetadata-37211285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80b2d3f5-598f-45f8-abce-cdd6720dc68d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:32:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1446410677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ec0ae6a-a344-4f20-9c0c-a43c8e9b5e18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2af1b09305de4e8e8c075cd5b30566c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:32:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:32:23Z,use_quota=True,user_id='61804e808e7d470289805fcde4b81524',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:32:23 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-f6f19b2d-6bac-4012-b11a-81eff0773366 tempest-VolumesImageMetadata-37211285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45077647-74c6-404a-9178-faf1b190b6ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:32:23 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-f6f19b2d-6bac-4012-b11a-81eff0773366 tempest-VolumesImageMetadata-37211285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45077647-74c6-404a-9178-faf1b190b6ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:32:23 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-f6f19b2d-6bac-4012-b11a-81eff0773366 tempest-VolumesImageMetadata-37211285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (769efdd4-f3a5-4174-bddb-fe7f848be208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:32:23 devstack cinder-volume[86553]: DEBUG cinder.image.glance [None req-f6f19b2d-6bac-4012-b11a-81eff0773366 tempest-VolumesImageMetadata-37211285 None] Creating Keystone auth plugin from conf {{(pid=86553) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 09:32:23 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-7effe36d-b7a7-48c4-92bd-5ce564dcd5e0 tempest-AbsoluteLimitsTests-560447709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:32:23 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7effe36d-b7a7-48c4-92bd-5ce564dcd5e0 tempest-AbsoluteLimitsTests-560447709 None] Flow 'volume_create_manager' (83bb82e6-0a96-4d8a-9857-ba35e0508911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:32:23 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7effe36d-b7a7-48c4-92bd-5ce564dcd5e0 tempest-AbsoluteLimitsTests-560447709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee350c50-ac15-46a3-987d-baa906a78ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:32:23 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7effe36d-b7a7-48c4-92bd-5ce564dcd5e0 tempest-AbsoluteLimitsTests-560447709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee350c50-ac15-46a3-987d-baa906a78ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:32:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-272752288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7317ebf5-9657-48b5-aefd-b332171ae4ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b979624221394cd7a12d1fb64d4dbf7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:32:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:32:24Z,use_quota=True,user_id='c2d9e95d21cb4e7c82cf08a3d71aab67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:32:23 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7effe36d-b7a7-48c4-92bd-5ce564dcd5e0 tempest-AbsoluteLimitsTests-560447709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64421764-84a5-42cd-8d8f-ab8df51deb4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:32:23 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7effe36d-b7a7-48c4-92bd-5ce564dcd5e0 tempest-AbsoluteLimitsTests-560447709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64421764-84a5-42cd-8d8f-ab8df51deb4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:32:23 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7effe36d-b7a7-48c4-92bd-5ce564dcd5e0 tempest-AbsoluteLimitsTests-560447709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f19d268f-a035-4c34-b8d5-59fa1ac3705a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:32:23 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7effe36d-b7a7-48c4-92bd-5ce564dcd5e0 tempest-AbsoluteLimitsTests-560447709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f19d268f-a035-4c34-b8d5-59fa1ac3705a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7317ebf5-9657-48b5-aefd-b332171ae4ea', 'volume_name': 'volume-7317ebf5-9657-48b5-aefd-b332171ae4ea', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:32:23 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7effe36d-b7a7-48c4-92bd-5ce564dcd5e0 tempest-AbsoluteLimitsTests-560447709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cb540d5-0b68-4c4b-80f5-c84af97a5976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:32:23 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7effe36d-b7a7-48c4-92bd-5ce564dcd5e0 tempest-AbsoluteLimitsTests-560447709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cb540d5-0b68-4c4b-80f5-c84af97a5976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:32:23 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7effe36d-b7a7-48c4-92bd-5ce564dcd5e0 tempest-AbsoluteLimitsTests-560447709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de9d12d3-a538-43f0-a09c-1c432367ba68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:32:23 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-7effe36d-b7a7-48c4-92bd-5ce564dcd5e0 tempest-AbsoluteLimitsTests-560447709 None] Volume 7317ebf5-9657-48b5-aefd-b332171ae4ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7317ebf5-9657-48b5-aefd-b332171ae4ea', 'volume_size': 1} Sep 28 09:32:23 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-7effe36d-b7a7-48c4-92bd-5ce564dcd5e0 tempest-AbsoluteLimitsTests-560447709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:32:23 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-7effe36d-b7a7-48c4-92bd-5ce564dcd5e0 tempest-AbsoluteLimitsTests-560447709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:32:23 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-7effe36d-b7a7-48c4-92bd-5ce564dcd5e0 tempest-AbsoluteLimitsTests-560447709 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:32:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-272752288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7317ebf5-9657-48b5-aefd-b332171ae4ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b979624221394cd7a12d1fb64d4dbf7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:32:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:32:24Z,use_quota=True,user_id='c2d9e95d21cb4e7c82cf08a3d71aab67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:32:23 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-7effe36d-b7a7-48c4-92bd-5ce564dcd5e0 tempest-AbsoluteLimitsTests-560447709 None] Creating volume 7317ebf5-9657-48b5-aefd-b332171ae4ea {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:32:23 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-7effe36d-b7a7-48c4-92bd-5ce564dcd5e0 tempest-AbsoluteLimitsTests-560447709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:32:23 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-7effe36d-b7a7-48c4-92bd-5ce564dcd5e0 tempest-AbsoluteLimitsTests-560447709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:32:23 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-7effe36d-b7a7-48c4-92bd-5ce564dcd5e0 tempest-AbsoluteLimitsTests-560447709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:32:23 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-7effe36d-b7a7-48c4-92bd-5ce564dcd5e0 tempest-AbsoluteLimitsTests-560447709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:32:23 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-7effe36d-b7a7-48c4-92bd-5ce564dcd5e0 tempest-AbsoluteLimitsTests-560447709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:32:23 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-7effe36d-b7a7-48c4-92bd-5ce564dcd5e0 tempest-AbsoluteLimitsTests-560447709 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:32:23 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-7effe36d-b7a7-48c4-92bd-5ce564dcd5e0 tempest-AbsoluteLimitsTests-560447709 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:32:23 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-7effe36d-b7a7-48c4-92bd-5ce564dcd5e0 tempest-AbsoluteLimitsTests-560447709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-7317ebf5-9657-48b5-aefd-b332171ae4ea 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:32:23 devstack sudo[99517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-7317ebf5-9657-48b5-aefd-b332171ae4ea 1073741824 Sep 28 09:32:23 devstack sudo[99517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:32:24 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-f6f19b2d-6bac-4012-b11a-81eff0773366 tempest-VolumesImageMetadata-37211285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (769efdd4-f3a5-4174-bddb-fe7f848be208) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0ec0ae6a-a344-4f20-9c0c-a43c8e9b5e18', 'volume_name': 'volume-0ec0ae6a-a344-4f20-9c0c-a43c8e9b5e18', 'volume_size': 1, 'image_id': '1a11c21d-88b0-4620-aa82-1ded26f580c9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1a11c21d-88b0-4620-aa82-1ded26f580c9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b800784c68dc485682fd42484c46336e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1a11c21d-88b0-4620-aa82-1ded26f580c9', 'created_at': datetime.datetime(2026, 9, 28, 7, 16, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 7, 16, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a11c21d-88b0-4620-aa82-1ded26f580c9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:32:24 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-f6f19b2d-6bac-4012-b11a-81eff0773366 tempest-VolumesImageMetadata-37211285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc536201-538c-4deb-b85c-fe9071635143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:32:24 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-f6f19b2d-6bac-4012-b11a-81eff0773366 tempest-VolumesImageMetadata-37211285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc536201-538c-4deb-b85c-fe9071635143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:32:24 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-f6f19b2d-6bac-4012-b11a-81eff0773366 tempest-VolumesImageMetadata-37211285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (837e8ac5-5800-45ca-84f9-6a5c95037463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:32:24 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-f6f19b2d-6bac-4012-b11a-81eff0773366 tempest-VolumesImageMetadata-37211285 None] Volume 0ec0ae6a-a344-4f20-9c0c-a43c8e9b5e18: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0ec0ae6a-a344-4f20-9c0c-a43c8e9b5e18', 'volume_size': 1, 'image_id': '1a11c21d-88b0-4620-aa82-1ded26f580c9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1a11c21d-88b0-4620-aa82-1ded26f580c9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b800784c68dc485682fd42484c46336e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1a11c21d-88b0-4620-aa82-1ded26f580c9', 'created_at': datetime.datetime(2026, 9, 28, 7, 16, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 7, 16, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a11c21d-88b0-4620-aa82-1ded26f580c9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 09:32:24 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6f19b2d-6bac-4012-b11a-81eff0773366 tempest-VolumesImageMetadata-37211285 None] Trying to clone 0ec0ae6a-a344-4f20-9c0c-a43c8e9b5e18 from image 1a11c21d-88b0-4620-aa82-1ded26f580c9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1a11c21d-88b0-4620-aa82-1ded26f580c9', 'metadata': {}}]). {{(pid=86553) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 09:32:24 devstack sudo[99517]: pam_unix(sudo:session): session closed for user root Sep 28 09:32:24 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-7effe36d-b7a7-48c4-92bd-5ce564dcd5e0 tempest-AbsoluteLimitsTests-560447709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-7317ebf5-9657-48b5-aefd-b332171ae4ea 1073741824" returned: 0 in 0.618s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:32:24 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-7effe36d-b7a7-48c4-92bd-5ce564dcd5e0 tempest-AbsoluteLimitsTests-560447709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-7317ebf5-9657-48b5-aefd-b332171ae4ea {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:32:24 devstack cinder-volume[86553]: DEBUG cinder.image.image_utils [None req-f6f19b2d-6bac-4012-b11a-81eff0773366 tempest-VolumesImageMetadata-37211285 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1a11c21d-88b0-4620-aa82-1ded26f580c9_2joxe3m9devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86553) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 09:32:24 devstack cinder-volume[86553]: INFO cinder.image.image_utils [None req-f6f19b2d-6bac-4012-b11a-81eff0773366 tempest-VolumesImageMetadata-37211285 None] Image download 20.69 MB at 20.69 MB/s Sep 28 09:32:24 devstack sudo[99524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-7317ebf5-9657-48b5-aefd-b332171ae4ea Sep 28 09:32:24 devstack sudo[99524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:32:24 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[462414d2-3d8b-4247-9392-c636c987d2aa]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:32:24 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f6f19b2d-6bac-4012-b11a-81eff0773366 tempest-VolumesImageMetadata-37211285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1a11c21d-88b0-4620-aa82-1ded26f580c9_2joxe3m9devstack@QuobyteHD {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:32:24 devstack sudo[99526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1a11c21d-88b0-4620-aa82-1ded26f580c9_2joxe3m9devstack@QuobyteHD Sep 28 09:32:24 devstack sudo[99526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:32:24 devstack sudo[99524]: pam_unix(sudo:session): session closed for user root Sep 28 09:32:25 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-7effe36d-b7a7-48c4-92bd-5ce564dcd5e0 tempest-AbsoluteLimitsTests-560447709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-7317ebf5-9657-48b5-aefd-b332171ae4ea" returned: 0 in 0.330s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:32:25 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-7effe36d-b7a7-48c4-92bd-5ce564dcd5e0 tempest-AbsoluteLimitsTests-560447709 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:32:25 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-7effe36d-b7a7-48c4-92bd-5ce564dcd5e0 tempest-AbsoluteLimitsTests-560447709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:32:25 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7effe36d-b7a7-48c4-92bd-5ce564dcd5e0 tempest-AbsoluteLimitsTests-560447709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de9d12d3-a538-43f0-a09c-1c432367ba68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7317ebf5-9657-48b5-aefd-b332171ae4ea', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:32:25 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7effe36d-b7a7-48c4-92bd-5ce564dcd5e0 tempest-AbsoluteLimitsTests-560447709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95903dc6-ab88-44b2-8af1-1a0fc94a3e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:32:25 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-7effe36d-b7a7-48c4-92bd-5ce564dcd5e0 tempest-AbsoluteLimitsTests-560447709 None] Volume volume-7317ebf5-9657-48b5-aefd-b332171ae4ea (7317ebf5-9657-48b5-aefd-b332171ae4ea): created successfully Sep 28 09:32:25 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7effe36d-b7a7-48c4-92bd-5ce564dcd5e0 tempest-AbsoluteLimitsTests-560447709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95903dc6-ab88-44b2-8af1-1a0fc94a3e6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:32:25 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7effe36d-b7a7-48c4-92bd-5ce564dcd5e0 tempest-AbsoluteLimitsTests-560447709 None] Flow 'volume_create_manager' (83bb82e6-0a96-4d8a-9857-ba35e0508911) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:32:25 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-7effe36d-b7a7-48c4-92bd-5ce564dcd5e0 tempest-AbsoluteLimitsTests-560447709 None] Created volume successfully. Sep 28 09:32:25 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-1f19c473-1611-49ae-8c3e-8e136572885e tempest-GroupsTest-925794044 None] Update group completed successfully. Sep 28 09:32:25 devstack sudo[99526]: pam_unix(sudo:session): session closed for user root Sep 28 09:32:25 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f6f19b2d-6bac-4012-b11a-81eff0773366 tempest-VolumesImageMetadata-37211285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1a11c21d-88b0-4620-aa82-1ded26f580c9_2joxe3m9devstack@QuobyteHD" returned: 0 in 0.404s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:32:25 devstack cinder-volume[86553]: DEBUG cinder.image.image_utils [None req-f6f19b2d-6bac-4012-b11a-81eff0773366 tempest-VolumesImageMetadata-37211285 None] Temporary image 1a11c21d-88b0-4620-aa82-1ded26f580c9 is fetched for user 61804e808e7d470289805fcde4b81524. {{(pid=86553) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 09:32:25 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[883c6215-3761-4b9f-b8fa-0c4928b90aba]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:32:25 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f6f19b2d-6bac-4012-b11a-81eff0773366 tempest-VolumesImageMetadata-37211285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1a11c21d-88b0-4620-aa82-1ded26f580c9_2joxe3m9devstack@QuobyteHD {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:32:25 devstack sudo[99532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1a11c21d-88b0-4620-aa82-1ded26f580c9_2joxe3m9devstack@QuobyteHD Sep 28 09:32:25 devstack sudo[99532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:32:25 devstack sudo[99532]: pam_unix(sudo:session): session closed for user root Sep 28 09:32:25 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f6f19b2d-6bac-4012-b11a-81eff0773366 tempest-VolumesImageMetadata-37211285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1a11c21d-88b0-4620-aa82-1ded26f580c9_2joxe3m9devstack@QuobyteHD" returned: 0 in 0.374s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:32:25 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-f6f19b2d-6bac-4012-b11a-81eff0773366 tempest-VolumesImageMetadata-37211285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:32:25 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-f6f19b2d-6bac-4012-b11a-81eff0773366 tempest-VolumesImageMetadata-37211285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:32:25 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-f6f19b2d-6bac-4012-b11a-81eff0773366 tempest-VolumesImageMetadata-37211285 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:32:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1446410677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ec0ae6a-a344-4f20-9c0c-a43c8e9b5e18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2af1b09305de4e8e8c075cd5b30566c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:32:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:32:23Z,use_quota=True,user_id='61804e808e7d470289805fcde4b81524',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:32:25 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-f6f19b2d-6bac-4012-b11a-81eff0773366 tempest-VolumesImageMetadata-37211285 None] Creating volume 0ec0ae6a-a344-4f20-9c0c-a43c8e9b5e18 {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:32:25 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-f6f19b2d-6bac-4012-b11a-81eff0773366 tempest-VolumesImageMetadata-37211285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:32:25 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-f6f19b2d-6bac-4012-b11a-81eff0773366 tempest-VolumesImageMetadata-37211285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:32:25 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-f6f19b2d-6bac-4012-b11a-81eff0773366 tempest-VolumesImageMetadata-37211285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:32:25 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-f6f19b2d-6bac-4012-b11a-81eff0773366 tempest-VolumesImageMetadata-37211285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:32:25 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-f6f19b2d-6bac-4012-b11a-81eff0773366 tempest-VolumesImageMetadata-37211285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:32:25 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-f6f19b2d-6bac-4012-b11a-81eff0773366 tempest-VolumesImageMetadata-37211285 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:32:25 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-f6f19b2d-6bac-4012-b11a-81eff0773366 tempest-VolumesImageMetadata-37211285 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:32:25 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f6f19b2d-6bac-4012-b11a-81eff0773366 tempest-VolumesImageMetadata-37211285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-0ec0ae6a-a344-4f20-9c0c-a43c8e9b5e18 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:32:25 devstack sudo[99537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-0ec0ae6a-a344-4f20-9c0c-a43c8e9b5e18 1073741824 Sep 28 09:32:25 devstack sudo[99537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:32:26 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-0c67183b-5beb-4531-9f1c-6ad929bddaa9 tempest-AbsoluteLimitsTests-560447709 None] Acquiring lock "cinder-7317ebf5-9657-48b5-aefd-b332171ae4ea-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:32:26 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-0c67183b-5beb-4531-9f1c-6ad929bddaa9 tempest-AbsoluteLimitsTests-560447709 None] Lock "cinder-7317ebf5-9657-48b5-aefd-b332171ae4ea-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:32:26 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-0c67183b-5beb-4531-9f1c-6ad929bddaa9 tempest-AbsoluteLimitsTests-560447709 None] Acquiring lock "cinder-quobyte-7317ebf5-9657-48b5-aefd-b332171ae4ea" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:32:26 devstack sudo[99537]: pam_unix(sudo:session): session closed for user root Sep 28 09:32:26 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f6f19b2d-6bac-4012-b11a-81eff0773366 tempest-VolumesImageMetadata-37211285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-0ec0ae6a-a344-4f20-9c0c-a43c8e9b5e18 1073741824" returned: 0 in 0.580s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:32:26 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-0c67183b-5beb-4531-9f1c-6ad929bddaa9 tempest-AbsoluteLimitsTests-560447709 None] Lock "cinder-quobyte-7317ebf5-9657-48b5-aefd-b332171ae4ea" acquired by "delete_volume" :: waited 0.023s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:32:26 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd0b3b85-0eaf-4f0b-b4a3-1e8bcae23503]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:32:26 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0c67183b-5beb-4531-9f1c-6ad929bddaa9 tempest-AbsoluteLimitsTests-560447709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-7317ebf5-9657-48b5-aefd-b332171ae4ea {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:32:26 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f6f19b2d-6bac-4012-b11a-81eff0773366 tempest-VolumesImageMetadata-37211285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-0ec0ae6a-a344-4f20-9c0c-a43c8e9b5e18 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:32:26 devstack sudo[99544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-0ec0ae6a-a344-4f20-9c0c-a43c8e9b5e18 Sep 28 09:32:26 devstack sudo[99544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:32:26 devstack sudo[99543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-7317ebf5-9657-48b5-aefd-b332171ae4ea Sep 28 09:32:26 devstack sudo[99543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:32:26 devstack sudo[99544]: pam_unix(sudo:session): session closed for user root Sep 28 09:32:26 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f6f19b2d-6bac-4012-b11a-81eff0773366 tempest-VolumesImageMetadata-37211285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-0ec0ae6a-a344-4f20-9c0c-a43c8e9b5e18" returned: 0 in 0.315s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:32:26 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-f6f19b2d-6bac-4012-b11a-81eff0773366 tempest-VolumesImageMetadata-37211285 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:32:26 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-f6f19b2d-6bac-4012-b11a-81eff0773366 tempest-VolumesImageMetadata-37211285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:32:26 devstack cinder-volume[86553]: DEBUG cinder.volume.volume_utils [None req-f6f19b2d-6bac-4012-b11a-81eff0773366 tempest-VolumesImageMetadata-37211285 None] Attempting download of 1a11c21d-88b0-4620-aa82-1ded26f580c9 ((None, [{'url': 'file:///opt/stack/data/glance/images/1a11c21d-88b0-4620-aa82-1ded26f580c9', 'metadata': {}}])) to volume 0ec0ae6a-a344-4f20-9c0c-a43c8e9b5e18. {{(pid=86553) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 09:32:26 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[f44581f0-9616-4947-a2fe-c822b61a05ac]: (4, 'raw') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:32:26 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f6f19b2d-6bac-4012-b11a-81eff0773366 tempest-VolumesImageMetadata-37211285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1a11c21d-88b0-4620-aa82-1ded26f580c9_5awkcrxd {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:32:26 devstack sudo[99543]: pam_unix(sudo:session): session closed for user root Sep 28 09:32:26 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0c67183b-5beb-4531-9f1c-6ad929bddaa9 tempest-AbsoluteLimitsTests-560447709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-7317ebf5-9657-48b5-aefd-b332171ae4ea" returned: 0 in 0.534s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:32:26 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0c67183b-5beb-4531-9f1c-6ad929bddaa9 tempest-AbsoluteLimitsTests-560447709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-7317ebf5-9657-48b5-aefd-b332171ae4ea {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:32:26 devstack sudo[99552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-7317ebf5-9657-48b5-aefd-b332171ae4ea Sep 28 09:32:26 devstack sudo[99552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:32:26 devstack sudo[99551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1a11c21d-88b0-4620-aa82-1ded26f580c9_5awkcrxd Sep 28 09:32:26 devstack sudo[99551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:32:27 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-be6fed63-84b5-447a-b873-86552762327b tempest-GroupsTest-925794044 None] Acquiring lock "cinder-quobyte-3a031c73-849f-4095-9108-cccdac533d52" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:32:27 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-be6fed63-84b5-447a-b873-86552762327b tempest-GroupsTest-925794044 None] Lock "cinder-quobyte-3a031c73-849f-4095-9108-cccdac533d52" acquired by "delete_volume" :: waited 0.028s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:32:27 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a8aeb05-d075-46bb-af5f-ae05e0baaad4]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:32:27 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-be6fed63-84b5-447a-b873-86552762327b tempest-GroupsTest-925794044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3a031c73-849f-4095-9108-cccdac533d52 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:32:27 devstack sudo[99552]: pam_unix(sudo:session): session closed for user root Sep 28 09:32:27 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0c67183b-5beb-4531-9f1c-6ad929bddaa9 tempest-AbsoluteLimitsTests-560447709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-7317ebf5-9657-48b5-aefd-b332171ae4ea" returned: 0 in 0.356s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:32:27 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-0c67183b-5beb-4531-9f1c-6ad929bddaa9 tempest-AbsoluteLimitsTests-560447709 None] Lock "cinder-quobyte-7317ebf5-9657-48b5-aefd-b332171ae4ea" released by "delete_volume" :: held 0.962s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:32:27 devstack sudo[99551]: pam_unix(sudo:session): session closed for user root Sep 28 09:32:27 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f6f19b2d-6bac-4012-b11a-81eff0773366 tempest-VolumesImageMetadata-37211285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1a11c21d-88b0-4620-aa82-1ded26f580c9_5awkcrxd" returned: 0 in 0.467s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:32:27 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f6f19b2d-6bac-4012-b11a-81eff0773366 tempest-VolumesImageMetadata-37211285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1a11c21d-88b0-4620-aa82-1ded26f580c9_5awkcrxd {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:32:27 devstack sudo[99556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3a031c73-849f-4095-9108-cccdac533d52 Sep 28 09:32:27 devstack sudo[99556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:32:27 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-0c67183b-5beb-4531-9f1c-6ad929bddaa9 tempest-AbsoluteLimitsTests-560447709 None] Created reservations ['a294929c-9759-4032-b54d-79431f3d0d0d', 'bb5c571b-ddcc-49fd-b315-663fdb997bcc', '812f111d-ded6-4b71-85d9-9c8d1c67191b', '5802f944-433e-49b4-ba9d-1f25201ac2f2'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:32:27 devstack sudo[99559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1a11c21d-88b0-4620-aa82-1ded26f580c9_5awkcrxd Sep 28 09:32:27 devstack sudo[99559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:32:27 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-0c67183b-5beb-4531-9f1c-6ad929bddaa9 tempest-AbsoluteLimitsTests-560447709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:32:27 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-0c67183b-5beb-4531-9f1c-6ad929bddaa9 tempest-AbsoluteLimitsTests-560447709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:32:27 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-0c67183b-5beb-4531-9f1c-6ad929bddaa9 tempest-AbsoluteLimitsTests-560447709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:32:27 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-0c67183b-5beb-4531-9f1c-6ad929bddaa9 tempest-AbsoluteLimitsTests-560447709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:32:27 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-0c67183b-5beb-4531-9f1c-6ad929bddaa9 tempest-AbsoluteLimitsTests-560447709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:32:27 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0c67183b-5beb-4531-9f1c-6ad929bddaa9 tempest-AbsoluteLimitsTests-560447709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:32:27 devstack sudo[99562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:32:27 devstack sudo[99562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:32:27 devstack sudo[99556]: pam_unix(sudo:session): session closed for user root Sep 28 09:32:27 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-be6fed63-84b5-447a-b873-86552762327b tempest-GroupsTest-925794044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3a031c73-849f-4095-9108-cccdac533d52" returned: 0 in 0.468s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:32:27 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-be6fed63-84b5-447a-b873-86552762327b tempest-GroupsTest-925794044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3a031c73-849f-4095-9108-cccdac533d52 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:32:27 devstack sudo[99567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3a031c73-849f-4095-9108-cccdac533d52 Sep 28 09:32:27 devstack sudo[99567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:32:27 devstack sudo[99559]: pam_unix(sudo:session): session closed for user root Sep 28 09:32:27 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f6f19b2d-6bac-4012-b11a-81eff0773366 tempest-VolumesImageMetadata-37211285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1a11c21d-88b0-4620-aa82-1ded26f580c9_5awkcrxd" returned: 1 in 0.449s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:32:27 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f6f19b2d-6bac-4012-b11a-81eff0773366 tempest-VolumesImageMetadata-37211285 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1a11c21d-88b0-4620-aa82-1ded26f580c9_5awkcrxd' failed. Not Retrying. {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 09:32:27 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ddf5b7b-49b8-48de-b2eb-c61902a2d9b6]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:32:27 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f6f19b2d-6bac-4012-b11a-81eff0773366 tempest-VolumesImageMetadata-37211285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1a11c21d-88b0-4620-aa82-1ded26f580c9_2joxe3m9devstack@QuobyteHD {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:32:27 devstack sudo[99562]: pam_unix(sudo:session): session closed for user root Sep 28 09:32:27 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0c67183b-5beb-4531-9f1c-6ad929bddaa9 tempest-AbsoluteLimitsTests-560447709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.342s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:32:27 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-0c67183b-5beb-4531-9f1c-6ad929bddaa9 tempest-AbsoluteLimitsTests-560447709 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:32:27 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-0c67183b-5beb-4531-9f1c-6ad929bddaa9 tempest-AbsoluteLimitsTests-560447709 None] Deleted volume successfully. Sep 28 09:32:27 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-0c67183b-5beb-4531-9f1c-6ad929bddaa9 tempest-AbsoluteLimitsTests-560447709 None] Lock "cinder-7317ebf5-9657-48b5-aefd-b332171ae4ea-delete_volume" released by "delete_volume" :: held 1.657s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:32:27 devstack sudo[99574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1a11c21d-88b0-4620-aa82-1ded26f580c9_2joxe3m9devstack@QuobyteHD Sep 28 09:32:27 devstack sudo[99574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:32:27 devstack sudo[99567]: pam_unix(sudo:session): session closed for user root Sep 28 09:32:27 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-be6fed63-84b5-447a-b873-86552762327b tempest-GroupsTest-925794044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3a031c73-849f-4095-9108-cccdac533d52" returned: 0 in 0.345s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:32:27 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-be6fed63-84b5-447a-b873-86552762327b tempest-GroupsTest-925794044 None] Lock "cinder-quobyte-3a031c73-849f-4095-9108-cccdac533d52" released by "delete_volume" :: held 0.893s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:32:27 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-be6fed63-84b5-447a-b873-86552762327b tempest-GroupsTest-925794044 None] Acquiring lock "cinder-quobyte-56799e3c-86a0-4f74-aa42-ab406b616e56" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:32:27 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-be6fed63-84b5-447a-b873-86552762327b tempest-GroupsTest-925794044 None] Lock "cinder-quobyte-56799e3c-86a0-4f74-aa42-ab406b616e56" acquired by "delete_volume" :: waited 0.019s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:32:27 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcae2700-2760-4217-be43-c3e87e1d08f5]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:32:27 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-be6fed63-84b5-447a-b873-86552762327b tempest-GroupsTest-925794044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-56799e3c-86a0-4f74-aa42-ab406b616e56 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:32:28 devstack sudo[99574]: pam_unix(sudo:session): session closed for user root Sep 28 09:32:28 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f6f19b2d-6bac-4012-b11a-81eff0773366 tempest-VolumesImageMetadata-37211285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1a11c21d-88b0-4620-aa82-1ded26f580c9_2joxe3m9devstack@QuobyteHD" returned: 0 in 0.384s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:32:28 devstack cinder-volume[86553]: DEBUG cinder.image.image_utils [None req-f6f19b2d-6bac-4012-b11a-81eff0773366 tempest-VolumesImageMetadata-37211285 None] 1a11c21d-88b0-4620-aa82-1ded26f580c9 was qcow2, converting to qcow2 {{(pid=86553) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 09:32:28 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f6f19b2d-6bac-4012-b11a-81eff0773366 tempest-VolumesImageMetadata-37211285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1a11c21d-88b0-4620-aa82-1ded26f580c9_2joxe3m9devstack@QuobyteHD /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-0ec0ae6a-a344-4f20-9c0c-a43c8e9b5e18 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:32:28 devstack sudo[99581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1a11c21d-88b0-4620-aa82-1ded26f580c9_2joxe3m9devstack@QuobyteHD /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-0ec0ae6a-a344-4f20-9c0c-a43c8e9b5e18 Sep 28 09:32:28 devstack sudo[99581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:32:28 devstack sudo[99577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-56799e3c-86a0-4f74-aa42-ab406b616e56 Sep 28 09:32:28 devstack sudo[99577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:32:28 devstack sudo[99577]: pam_unix(sudo:session): session closed for user root Sep 28 09:32:28 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-be6fed63-84b5-447a-b873-86552762327b tempest-GroupsTest-925794044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-56799e3c-86a0-4f74-aa42-ab406b616e56" returned: 0 in 0.435s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:32:28 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-be6fed63-84b5-447a-b873-86552762327b tempest-GroupsTest-925794044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-56799e3c-86a0-4f74-aa42-ab406b616e56 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:32:28 devstack sudo[99590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-56799e3c-86a0-4f74-aa42-ab406b616e56 Sep 28 09:32:28 devstack sudo[99590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:32:28 devstack sudo[99590]: pam_unix(sudo:session): session closed for user root Sep 28 09:32:28 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-be6fed63-84b5-447a-b873-86552762327b tempest-GroupsTest-925794044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-56799e3c-86a0-4f74-aa42-ab406b616e56" returned: 0 in 0.310s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:32:28 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-be6fed63-84b5-447a-b873-86552762327b tempest-GroupsTest-925794044 None] Lock "cinder-quobyte-56799e3c-86a0-4f74-aa42-ab406b616e56" released by "delete_volume" :: held 0.799s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:32:28 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-be6fed63-84b5-447a-b873-86552762327b tempest-GroupsTest-925794044 None] Created reservations ['f26b4c69-13c0-4362-ab95-8bebbfbc8fa1'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:32:28 devstack cinder-volume[86553]: WARNING cinder.quota [None req-be6fed63-84b5-447a-b873-86552762327b tempest-GroupsTest-925794044 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-129280727 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-129280727, it is now deprecated. Please use the default quota class for default quota. Sep 28 09:32:28 devstack cinder-volume[86553]: WARNING cinder.quota [None req-be6fed63-84b5-447a-b873-86552762327b tempest-GroupsTest-925794044 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-129280727 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-129280727, it is now deprecated. Please use the default quota class for default quota. Sep 28 09:32:28 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-be6fed63-84b5-447a-b873-86552762327b tempest-GroupsTest-925794044 None] Created reservations ['c76be861-deec-40fc-b077-0d15de4aa71a', '7d277a5b-21ff-42f9-bfba-1984f8b0a08e', 'b7e8b629-b0ba-4b72-9f0f-1df37fc1c77d', 'bf822730-319c-492f-b413-fe51c2b398b1'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:32:29 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-be6fed63-84b5-447a-b873-86552762327b tempest-GroupsTest-925794044 None] Created reservations ['e45f8577-6ff1-4cf6-9c28-fb5a9a526d17', '11c6268a-d683-4caf-be6e-957c7c1cc05d', 'f2fe4e48-ffcd-496f-9828-9ec5b29ef5f7', '00104116-bb33-4e78-9e4e-cfbca572619a'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:32:29 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-be6fed63-84b5-447a-b873-86552762327b tempest-GroupsTest-925794044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:32:29 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-be6fed63-84b5-447a-b873-86552762327b tempest-GroupsTest-925794044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:32:29 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-be6fed63-84b5-447a-b873-86552762327b tempest-GroupsTest-925794044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:32:29 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-be6fed63-84b5-447a-b873-86552762327b tempest-GroupsTest-925794044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:32:29 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-be6fed63-84b5-447a-b873-86552762327b tempest-GroupsTest-925794044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:32:29 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-be6fed63-84b5-447a-b873-86552762327b tempest-GroupsTest-925794044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:32:29 devstack sudo[99596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:32:29 devstack sudo[99596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:32:29 devstack sudo[99596]: pam_unix(sudo:session): session closed for user root Sep 28 09:32:29 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-be6fed63-84b5-447a-b873-86552762327b tempest-GroupsTest-925794044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.357s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:32:29 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-be6fed63-84b5-447a-b873-86552762327b tempest-GroupsTest-925794044 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:32:29 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-be6fed63-84b5-447a-b873-86552762327b tempest-GroupsTest-925794044 None] Delete group completed successfully. Sep 28 09:32:30 devstack sudo[99581]: pam_unix(sudo:session): session closed for user root Sep 28 09:32:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f6f19b2d-6bac-4012-b11a-81eff0773366 tempest-VolumesImageMetadata-37211285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1a11c21d-88b0-4620-aa82-1ded26f580c9_2joxe3m9devstack@QuobyteHD /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-0ec0ae6a-a344-4f20-9c0c-a43c8e9b5e18" returned: 0 in 2.582s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:32:30 devstack cinder-volume[86553]: DEBUG cinder.image.image_utils [None req-f6f19b2d-6bac-4012-b11a-81eff0773366 tempest-VolumesImageMetadata-37211285 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1a11c21d-88b0-4620-aa82-1ded26f580c9_2joxe3m9devstack@QuobyteHD, size 112.00 MB, duration 2.58 sec, destination /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-0ec0ae6a-a344-4f20-9c0c-a43c8e9b5e18 {{(pid=86553) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 09:32:30 devstack cinder-volume[86553]: INFO cinder.image.image_utils [None req-f6f19b2d-6bac-4012-b11a-81eff0773366 tempest-VolumesImageMetadata-37211285 None] Converted 112.00 MB image at 43.34 MB/s Sep 28 09:32:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f6f19b2d-6bac-4012-b11a-81eff0773366 tempest-VolumesImageMetadata-37211285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-0ec0ae6a-a344-4f20-9c0c-a43c8e9b5e18 1G {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:32:30 devstack sudo[99600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-0ec0ae6a-a344-4f20-9c0c-a43c8e9b5e18 1G Sep 28 09:32:30 devstack sudo[99600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:32:31 devstack sudo[99600]: pam_unix(sudo:session): session closed for user root Sep 28 09:32:31 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f6f19b2d-6bac-4012-b11a-81eff0773366 tempest-VolumesImageMetadata-37211285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-0ec0ae6a-a344-4f20-9c0c-a43c8e9b5e18 1G" returned: 0 in 0.555s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:32:31 devstack cinder-volume[86553]: DEBUG cinder.volume.volume_utils [None req-f6f19b2d-6bac-4012-b11a-81eff0773366 tempest-VolumesImageMetadata-37211285 None] Downloaded image 1a11c21d-88b0-4620-aa82-1ded26f580c9 ((None, [{'url': 'file:///opt/stack/data/glance/images/1a11c21d-88b0-4620-aa82-1ded26f580c9', 'metadata': {}}])) to volume 0ec0ae6a-a344-4f20-9c0c-a43c8e9b5e18 successfully. {{(pid=86553) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 09:32:31 devstack cinder-volume[86553]: DEBUG cinder.image.image_utils [None req-f6f19b2d-6bac-4012-b11a-81eff0773366 tempest-VolumesImageMetadata-37211285 None] Temporary image 1a11c21d-88b0-4620-aa82-1ded26f580c9 for user 61804e808e7d470289805fcde4b81524 is deleted. {{(pid=86553) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 09:32:31 devstack cinder-volume[86553]: DEBUG cinder.volume.volume_utils [None req-f6f19b2d-6bac-4012-b11a-81eff0773366 tempest-VolumesImageMetadata-37211285 None] Marking volume 0ec0ae6a-a344-4f20-9c0c-a43c8e9b5e18 as bootable. {{(pid=86553) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 09:32:31 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6f19b2d-6bac-4012-b11a-81eff0773366 tempest-VolumesImageMetadata-37211285 None] Copying metadata from image 1a11c21d-88b0-4620-aa82-1ded26f580c9 to 0ec0ae6a-a344-4f20-9c0c-a43c8e9b5e18. {{(pid=86553) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 09:32:31 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6f19b2d-6bac-4012-b11a-81eff0773366 tempest-VolumesImageMetadata-37211285 None] Creating volume glance metadata for volume 0ec0ae6a-a344-4f20-9c0c-a43c8e9b5e18 backed by image 1a11c21d-88b0-4620-aa82-1ded26f580c9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '1a11c21d-88b0-4620-aa82-1ded26f580c9', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86553) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 09:32:31 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-f6f19b2d-6bac-4012-b11a-81eff0773366 tempest-VolumesImageMetadata-37211285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (837e8ac5-5800-45ca-84f9-6a5c95037463) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ec0ae6a-a344-4f20-9c0c-a43c8e9b5e18', 'volume_size': 1, 'image_id': '1a11c21d-88b0-4620-aa82-1ded26f580c9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1a11c21d-88b0-4620-aa82-1ded26f580c9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b800784c68dc485682fd42484c46336e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1a11c21d-88b0-4620-aa82-1ded26f580c9', 'created_at': datetime.datetime(2026, 9, 28, 7, 16, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 7, 16, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a11c21d-88b0-4620-aa82-1ded26f580c9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:32:31 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-f6f19b2d-6bac-4012-b11a-81eff0773366 tempest-VolumesImageMetadata-37211285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f703cc40-8281-4ee3-b759-52368d606bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:32:31 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-f6f19b2d-6bac-4012-b11a-81eff0773366 tempest-VolumesImageMetadata-37211285 None] Volume volume-0ec0ae6a-a344-4f20-9c0c-a43c8e9b5e18 (0ec0ae6a-a344-4f20-9c0c-a43c8e9b5e18): created successfully Sep 28 09:32:31 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-f6f19b2d-6bac-4012-b11a-81eff0773366 tempest-VolumesImageMetadata-37211285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f703cc40-8281-4ee3-b759-52368d606bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:32:31 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-f6f19b2d-6bac-4012-b11a-81eff0773366 tempest-VolumesImageMetadata-37211285 None] Flow 'volume_create_manager' (26ef326f-bf27-440e-a04b-edd69527b8bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:32:31 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-f6f19b2d-6bac-4012-b11a-81eff0773366 tempest-VolumesImageMetadata-37211285 None] Created volume successfully. Sep 28 09:32:32 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-929e910e-6bda-4e22-b682-92bc2743c4aa tempest-VolumesImageMetadata-37211285 None] Acquiring lock "cinder-0ec0ae6a-a344-4f20-9c0c-a43c8e9b5e18-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:32:32 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-929e910e-6bda-4e22-b682-92bc2743c4aa tempest-VolumesImageMetadata-37211285 None] Lock "cinder-0ec0ae6a-a344-4f20-9c0c-a43c8e9b5e18-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:32:33 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-929e910e-6bda-4e22-b682-92bc2743c4aa tempest-VolumesImageMetadata-37211285 None] Acquiring lock "cinder-quobyte-0ec0ae6a-a344-4f20-9c0c-a43c8e9b5e18" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:32:33 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-929e910e-6bda-4e22-b682-92bc2743c4aa tempest-VolumesImageMetadata-37211285 None] Lock "cinder-quobyte-0ec0ae6a-a344-4f20-9c0c-a43c8e9b5e18" acquired by "delete_volume" :: waited 0.027s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:32:33 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[2867d608-56ba-4679-ae71-d3871375a9cb]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:32:33 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-929e910e-6bda-4e22-b682-92bc2743c4aa tempest-VolumesImageMetadata-37211285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-0ec0ae6a-a344-4f20-9c0c-a43c8e9b5e18 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:32:33 devstack sudo[99613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-0ec0ae6a-a344-4f20-9c0c-a43c8e9b5e18 Sep 28 09:32:33 devstack sudo[99613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:32:33 devstack sudo[99613]: pam_unix(sudo:session): session closed for user root Sep 28 09:32:33 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-929e910e-6bda-4e22-b682-92bc2743c4aa tempest-VolumesImageMetadata-37211285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-0ec0ae6a-a344-4f20-9c0c-a43c8e9b5e18" returned: 0 in 0.498s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:32:33 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-929e910e-6bda-4e22-b682-92bc2743c4aa tempest-VolumesImageMetadata-37211285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-0ec0ae6a-a344-4f20-9c0c-a43c8e9b5e18 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:32:33 devstack sudo[99618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-0ec0ae6a-a344-4f20-9c0c-a43c8e9b5e18 Sep 28 09:32:33 devstack sudo[99618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:32:33 devstack sudo[99618]: pam_unix(sudo:session): session closed for user root Sep 28 09:32:33 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-929e910e-6bda-4e22-b682-92bc2743c4aa tempest-VolumesImageMetadata-37211285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-0ec0ae6a-a344-4f20-9c0c-a43c8e9b5e18" returned: 0 in 0.353s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:32:33 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-929e910e-6bda-4e22-b682-92bc2743c4aa tempest-VolumesImageMetadata-37211285 None] Lock "cinder-quobyte-0ec0ae6a-a344-4f20-9c0c-a43c8e9b5e18" released by "delete_volume" :: held 0.910s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:32:34 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-929e910e-6bda-4e22-b682-92bc2743c4aa tempest-VolumesImageMetadata-37211285 None] Created reservations ['482f7705-7ecd-4f28-8d0d-6b348c8ddb2d', 'b67b9ed2-2e42-41a5-a893-b736462d27f6', '82bca6ff-b204-4201-8954-164b01fffa52', 'f5a70efe-1c4e-4830-a36a-11078f19cb7a'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:32:34 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-929e910e-6bda-4e22-b682-92bc2743c4aa tempest-VolumesImageMetadata-37211285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:32:34 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-929e910e-6bda-4e22-b682-92bc2743c4aa tempest-VolumesImageMetadata-37211285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:32:34 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-929e910e-6bda-4e22-b682-92bc2743c4aa tempest-VolumesImageMetadata-37211285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:32:34 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-929e910e-6bda-4e22-b682-92bc2743c4aa tempest-VolumesImageMetadata-37211285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:32:34 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-929e910e-6bda-4e22-b682-92bc2743c4aa tempest-VolumesImageMetadata-37211285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:32:34 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-929e910e-6bda-4e22-b682-92bc2743c4aa tempest-VolumesImageMetadata-37211285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:32:34 devstack sudo[99621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:32:34 devstack sudo[99621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:32:34 devstack sudo[99621]: pam_unix(sudo:session): session closed for user root Sep 28 09:32:34 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-929e910e-6bda-4e22-b682-92bc2743c4aa tempest-VolumesImageMetadata-37211285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.341s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:32:34 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-929e910e-6bda-4e22-b682-92bc2743c4aa tempest-VolumesImageMetadata-37211285 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:32:34 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-929e910e-6bda-4e22-b682-92bc2743c4aa tempest-VolumesImageMetadata-37211285 None] Deleted volume successfully. Sep 28 09:32:34 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-929e910e-6bda-4e22-b682-92bc2743c4aa tempest-VolumesImageMetadata-37211285 None] Lock "cinder-0ec0ae6a-a344-4f20-9c0c-a43c8e9b5e18-delete_volume" released by "delete_volume" :: held 1.612s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:32:36 devstack cinder-volume[86553]: DEBUG dbcounter [-] [86553] Writing DB stats cinder:SELECT=165,cinder:UPDATE=205,cinder:INSERT=50,cinder:DELETE=10 {{(pid=86553) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 09:32:36 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ce5732c-95fe-4e25-b168-0bcc9c8439c7 tempest-VolumesDeleteCascade-1244338346 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:32:36 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0ce5732c-95fe-4e25-b168-0bcc9c8439c7 tempest-VolumesDeleteCascade-1244338346 None] Flow 'volume_create_manager' (264194be-30fc-4e62-8e57-a7f5850df56c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:32:36 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0ce5732c-95fe-4e25-b168-0bcc9c8439c7 tempest-VolumesDeleteCascade-1244338346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a79b7c03-0c87-4234-ba07-74a154f336ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:32:36 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0ce5732c-95fe-4e25-b168-0bcc9c8439c7 tempest-VolumesDeleteCascade-1244338346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a79b7c03-0c87-4234-ba07-74a154f336ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:32:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2033112641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ba3624e-bbbc-4e79-a564-0c2025a7d095,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c488dfb6dd74519a316387bbe015180',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:32:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:32:36Z,use_quota=True,user_id='de93fe157e72427aba7706c3b000441c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:32:36 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0ce5732c-95fe-4e25-b168-0bcc9c8439c7 tempest-VolumesDeleteCascade-1244338346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d91e3459-66de-4406-a0b0-80a5c8048bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:32:36 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0ce5732c-95fe-4e25-b168-0bcc9c8439c7 tempest-VolumesDeleteCascade-1244338346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d91e3459-66de-4406-a0b0-80a5c8048bf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:32:36 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0ce5732c-95fe-4e25-b168-0bcc9c8439c7 tempest-VolumesDeleteCascade-1244338346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d5c2e71-62d0-4db6-9ce7-1647b7dba0c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:32:36 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0ce5732c-95fe-4e25-b168-0bcc9c8439c7 tempest-VolumesDeleteCascade-1244338346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d5c2e71-62d0-4db6-9ce7-1647b7dba0c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ba3624e-bbbc-4e79-a564-0c2025a7d095', 'volume_name': 'volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:32:36 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0ce5732c-95fe-4e25-b168-0bcc9c8439c7 tempest-VolumesDeleteCascade-1244338346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5332eb55-07f0-4cee-861d-7bba2413f24f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:32:36 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0ce5732c-95fe-4e25-b168-0bcc9c8439c7 tempest-VolumesDeleteCascade-1244338346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5332eb55-07f0-4cee-861d-7bba2413f24f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:32:36 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0ce5732c-95fe-4e25-b168-0bcc9c8439c7 tempest-VolumesDeleteCascade-1244338346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d3e3876-d0b7-45c7-8a10-b6248d541d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:32:36 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-0ce5732c-95fe-4e25-b168-0bcc9c8439c7 tempest-VolumesDeleteCascade-1244338346 None] Volume 3ba3624e-bbbc-4e79-a564-0c2025a7d095: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095', 'volume_size': 1} Sep 28 09:32:36 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-0ce5732c-95fe-4e25-b168-0bcc9c8439c7 tempest-VolumesDeleteCascade-1244338346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:32:36 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-0ce5732c-95fe-4e25-b168-0bcc9c8439c7 tempest-VolumesDeleteCascade-1244338346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:32:36 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-0ce5732c-95fe-4e25-b168-0bcc9c8439c7 tempest-VolumesDeleteCascade-1244338346 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:32:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2033112641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ba3624e-bbbc-4e79-a564-0c2025a7d095,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c488dfb6dd74519a316387bbe015180',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:32:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:32:36Z,use_quota=True,user_id='de93fe157e72427aba7706c3b000441c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:32:36 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-0ce5732c-95fe-4e25-b168-0bcc9c8439c7 tempest-VolumesDeleteCascade-1244338346 None] Creating volume 3ba3624e-bbbc-4e79-a564-0c2025a7d095 {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:32:36 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-0ce5732c-95fe-4e25-b168-0bcc9c8439c7 tempest-VolumesDeleteCascade-1244338346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:32:36 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-0ce5732c-95fe-4e25-b168-0bcc9c8439c7 tempest-VolumesDeleteCascade-1244338346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:32:36 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-0ce5732c-95fe-4e25-b168-0bcc9c8439c7 tempest-VolumesDeleteCascade-1244338346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:32:36 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-0ce5732c-95fe-4e25-b168-0bcc9c8439c7 tempest-VolumesDeleteCascade-1244338346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:32:36 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-0ce5732c-95fe-4e25-b168-0bcc9c8439c7 tempest-VolumesDeleteCascade-1244338346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:32:36 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-0ce5732c-95fe-4e25-b168-0bcc9c8439c7 tempest-VolumesDeleteCascade-1244338346 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:32:36 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-0ce5732c-95fe-4e25-b168-0bcc9c8439c7 tempest-VolumesDeleteCascade-1244338346 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:32:36 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0ce5732c-95fe-4e25-b168-0bcc9c8439c7 tempest-VolumesDeleteCascade-1244338346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:32:36 devstack sudo[99624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095 1073741824 Sep 28 09:32:36 devstack sudo[99624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:32:37 devstack sudo[99624]: pam_unix(sudo:session): session closed for user root Sep 28 09:32:37 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0ce5732c-95fe-4e25-b168-0bcc9c8439c7 tempest-VolumesDeleteCascade-1244338346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095 1073741824" returned: 0 in 0.737s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:32:37 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0ce5732c-95fe-4e25-b168-0bcc9c8439c7 tempest-VolumesDeleteCascade-1244338346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:32:37 devstack sudo[99630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095 Sep 28 09:32:37 devstack sudo[99630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:32:37 devstack sudo[99630]: pam_unix(sudo:session): session closed for user root Sep 28 09:32:37 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0ce5732c-95fe-4e25-b168-0bcc9c8439c7 tempest-VolumesDeleteCascade-1244338346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095" returned: 0 in 0.322s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:32:37 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-0ce5732c-95fe-4e25-b168-0bcc9c8439c7 tempest-VolumesDeleteCascade-1244338346 None] <== create_volume: return (1113ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:32:37 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-0ce5732c-95fe-4e25-b168-0bcc9c8439c7 tempest-VolumesDeleteCascade-1244338346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.115s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:32:37 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0ce5732c-95fe-4e25-b168-0bcc9c8439c7 tempest-VolumesDeleteCascade-1244338346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d3e3876-d0b7-45c7-8a10-b6248d541d10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:32:37 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0ce5732c-95fe-4e25-b168-0bcc9c8439c7 tempest-VolumesDeleteCascade-1244338346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (922c5c22-df51-494e-bb1d-42740ce8da9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:32:37 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-0ce5732c-95fe-4e25-b168-0bcc9c8439c7 tempest-VolumesDeleteCascade-1244338346 None] Volume volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095 (3ba3624e-bbbc-4e79-a564-0c2025a7d095): created successfully Sep 28 09:32:37 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0ce5732c-95fe-4e25-b168-0bcc9c8439c7 tempest-VolumesDeleteCascade-1244338346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (922c5c22-df51-494e-bb1d-42740ce8da9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:32:37 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0ce5732c-95fe-4e25-b168-0bcc9c8439c7 tempest-VolumesDeleteCascade-1244338346 None] Flow 'volume_create_manager' (264194be-30fc-4e62-8e57-a7f5850df56c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:32:37 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-0ce5732c-95fe-4e25-b168-0bcc9c8439c7 tempest-VolumesDeleteCascade-1244338346 None] Created volume successfully. Sep 28 09:32:38 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-50089dc0-a06b-4b5f-b8bb-62688d8ecc4c tempest-VolumesDeleteCascade-1244338346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:32:38 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-50089dc0-a06b-4b5f-b8bb-62688d8ecc4c tempest-VolumesDeleteCascade-1244338346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:32:38 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-50089dc0-a06b-4b5f-b8bb-62688d8ecc4c tempest-VolumesDeleteCascade-1244338346 None] Creating offline snapshot 29a8b366-10df-403a-9d28-1d03eb8708f4 of volume 3ba3624e-bbbc-4e79-a564-0c2025a7d095 {{(pid=86553) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 09:32:38 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff68d379-cf11-4428-9813-a3a040c93af2]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:32:38 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-50089dc0-a06b-4b5f-b8bb-62688d8ecc4c tempest-VolumesDeleteCascade-1244338346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:32:38 devstack sudo[99634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095 Sep 28 09:32:38 devstack sudo[99634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:32:39 devstack sudo[99634]: pam_unix(sudo:session): session closed for user root Sep 28 09:32:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-50089dc0-a06b-4b5f-b8bb-62688d8ecc4c tempest-VolumesDeleteCascade-1244338346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095" returned: 0 in 0.417s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:32:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-50089dc0-a06b-4b5f-b8bb-62688d8ecc4c tempest-VolumesDeleteCascade-1244338346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095.29a8b366-10df-403a-9d28-1d03eb8708f4 1G {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:32:39 devstack sudo[99639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095.29a8b366-10df-403a-9d28-1d03eb8708f4 1G Sep 28 09:32:39 devstack sudo[99639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:32:39 devstack sudo[99639]: pam_unix(sudo:session): session closed for user root Sep 28 09:32:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-50089dc0-a06b-4b5f-b8bb-62688d8ecc4c tempest-VolumesDeleteCascade-1244338346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095.29a8b366-10df-403a-9d28-1d03eb8708f4 1G" returned: 0 in 0.493s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:32:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-50089dc0-a06b-4b5f-b8bb-62688d8ecc4c tempest-VolumesDeleteCascade-1244338346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095 -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095.29a8b366-10df-403a-9d28-1d03eb8708f4 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:32:39 devstack sudo[99645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095 -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095.29a8b366-10df-403a-9d28-1d03eb8708f4 Sep 28 09:32:39 devstack sudo[99645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:32:40 devstack sudo[99645]: pam_unix(sudo:session): session closed for user root Sep 28 09:32:40 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-50089dc0-a06b-4b5f-b8bb-62688d8ecc4c tempest-VolumesDeleteCascade-1244338346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095 -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095.29a8b366-10df-403a-9d28-1d03eb8708f4" returned: 0 in 0.374s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:32:40 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-50089dc0-a06b-4b5f-b8bb-62688d8ecc4c tempest-VolumesDeleteCascade-1244338346 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095.29a8b366-10df-403a-9d28-1d03eb8708f4 is being set with open permissions: ugo+rw Sep 28 09:32:40 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-50089dc0-a06b-4b5f-b8bb-62688d8ecc4c tempest-VolumesDeleteCascade-1244338346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095.29a8b366-10df-403a-9d28-1d03eb8708f4 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:32:40 devstack sudo[99652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095.29a8b366-10df-403a-9d28-1d03eb8708f4 Sep 28 09:32:40 devstack sudo[99652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:32:40 devstack sudo[99652]: pam_unix(sudo:session): session closed for user root Sep 28 09:32:40 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-50089dc0-a06b-4b5f-b8bb-62688d8ecc4c tempest-VolumesDeleteCascade-1244338346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095.29a8b366-10df-403a-9d28-1d03eb8708f4" returned: 0 in 0.275s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:32:40 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-50089dc0-a06b-4b5f-b8bb-62688d8ecc4c tempest-VolumesDeleteCascade-1244338346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095.info {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:32:40 devstack sudo[99655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095.info Sep 28 09:32:40 devstack sudo[99655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:32:40 devstack sudo[99655]: pam_unix(sudo:session): session closed for user root Sep 28 09:32:40 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-50089dc0-a06b-4b5f-b8bb-62688d8ecc4c tempest-VolumesDeleteCascade-1244338346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095.info" returned: 0 in 0.290s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:32:40 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-50089dc0-a06b-4b5f-b8bb-62688d8ecc4c tempest-VolumesDeleteCascade-1244338346 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095.info is being set with open permissions: ugo+rw Sep 28 09:32:40 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-50089dc0-a06b-4b5f-b8bb-62688d8ecc4c tempest-VolumesDeleteCascade-1244338346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095.info {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:32:40 devstack sudo[99658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095.info Sep 28 09:32:40 devstack sudo[99658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:32:40 devstack sudo[99658]: pam_unix(sudo:session): session closed for user root Sep 28 09:32:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-50089dc0-a06b-4b5f-b8bb-62688d8ecc4c tempest-VolumesDeleteCascade-1244338346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095.info" returned: 0 in 0.283s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:32:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-50089dc0-a06b-4b5f-b8bb-62688d8ecc4c tempest-VolumesDeleteCascade-1244338346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.261s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:32:41 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-50089dc0-a06b-4b5f-b8bb-62688d8ecc4c tempest-VolumesDeleteCascade-1244338346 None] Create snapshot completed successfully Sep 28 09:32:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-e375784b-d41b-40e5-ba5e-d83b00581548 tempest-VolumesDeleteCascade-1244338346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:32:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-e375784b-d41b-40e5-ba5e-d83b00581548 tempest-VolumesDeleteCascade-1244338346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:32:42 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-e375784b-d41b-40e5-ba5e-d83b00581548 tempest-VolumesDeleteCascade-1244338346 None] Creating offline snapshot daf1d0d5-fb48-4d14-a7f7-e12b32546567 of volume 3ba3624e-bbbc-4e79-a564-0c2025a7d095 {{(pid=86553) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 09:32:42 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[df421812-e972-4442-8c09-a94b79b9e98c]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:32:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e375784b-d41b-40e5-ba5e-d83b00581548 tempest-VolumesDeleteCascade-1244338346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095.29a8b366-10df-403a-9d28-1d03eb8708f4 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:32:42 devstack sudo[99661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095.29a8b366-10df-403a-9d28-1d03eb8708f4 Sep 28 09:32:42 devstack sudo[99661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:32:42 devstack sudo[99661]: pam_unix(sudo:session): session closed for user root Sep 28 09:32:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e375784b-d41b-40e5-ba5e-d83b00581548 tempest-VolumesDeleteCascade-1244338346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095.29a8b366-10df-403a-9d28-1d03eb8708f4" returned: 0 in 0.501s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:32:42 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-e375784b-d41b-40e5-ba5e-d83b00581548 tempest-VolumesDeleteCascade-1244338346 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86553) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 09:32:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e375784b-d41b-40e5-ba5e-d83b00581548 tempest-VolumesDeleteCascade-1244338346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095.29a8b366-10df-403a-9d28-1d03eb8708f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095.daf1d0d5-fb48-4d14-a7f7-e12b32546567 1G {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:32:42 devstack sudo[99666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095.29a8b366-10df-403a-9d28-1d03eb8708f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095.daf1d0d5-fb48-4d14-a7f7-e12b32546567 1G Sep 28 09:32:42 devstack sudo[99666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:32:43 devstack sudo[99666]: pam_unix(sudo:session): session closed for user root Sep 28 09:32:43 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e375784b-d41b-40e5-ba5e-d83b00581548 tempest-VolumesDeleteCascade-1244338346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095.29a8b366-10df-403a-9d28-1d03eb8708f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095.daf1d0d5-fb48-4d14-a7f7-e12b32546567 1G" returned: 0 in 0.804s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:32:43 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e375784b-d41b-40e5-ba5e-d83b00581548 tempest-VolumesDeleteCascade-1244338346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095.29a8b366-10df-403a-9d28-1d03eb8708f4 -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095.daf1d0d5-fb48-4d14-a7f7-e12b32546567 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:32:43 devstack sudo[99675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095.29a8b366-10df-403a-9d28-1d03eb8708f4 -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095.daf1d0d5-fb48-4d14-a7f7-e12b32546567 Sep 28 09:32:43 devstack sudo[99675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:32:43 devstack sudo[99675]: pam_unix(sudo:session): session closed for user root Sep 28 09:32:43 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e375784b-d41b-40e5-ba5e-d83b00581548 tempest-VolumesDeleteCascade-1244338346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095.29a8b366-10df-403a-9d28-1d03eb8708f4 -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095.daf1d0d5-fb48-4d14-a7f7-e12b32546567" returned: 0 in 0.385s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:32:43 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-e375784b-d41b-40e5-ba5e-d83b00581548 tempest-VolumesDeleteCascade-1244338346 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095.daf1d0d5-fb48-4d14-a7f7-e12b32546567 is being set with open permissions: ugo+rw Sep 28 09:32:43 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e375784b-d41b-40e5-ba5e-d83b00581548 tempest-VolumesDeleteCascade-1244338346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095.daf1d0d5-fb48-4d14-a7f7-e12b32546567 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:32:44 devstack sudo[99681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095.daf1d0d5-fb48-4d14-a7f7-e12b32546567 Sep 28 09:32:44 devstack sudo[99681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:32:44 devstack sudo[99681]: pam_unix(sudo:session): session closed for user root Sep 28 09:32:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e375784b-d41b-40e5-ba5e-d83b00581548 tempest-VolumesDeleteCascade-1244338346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095.daf1d0d5-fb48-4d14-a7f7-e12b32546567" returned: 0 in 0.323s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:32:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-e375784b-d41b-40e5-ba5e-d83b00581548 tempest-VolumesDeleteCascade-1244338346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.185s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:32:44 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-e375784b-d41b-40e5-ba5e-d83b00581548 tempest-VolumesDeleteCascade-1244338346 None] Create snapshot completed successfully Sep 28 09:32:45 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-86ddff90-8232-4062-a355-d9a9ad89cc5a tempest-VolumesDeleteCascade-1244338346 None] Acquiring lock "cinder-3ba3624e-bbbc-4e79-a564-0c2025a7d095-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:32:45 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-86ddff90-8232-4062-a355-d9a9ad89cc5a tempest-VolumesDeleteCascade-1244338346 None] Lock "cinder-3ba3624e-bbbc-4e79-a564-0c2025a7d095-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:32:45 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-86ddff90-8232-4062-a355-d9a9ad89cc5a tempest-VolumesDeleteCascade-1244338346 None] Performing cascade delete. {{(pid=86553) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 28 09:32:45 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-86ddff90-8232-4062-a355-d9a9ad89cc5a tempest-VolumesDeleteCascade-1244338346 None] Acquiring lock "cinder-29a8b366-10df-403a-9d28-1d03eb8708f4-delete_snapshot" by "delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:32:45 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-86ddff90-8232-4062-a355-d9a9ad89cc5a tempest-VolumesDeleteCascade-1244338346 None] Lock "cinder-29a8b366-10df-403a-9d28-1d03eb8708f4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:32:45 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-86ddff90-8232-4062-a355-d9a9ad89cc5a tempest-VolumesDeleteCascade-1244338346 None] Acquiring lock "cinder-quobyte-3ba3624e-bbbc-4e79-a564-0c2025a7d095" by "delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:32:45 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-86ddff90-8232-4062-a355-d9a9ad89cc5a tempest-VolumesDeleteCascade-1244338346 None] Lock "cinder-quobyte-3ba3624e-bbbc-4e79-a564-0c2025a7d095" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:32:45 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-86ddff90-8232-4062-a355-d9a9ad89cc5a tempest-VolumesDeleteCascade-1244338346 None] Acquiring lock "cinder-quobyte-29a8b366-10df-403a-9d28-1d03eb8708f4" by "_delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:32:45 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-86ddff90-8232-4062-a355-d9a9ad89cc5a tempest-VolumesDeleteCascade-1244338346 None] Lock "cinder-quobyte-29a8b366-10df-403a-9d28-1d03eb8708f4" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:32:45 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-86ddff90-8232-4062-a355-d9a9ad89cc5a tempest-VolumesDeleteCascade-1244338346 None] Deleting offline snapshot 29a8b366-10df-403a-9d28-1d03eb8708f4 of volume 3ba3624e-bbbc-4e79-a564-0c2025a7d095 {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 09:32:45 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-86ddff90-8232-4062-a355-d9a9ad89cc5a tempest-VolumesDeleteCascade-1244338346 None] snapshot_file for this snap is: volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095.29a8b366-10df-403a-9d28-1d03eb8708f4 {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 09:32:45 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[9469246c-4739-4d95-8820-6eeb71df71a2]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:32:45 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-86ddff90-8232-4062-a355-d9a9ad89cc5a tempest-VolumesDeleteCascade-1244338346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095.29a8b366-10df-403a-9d28-1d03eb8708f4 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:32:45 devstack sudo[99684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095.29a8b366-10df-403a-9d28-1d03eb8708f4 Sep 28 09:32:45 devstack sudo[99684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:32:46 devstack sudo[99684]: pam_unix(sudo:session): session closed for user root Sep 28 09:32:46 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-86ddff90-8232-4062-a355-d9a9ad89cc5a tempest-VolumesDeleteCascade-1244338346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095.29a8b366-10df-403a-9d28-1d03eb8708f4" returned: 0 in 0.523s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:32:46 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-86ddff90-8232-4062-a355-d9a9ad89cc5a tempest-VolumesDeleteCascade-1244338346 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86553) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 09:32:46 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[c94e9bf1-d63e-4be6-ae3a-01f50fc0b242]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:32:46 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-86ddff90-8232-4062-a355-d9a9ad89cc5a tempest-VolumesDeleteCascade-1244338346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:32:46 devstack sudo[99690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095 Sep 28 09:32:46 devstack sudo[99690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:32:47 devstack sudo[99690]: pam_unix(sudo:session): session closed for user root Sep 28 09:32:47 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-86ddff90-8232-4062-a355-d9a9ad89cc5a tempest-VolumesDeleteCascade-1244338346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095" returned: 0 in 0.724s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:32:47 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b7c445-f0e4-4fc0-ab07-d3ef27785d3a]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:32:47 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-86ddff90-8232-4062-a355-d9a9ad89cc5a tempest-VolumesDeleteCascade-1244338346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095.daf1d0d5-fb48-4d14-a7f7-e12b32546567 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:32:47 devstack sudo[99696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095.daf1d0d5-fb48-4d14-a7f7-e12b32546567 Sep 28 09:32:47 devstack sudo[99696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:32:47 devstack sudo[99696]: pam_unix(sudo:session): session closed for user root Sep 28 09:32:47 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-86ddff90-8232-4062-a355-d9a9ad89cc5a tempest-VolumesDeleteCascade-1244338346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095.daf1d0d5-fb48-4d14-a7f7-e12b32546567" returned: 0 in 0.525s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:32:47 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-86ddff90-8232-4062-a355-d9a9ad89cc5a tempest-VolumesDeleteCascade-1244338346 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86553) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 09:32:47 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fa19758-fcdd-4643-9ed5-559c4fab3b62]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:32:47 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-86ddff90-8232-4062-a355-d9a9ad89cc5a tempest-VolumesDeleteCascade-1244338346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095.29a8b366-10df-403a-9d28-1d03eb8708f4 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:32:47 devstack sudo[99715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095.29a8b366-10df-403a-9d28-1d03eb8708f4 Sep 28 09:32:47 devstack sudo[99715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:32:48 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f3248a5-df80-40a9-be3b-1ee9883d962d tempest-VolumesTransfersV357Test-258044696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:32:48 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7f3248a5-df80-40a9-be3b-1ee9883d962d tempest-VolumesTransfersV357Test-258044696 None] Flow 'volume_create_manager' (085eb104-3281-4ff0-856d-3be06e39427a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:32:48 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7f3248a5-df80-40a9-be3b-1ee9883d962d tempest-VolumesTransfersV357Test-258044696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15473584-6e6f-4ee4-b16a-fe0b37d233ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:32:48 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7f3248a5-df80-40a9-be3b-1ee9883d962d tempest-VolumesTransfersV357Test-258044696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15473584-6e6f-4ee4-b16a-fe0b37d233ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:32:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-948459369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ead1197-3540-4459-9318-3a71fc10a7f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b363fd3a3c924fb983b15db3f7974153',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:32:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:32:48Z,use_quota=True,user_id='d1937bd97d734f7dbcbd01bade56fb0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:32:48 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7f3248a5-df80-40a9-be3b-1ee9883d962d tempest-VolumesTransfersV357Test-258044696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa3d8bd4-a664-441c-8b9e-fb2c5538a81f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:32:48 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7f3248a5-df80-40a9-be3b-1ee9883d962d tempest-VolumesTransfersV357Test-258044696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa3d8bd4-a664-441c-8b9e-fb2c5538a81f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:32:48 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7f3248a5-df80-40a9-be3b-1ee9883d962d tempest-VolumesTransfersV357Test-258044696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d4edd16-cd21-4d7d-876b-2327e95c4296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:32:48 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7f3248a5-df80-40a9-be3b-1ee9883d962d tempest-VolumesTransfersV357Test-258044696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d4edd16-cd21-4d7d-876b-2327e95c4296) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ead1197-3540-4459-9318-3a71fc10a7f3', 'volume_name': 'volume-4ead1197-3540-4459-9318-3a71fc10a7f3', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:32:48 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7f3248a5-df80-40a9-be3b-1ee9883d962d tempest-VolumesTransfersV357Test-258044696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d257f706-d12f-460b-aecd-fd7c976fc2a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:32:48 devstack sudo[99715]: pam_unix(sudo:session): session closed for user root Sep 28 09:32:48 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7f3248a5-df80-40a9-be3b-1ee9883d962d tempest-VolumesTransfersV357Test-258044696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d257f706-d12f-460b-aecd-fd7c976fc2a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:32:48 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7f3248a5-df80-40a9-be3b-1ee9883d962d tempest-VolumesTransfersV357Test-258044696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (102974cb-205f-4d43-bae1-d405cc8021f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:32:48 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-7f3248a5-df80-40a9-be3b-1ee9883d962d tempest-VolumesTransfersV357Test-258044696 None] Volume 4ead1197-3540-4459-9318-3a71fc10a7f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ead1197-3540-4459-9318-3a71fc10a7f3', 'volume_size': 1} Sep 28 09:32:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-7f3248a5-df80-40a9-be3b-1ee9883d962d tempest-VolumesTransfersV357Test-258044696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:32:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-7f3248a5-df80-40a9-be3b-1ee9883d962d tempest-VolumesTransfersV357Test-258044696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:32:48 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-7f3248a5-df80-40a9-be3b-1ee9883d962d tempest-VolumesTransfersV357Test-258044696 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:32:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-948459369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ead1197-3540-4459-9318-3a71fc10a7f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b363fd3a3c924fb983b15db3f7974153',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:32:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:32:48Z,use_quota=True,user_id='d1937bd97d734f7dbcbd01bade56fb0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:32:48 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-7f3248a5-df80-40a9-be3b-1ee9883d962d tempest-VolumesTransfersV357Test-258044696 None] Creating volume 4ead1197-3540-4459-9318-3a71fc10a7f3 {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:32:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-7f3248a5-df80-40a9-be3b-1ee9883d962d tempest-VolumesTransfersV357Test-258044696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:32:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-7f3248a5-df80-40a9-be3b-1ee9883d962d tempest-VolumesTransfersV357Test-258044696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:32:48 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-7f3248a5-df80-40a9-be3b-1ee9883d962d tempest-VolumesTransfersV357Test-258044696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:32:48 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-7f3248a5-df80-40a9-be3b-1ee9883d962d tempest-VolumesTransfersV357Test-258044696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:32:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-7f3248a5-df80-40a9-be3b-1ee9883d962d tempest-VolumesTransfersV357Test-258044696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:32:48 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-7f3248a5-df80-40a9-be3b-1ee9883d962d tempest-VolumesTransfersV357Test-258044696 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:32:48 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-7f3248a5-df80-40a9-be3b-1ee9883d962d tempest-VolumesTransfersV357Test-258044696 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:32:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-7f3248a5-df80-40a9-be3b-1ee9883d962d tempest-VolumesTransfersV357Test-258044696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-4ead1197-3540-4459-9318-3a71fc10a7f3 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:32:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-86ddff90-8232-4062-a355-d9a9ad89cc5a tempest-VolumesDeleteCascade-1244338346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095.29a8b366-10df-403a-9d28-1d03eb8708f4" returned: 0 in 0.776s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:32:48 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-86ddff90-8232-4062-a355-d9a9ad89cc5a tempest-VolumesDeleteCascade-1244338346 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86553) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 09:32:48 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f9e119e-16fe-4b9c-8ac4-1f64a185e57c]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:32:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-86ddff90-8232-4062-a355-d9a9ad89cc5a tempest-VolumesDeleteCascade-1244338346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:32:48 devstack sudo[99733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-4ead1197-3540-4459-9318-3a71fc10a7f3 1073741824 Sep 28 09:32:48 devstack sudo[99733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:32:48 devstack sudo[99738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095 Sep 28 09:32:48 devstack sudo[99738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:32:49 devstack sudo[99738]: pam_unix(sudo:session): session closed for user root Sep 28 09:32:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-86ddff90-8232-4062-a355-d9a9ad89cc5a tempest-VolumesDeleteCascade-1244338346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095" returned: 0 in 0.630s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:32:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-86ddff90-8232-4062-a355-d9a9ad89cc5a tempest-VolumesDeleteCascade-1244338346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095.29a8b366-10df-403a-9d28-1d03eb8708f4 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:32:49 devstack sudo[99751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095.29a8b366-10df-403a-9d28-1d03eb8708f4 Sep 28 09:32:49 devstack sudo[99751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:32:49 devstack sudo[99733]: pam_unix(sudo:session): session closed for user root Sep 28 09:32:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-7f3248a5-df80-40a9-be3b-1ee9883d962d tempest-VolumesTransfersV357Test-258044696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-4ead1197-3540-4459-9318-3a71fc10a7f3 1073741824" returned: 0 in 0.807s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:32:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-7f3248a5-df80-40a9-be3b-1ee9883d962d tempest-VolumesTransfersV357Test-258044696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-4ead1197-3540-4459-9318-3a71fc10a7f3 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:32:49 devstack sudo[99753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-4ead1197-3540-4459-9318-3a71fc10a7f3 Sep 28 09:32:49 devstack sudo[99753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:32:49 devstack sudo[99751]: pam_unix(sudo:session): session closed for user root Sep 28 09:32:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-86ddff90-8232-4062-a355-d9a9ad89cc5a tempest-VolumesDeleteCascade-1244338346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095.29a8b366-10df-403a-9d28-1d03eb8708f4" returned: 0 in 0.468s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:32:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-86ddff90-8232-4062-a355-d9a9ad89cc5a tempest-VolumesDeleteCascade-1244338346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095.29a8b366-10df-403a-9d28-1d03eb8708f4 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:32:49 devstack sudo[99753]: pam_unix(sudo:session): session closed for user root Sep 28 09:32:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-7f3248a5-df80-40a9-be3b-1ee9883d962d tempest-VolumesTransfersV357Test-258044696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-4ead1197-3540-4459-9318-3a71fc10a7f3" returned: 0 in 0.294s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:32:49 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-7f3248a5-df80-40a9-be3b-1ee9883d962d tempest-VolumesTransfersV357Test-258044696 None] <== create_volume: return (1186ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:32:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-7f3248a5-df80-40a9-be3b-1ee9883d962d tempest-VolumesTransfersV357Test-258044696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.189s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:32:49 devstack sudo[99760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095.29a8b366-10df-403a-9d28-1d03eb8708f4 Sep 28 09:32:49 devstack sudo[99760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:32:49 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7f3248a5-df80-40a9-be3b-1ee9883d962d tempest-VolumesTransfersV357Test-258044696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (102974cb-205f-4d43-bae1-d405cc8021f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ead1197-3540-4459-9318-3a71fc10a7f3', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:32:49 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7f3248a5-df80-40a9-be3b-1ee9883d962d tempest-VolumesTransfersV357Test-258044696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0aaa1c99-5f59-413d-a577-5ec91b276c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:32:49 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-7f3248a5-df80-40a9-be3b-1ee9883d962d tempest-VolumesTransfersV357Test-258044696 None] Volume volume-4ead1197-3540-4459-9318-3a71fc10a7f3 (4ead1197-3540-4459-9318-3a71fc10a7f3): created successfully Sep 28 09:32:49 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7f3248a5-df80-40a9-be3b-1ee9883d962d tempest-VolumesTransfersV357Test-258044696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0aaa1c99-5f59-413d-a577-5ec91b276c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:32:49 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7f3248a5-df80-40a9-be3b-1ee9883d962d tempest-VolumesTransfersV357Test-258044696 None] Flow 'volume_create_manager' (085eb104-3281-4ff0-856d-3be06e39427a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:32:49 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-7f3248a5-df80-40a9-be3b-1ee9883d962d tempest-VolumesTransfersV357Test-258044696 None] Created volume successfully. Sep 28 09:32:50 devstack sudo[99760]: pam_unix(sudo:session): session closed for user root Sep 28 09:32:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-86ddff90-8232-4062-a355-d9a9ad89cc5a tempest-VolumesDeleteCascade-1244338346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095.29a8b366-10df-403a-9d28-1d03eb8708f4" returned: 0 in 0.512s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:32:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-86ddff90-8232-4062-a355-d9a9ad89cc5a tempest-VolumesDeleteCascade-1244338346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095.daf1d0d5-fb48-4d14-a7f7-e12b32546567 -F qcow2 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:32:50 devstack sudo[99776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095.daf1d0d5-fb48-4d14-a7f7-e12b32546567 -F qcow2 Sep 28 09:32:50 devstack sudo[99776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:32:50 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ed68fec-ec7c-4dcc-87b5-52f9bb9ad157 tempest-VolumeQuotasAdminTestJSON-703805994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:32:50 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-2ed68fec-ec7c-4dcc-87b5-52f9bb9ad157 tempest-VolumeQuotasAdminTestJSON-703805994 None] Flow 'volume_create_manager' (4fad7e25-5d13-4281-9a2e-9e76865aed2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:32:50 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-2ed68fec-ec7c-4dcc-87b5-52f9bb9ad157 tempest-VolumeQuotasAdminTestJSON-703805994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85b50099-0fbd-4dbd-bd35-b541a95778dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:32:50 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-2ed68fec-ec7c-4dcc-87b5-52f9bb9ad157 tempest-VolumeQuotasAdminTestJSON-703805994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85b50099-0fbd-4dbd-bd35-b541a95778dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:32:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-419036925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=213ac74d-84fb-4e85-b63c-c9d58781ab57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3796b3a5635a4a418d0d97a2a48ea745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:32:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:32:51Z,use_quota=True,user_id='42d49f64541245749592591e1bcd730f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:32:50 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-2ed68fec-ec7c-4dcc-87b5-52f9bb9ad157 tempest-VolumeQuotasAdminTestJSON-703805994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cacd71b-a6dd-4deb-a44f-19410fa8e8df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:32:50 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-2ed68fec-ec7c-4dcc-87b5-52f9bb9ad157 tempest-VolumeQuotasAdminTestJSON-703805994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cacd71b-a6dd-4deb-a44f-19410fa8e8df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:32:50 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-2ed68fec-ec7c-4dcc-87b5-52f9bb9ad157 tempest-VolumeQuotasAdminTestJSON-703805994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebe7d826-8f02-4420-9466-afb11c7a0ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:32:50 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-2ed68fec-ec7c-4dcc-87b5-52f9bb9ad157 tempest-VolumeQuotasAdminTestJSON-703805994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebe7d826-8f02-4420-9466-afb11c7a0ffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '213ac74d-84fb-4e85-b63c-c9d58781ab57', 'volume_name': 'volume-213ac74d-84fb-4e85-b63c-c9d58781ab57', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:32:50 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-2ed68fec-ec7c-4dcc-87b5-52f9bb9ad157 tempest-VolumeQuotasAdminTestJSON-703805994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9bdbaae-abfd-4de3-8401-3671b44dd136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:32:50 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-2ed68fec-ec7c-4dcc-87b5-52f9bb9ad157 tempest-VolumeQuotasAdminTestJSON-703805994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9bdbaae-abfd-4de3-8401-3671b44dd136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:32:50 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-2ed68fec-ec7c-4dcc-87b5-52f9bb9ad157 tempest-VolumeQuotasAdminTestJSON-703805994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a824e8b8-9263-4ff2-ac6e-2486424c82e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:32:50 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-2ed68fec-ec7c-4dcc-87b5-52f9bb9ad157 tempest-VolumeQuotasAdminTestJSON-703805994 None] Volume 213ac74d-84fb-4e85-b63c-c9d58781ab57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-213ac74d-84fb-4e85-b63c-c9d58781ab57', 'volume_size': 1} Sep 28 09:32:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-2ed68fec-ec7c-4dcc-87b5-52f9bb9ad157 tempest-VolumeQuotasAdminTestJSON-703805994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:32:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-2ed68fec-ec7c-4dcc-87b5-52f9bb9ad157 tempest-VolumeQuotasAdminTestJSON-703805994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:32:50 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-2ed68fec-ec7c-4dcc-87b5-52f9bb9ad157 tempest-VolumeQuotasAdminTestJSON-703805994 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:32:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-419036925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=213ac74d-84fb-4e85-b63c-c9d58781ab57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3796b3a5635a4a418d0d97a2a48ea745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:32:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:32:51Z,use_quota=True,user_id='42d49f64541245749592591e1bcd730f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:32:50 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-2ed68fec-ec7c-4dcc-87b5-52f9bb9ad157 tempest-VolumeQuotasAdminTestJSON-703805994 None] Creating volume 213ac74d-84fb-4e85-b63c-c9d58781ab57 {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:32:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-2ed68fec-ec7c-4dcc-87b5-52f9bb9ad157 tempest-VolumeQuotasAdminTestJSON-703805994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:32:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-2ed68fec-ec7c-4dcc-87b5-52f9bb9ad157 tempest-VolumeQuotasAdminTestJSON-703805994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:32:50 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-2ed68fec-ec7c-4dcc-87b5-52f9bb9ad157 tempest-VolumeQuotasAdminTestJSON-703805994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:32:50 devstack sudo[99776]: pam_unix(sudo:session): session closed for user root Sep 28 09:32:50 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-2ed68fec-ec7c-4dcc-87b5-52f9bb9ad157 tempest-VolumeQuotasAdminTestJSON-703805994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:32:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-2ed68fec-ec7c-4dcc-87b5-52f9bb9ad157 tempest-VolumeQuotasAdminTestJSON-703805994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:32:50 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-2ed68fec-ec7c-4dcc-87b5-52f9bb9ad157 tempest-VolumeQuotasAdminTestJSON-703805994 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:32:50 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-2ed68fec-ec7c-4dcc-87b5-52f9bb9ad157 tempest-VolumeQuotasAdminTestJSON-703805994 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:32:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2ed68fec-ec7c-4dcc-87b5-52f9bb9ad157 tempest-VolumeQuotasAdminTestJSON-703805994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-213ac74d-84fb-4e85-b63c-c9d58781ab57 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:32:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-86ddff90-8232-4062-a355-d9a9ad89cc5a tempest-VolumesDeleteCascade-1244338346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095.daf1d0d5-fb48-4d14-a7f7-e12b32546567 -F qcow2" returned: 0 in 0.731s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:32:50 devstack sudo[99813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-213ac74d-84fb-4e85-b63c-c9d58781ab57 1073741824 Sep 28 09:32:50 devstack sudo[99813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:32:50 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-86ddff90-8232-4062-a355-d9a9ad89cc5a tempest-VolumesDeleteCascade-1244338346 None] Lock "cinder-quobyte-29a8b366-10df-403a-9d28-1d03eb8708f4" released by "_delete_snapshot" :: held 5.255s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:32:50 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-86ddff90-8232-4062-a355-d9a9ad89cc5a tempest-VolumesDeleteCascade-1244338346 None] Lock "cinder-quobyte-3ba3624e-bbbc-4e79-a564-0c2025a7d095" released by "delete_snapshot" :: held 5.305s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:32:51 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-86ddff90-8232-4062-a355-d9a9ad89cc5a tempest-VolumesDeleteCascade-1244338346 None] Created reservations ['b4defa81-7226-48d4-8413-45fa2e9f9591', 'f2c1a934-505b-4409-8eaa-7e0d7d941ab3', '02383432-8ec2-4897-a925-4ef1c1cac5cc', '780ccabb-a1d6-4ec7-9a34-7f26311442be'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:32:51 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-86ddff90-8232-4062-a355-d9a9ad89cc5a tempest-VolumesDeleteCascade-1244338346 None] Delete snapshot completed successfully. Sep 28 09:32:51 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-86ddff90-8232-4062-a355-d9a9ad89cc5a tempest-VolumesDeleteCascade-1244338346 None] Lock "cinder-29a8b366-10df-403a-9d28-1d03eb8708f4-delete_snapshot" released by "delete_snapshot" :: held 5.655s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:32:51 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-86ddff90-8232-4062-a355-d9a9ad89cc5a tempest-VolumesDeleteCascade-1244338346 None] Acquiring lock "cinder-daf1d0d5-fb48-4d14-a7f7-e12b32546567-delete_snapshot" by "delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:32:51 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-86ddff90-8232-4062-a355-d9a9ad89cc5a tempest-VolumesDeleteCascade-1244338346 None] Lock "cinder-daf1d0d5-fb48-4d14-a7f7-e12b32546567-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:32:51 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-86ddff90-8232-4062-a355-d9a9ad89cc5a tempest-VolumesDeleteCascade-1244338346 None] Acquiring lock "cinder-quobyte-3ba3624e-bbbc-4e79-a564-0c2025a7d095" by "delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:32:51 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-86ddff90-8232-4062-a355-d9a9ad89cc5a tempest-VolumesDeleteCascade-1244338346 None] Lock "cinder-quobyte-3ba3624e-bbbc-4e79-a564-0c2025a7d095" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:32:51 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-86ddff90-8232-4062-a355-d9a9ad89cc5a tempest-VolumesDeleteCascade-1244338346 None] Acquiring lock "cinder-quobyte-daf1d0d5-fb48-4d14-a7f7-e12b32546567" by "_delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:32:51 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-86ddff90-8232-4062-a355-d9a9ad89cc5a tempest-VolumesDeleteCascade-1244338346 None] Lock "cinder-quobyte-daf1d0d5-fb48-4d14-a7f7-e12b32546567" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:32:51 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-86ddff90-8232-4062-a355-d9a9ad89cc5a tempest-VolumesDeleteCascade-1244338346 None] Deleting offline snapshot daf1d0d5-fb48-4d14-a7f7-e12b32546567 of volume 3ba3624e-bbbc-4e79-a564-0c2025a7d095 {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 09:32:51 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-86ddff90-8232-4062-a355-d9a9ad89cc5a tempest-VolumesDeleteCascade-1244338346 None] snapshot_file for this snap is: volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095.daf1d0d5-fb48-4d14-a7f7-e12b32546567 {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 09:32:51 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1aa6b03-f20d-4fcb-ae67-63a37fb00557]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:32:51 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-86ddff90-8232-4062-a355-d9a9ad89cc5a tempest-VolumesDeleteCascade-1244338346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095.daf1d0d5-fb48-4d14-a7f7-e12b32546567 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:32:51 devstack sudo[99839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095.daf1d0d5-fb48-4d14-a7f7-e12b32546567 Sep 28 09:32:51 devstack sudo[99839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:32:51 devstack sudo[99813]: pam_unix(sudo:session): session closed for user root Sep 28 09:32:51 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2ed68fec-ec7c-4dcc-87b5-52f9bb9ad157 tempest-VolumeQuotasAdminTestJSON-703805994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-213ac74d-84fb-4e85-b63c-c9d58781ab57 1073741824" returned: 0 in 0.892s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:32:51 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2ed68fec-ec7c-4dcc-87b5-52f9bb9ad157 tempest-VolumeQuotasAdminTestJSON-703805994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-213ac74d-84fb-4e85-b63c-c9d58781ab57 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:32:51 devstack sudo[99856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-213ac74d-84fb-4e85-b63c-c9d58781ab57 Sep 28 09:32:51 devstack sudo[99856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:32:51 devstack sudo[99839]: pam_unix(sudo:session): session closed for user root Sep 28 09:32:51 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-86ddff90-8232-4062-a355-d9a9ad89cc5a tempest-VolumesDeleteCascade-1244338346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095.daf1d0d5-fb48-4d14-a7f7-e12b32546567" returned: 0 in 0.578s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:32:51 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-86ddff90-8232-4062-a355-d9a9ad89cc5a tempest-VolumesDeleteCascade-1244338346 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86553) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 09:32:52 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8cf6e48-8a64-4545-8f99-9f915417dd66]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:32:52 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-86ddff90-8232-4062-a355-d9a9ad89cc5a tempest-VolumesDeleteCascade-1244338346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:32:52 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-2a142150-ca9c-421a-9471-5d6a4d3623f8 tempest-VolumesTransfersV357Test-1429707807 None] Transfer volume completed successfully. Sep 28 09:32:52 devstack sudo[99856]: pam_unix(sudo:session): session closed for user root Sep 28 09:32:52 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2ed68fec-ec7c-4dcc-87b5-52f9bb9ad157 tempest-VolumeQuotasAdminTestJSON-703805994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-213ac74d-84fb-4e85-b63c-c9d58781ab57" returned: 0 in 0.315s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:32:52 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-2ed68fec-ec7c-4dcc-87b5-52f9bb9ad157 tempest-VolumeQuotasAdminTestJSON-703805994 None] <== create_volume: return (1318ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:32:52 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-2ed68fec-ec7c-4dcc-87b5-52f9bb9ad157 tempest-VolumeQuotasAdminTestJSON-703805994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.320s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:32:52 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-2ed68fec-ec7c-4dcc-87b5-52f9bb9ad157 tempest-VolumeQuotasAdminTestJSON-703805994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a824e8b8-9263-4ff2-ac6e-2486424c82e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-213ac74d-84fb-4e85-b63c-c9d58781ab57', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:32:52 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-2ed68fec-ec7c-4dcc-87b5-52f9bb9ad157 tempest-VolumeQuotasAdminTestJSON-703805994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (444052c1-1b10-4786-8d7a-529a6a6be403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:32:52 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-2ed68fec-ec7c-4dcc-87b5-52f9bb9ad157 tempest-VolumeQuotasAdminTestJSON-703805994 None] Volume volume-213ac74d-84fb-4e85-b63c-c9d58781ab57 (213ac74d-84fb-4e85-b63c-c9d58781ab57): created successfully Sep 28 09:32:52 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-2ed68fec-ec7c-4dcc-87b5-52f9bb9ad157 tempest-VolumeQuotasAdminTestJSON-703805994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (444052c1-1b10-4786-8d7a-529a6a6be403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:32:52 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-2ed68fec-ec7c-4dcc-87b5-52f9bb9ad157 tempest-VolumeQuotasAdminTestJSON-703805994 None] Flow 'volume_create_manager' (4fad7e25-5d13-4281-9a2e-9e76865aed2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:32:52 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-2ed68fec-ec7c-4dcc-87b5-52f9bb9ad157 tempest-VolumeQuotasAdminTestJSON-703805994 None] Created volume successfully. Sep 28 09:32:52 devstack sudo[99862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095 Sep 28 09:32:52 devstack sudo[99862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:32:52 devstack sudo[99862]: pam_unix(sudo:session): session closed for user root Sep 28 09:32:52 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-86ddff90-8232-4062-a355-d9a9ad89cc5a tempest-VolumesDeleteCascade-1244338346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095" returned: 0 in 0.451s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:32:52 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-86ddff90-8232-4062-a355-d9a9ad89cc5a tempest-VolumesDeleteCascade-1244338346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095.daf1d0d5-fb48-4d14-a7f7-e12b32546567 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:32:52 devstack sudo[99867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095.daf1d0d5-fb48-4d14-a7f7-e12b32546567 Sep 28 09:32:52 devstack sudo[99867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:32:52 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-1b31d18b-1cc4-4a9f-873b-f947699300d6 tempest-VolumesTransfersV357Test-1688045820 None] Acquiring lock "cinder-4ead1197-3540-4459-9318-3a71fc10a7f3-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:32:52 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-1b31d18b-1cc4-4a9f-873b-f947699300d6 tempest-VolumesTransfersV357Test-1688045820 None] Lock "cinder-4ead1197-3540-4459-9318-3a71fc10a7f3-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:32:52 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-e09e2970-86cd-46f8-bffe-859b36808eb5 tempest-VolumeQuotasAdminTestJSON-703805994 None] Acquiring lock "cinder-213ac74d-84fb-4e85-b63c-c9d58781ab57-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:32:52 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-e09e2970-86cd-46f8-bffe-859b36808eb5 tempest-VolumeQuotasAdminTestJSON-703805994 None] Lock "cinder-213ac74d-84fb-4e85-b63c-c9d58781ab57-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:32:52 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-1b31d18b-1cc4-4a9f-873b-f947699300d6 tempest-VolumesTransfersV357Test-1688045820 None] Acquiring lock "cinder-quobyte-4ead1197-3540-4459-9318-3a71fc10a7f3" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:32:53 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-e09e2970-86cd-46f8-bffe-859b36808eb5 tempest-VolumeQuotasAdminTestJSON-703805994 None] Acquiring lock "cinder-quobyte-213ac74d-84fb-4e85-b63c-c9d58781ab57" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:32:53 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-1b31d18b-1cc4-4a9f-873b-f947699300d6 tempest-VolumesTransfersV357Test-1688045820 None] Lock "cinder-quobyte-4ead1197-3540-4459-9318-3a71fc10a7f3" acquired by "delete_volume" :: waited 0.070s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:32:53 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-e09e2970-86cd-46f8-bffe-859b36808eb5 tempest-VolumeQuotasAdminTestJSON-703805994 None] Lock "cinder-quobyte-213ac74d-84fb-4e85-b63c-c9d58781ab57" acquired by "delete_volume" :: waited 0.069s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:32:53 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[a08b2ada-9188-4a60-857b-caa782da39cf]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:32:53 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1b31d18b-1cc4-4a9f-873b-f947699300d6 tempest-VolumesTransfersV357Test-1688045820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-4ead1197-3540-4459-9318-3a71fc10a7f3 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:32:53 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[751880e9-1adb-43c9-be5c-3e9d2cda144e]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:32:53 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e09e2970-86cd-46f8-bffe-859b36808eb5 tempest-VolumeQuotasAdminTestJSON-703805994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-213ac74d-84fb-4e85-b63c-c9d58781ab57 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:32:53 devstack sudo[99867]: pam_unix(sudo:session): session closed for user root Sep 28 09:32:53 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-86ddff90-8232-4062-a355-d9a9ad89cc5a tempest-VolumesDeleteCascade-1244338346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095.daf1d0d5-fb48-4d14-a7f7-e12b32546567" returned: 0 in 0.698s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:32:53 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-86ddff90-8232-4062-a355-d9a9ad89cc5a tempest-VolumesDeleteCascade-1244338346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095.daf1d0d5-fb48-4d14-a7f7-e12b32546567 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:32:53 devstack sudo[99877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095.daf1d0d5-fb48-4d14-a7f7-e12b32546567 Sep 28 09:32:53 devstack sudo[99877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:32:53 devstack sudo[99876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-213ac74d-84fb-4e85-b63c-c9d58781ab57 Sep 28 09:32:53 devstack sudo[99876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:32:53 devstack sudo[99875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-4ead1197-3540-4459-9318-3a71fc10a7f3 Sep 28 09:32:53 devstack sudo[99875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:32:53 devstack sudo[99877]: pam_unix(sudo:session): session closed for user root Sep 28 09:32:53 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-86ddff90-8232-4062-a355-d9a9ad89cc5a tempest-VolumesDeleteCascade-1244338346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095.daf1d0d5-fb48-4d14-a7f7-e12b32546567" returned: 0 in 0.391s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:32:53 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-86ddff90-8232-4062-a355-d9a9ad89cc5a tempest-VolumesDeleteCascade-1244338346 None] Lock "cinder-quobyte-daf1d0d5-fb48-4d14-a7f7-e12b32546567" released by "_delete_snapshot" :: held 2.312s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:32:53 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-86ddff90-8232-4062-a355-d9a9ad89cc5a tempest-VolumesDeleteCascade-1244338346 None] Lock "cinder-quobyte-3ba3624e-bbbc-4e79-a564-0c2025a7d095" released by "delete_snapshot" :: held 2.358s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:32:53 devstack sudo[99876]: pam_unix(sudo:session): session closed for user root Sep 28 09:32:53 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e09e2970-86cd-46f8-bffe-859b36808eb5 tempest-VolumeQuotasAdminTestJSON-703805994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-213ac74d-84fb-4e85-b63c-c9d58781ab57" returned: 0 in 0.541s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:32:53 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e09e2970-86cd-46f8-bffe-859b36808eb5 tempest-VolumeQuotasAdminTestJSON-703805994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-213ac74d-84fb-4e85-b63c-c9d58781ab57 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:32:53 devstack sudo[99888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-213ac74d-84fb-4e85-b63c-c9d58781ab57 Sep 28 09:32:53 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-86ddff90-8232-4062-a355-d9a9ad89cc5a tempest-VolumesDeleteCascade-1244338346 None] Created reservations ['9d5ae948-287e-4ff5-be6e-43a9f27801e9', '82f938ba-8bb3-4bf0-a8d3-6c1c5472796b', '9d5a8c94-c9fe-4d99-b681-6d6ff4dcc1e9', 'fa06c4b5-9b7d-4d48-a5ae-83b2982a2270'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:32:53 devstack sudo[99888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:32:53 devstack sudo[99875]: pam_unix(sudo:session): session closed for user root Sep 28 09:32:53 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1b31d18b-1cc4-4a9f-873b-f947699300d6 tempest-VolumesTransfersV357Test-1688045820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-4ead1197-3540-4459-9318-3a71fc10a7f3" returned: 0 in 0.636s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:32:53 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1b31d18b-1cc4-4a9f-873b-f947699300d6 tempest-VolumesTransfersV357Test-1688045820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-4ead1197-3540-4459-9318-3a71fc10a7f3 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:32:53 devstack sudo[99891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-4ead1197-3540-4459-9318-3a71fc10a7f3 Sep 28 09:32:53 devstack sudo[99891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:32:53 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-86ddff90-8232-4062-a355-d9a9ad89cc5a tempest-VolumesDeleteCascade-1244338346 None] Delete snapshot completed successfully. Sep 28 09:32:53 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-86ddff90-8232-4062-a355-d9a9ad89cc5a tempest-VolumesDeleteCascade-1244338346 None] Lock "cinder-daf1d0d5-fb48-4d14-a7f7-e12b32546567-delete_snapshot" released by "delete_snapshot" :: held 2.635s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:32:53 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-86ddff90-8232-4062-a355-d9a9ad89cc5a tempest-VolumesDeleteCascade-1244338346 None] Snapshots deleted, issuing volume delete {{(pid=86553) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 28 09:32:53 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-86ddff90-8232-4062-a355-d9a9ad89cc5a tempest-VolumesDeleteCascade-1244338346 None] Acquiring lock "cinder-quobyte-3ba3624e-bbbc-4e79-a564-0c2025a7d095" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:32:53 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-86ddff90-8232-4062-a355-d9a9ad89cc5a tempest-VolumesDeleteCascade-1244338346 None] Lock "cinder-quobyte-3ba3624e-bbbc-4e79-a564-0c2025a7d095" acquired by "delete_volume" :: waited 0.015s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:32:53 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[e77d645a-bb14-4801-83e2-baaef1830a1d]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:32:53 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-86ddff90-8232-4062-a355-d9a9ad89cc5a tempest-VolumesDeleteCascade-1244338346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:32:54 devstack sudo[99888]: pam_unix(sudo:session): session closed for user root Sep 28 09:32:54 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e09e2970-86cd-46f8-bffe-859b36808eb5 tempest-VolumeQuotasAdminTestJSON-703805994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-213ac74d-84fb-4e85-b63c-c9d58781ab57" returned: 0 in 0.413s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:32:54 devstack sudo[99891]: pam_unix(sudo:session): session closed for user root Sep 28 09:32:54 devstack sudo[99893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095 Sep 28 09:32:54 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1b31d18b-1cc4-4a9f-873b-f947699300d6 tempest-VolumesTransfersV357Test-1688045820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-4ead1197-3540-4459-9318-3a71fc10a7f3" returned: 0 in 0.362s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:32:54 devstack sudo[99893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:32:54 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-e09e2970-86cd-46f8-bffe-859b36808eb5 tempest-VolumeQuotasAdminTestJSON-703805994 None] Lock "cinder-quobyte-213ac74d-84fb-4e85-b63c-c9d58781ab57" released by "delete_volume" :: held 1.052s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:32:54 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-1b31d18b-1cc4-4a9f-873b-f947699300d6 tempest-VolumesTransfersV357Test-1688045820 None] Lock "cinder-quobyte-4ead1197-3540-4459-9318-3a71fc10a7f3" released by "delete_volume" :: held 1.128s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:32:54 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-1b31d18b-1cc4-4a9f-873b-f947699300d6 tempest-VolumesTransfersV357Test-1688045820 None] Created reservations ['e03057a5-8a1d-46fb-82b1-d1655ae56dec', '5e6c300b-76e8-4562-a297-c823a1489e32', '95b7b526-0ea8-4f08-ac81-eb19b8b4401c', '63b03624-4aa4-4b05-b164-29fdafcba74d'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:32:54 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-e09e2970-86cd-46f8-bffe-859b36808eb5 tempest-VolumeQuotasAdminTestJSON-703805994 None] Created reservations ['b317a473-89a5-40cf-9e58-0271d18cb5ea', 'b3c05891-084f-4bcf-b34d-e8e7ecbc5f7c', '35dce7e8-333f-4526-be7a-dbff18988e1e', '6ae64d98-0ac2-4d7d-9f98-994575d1143b'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:32:54 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-1b31d18b-1cc4-4a9f-873b-f947699300d6 tempest-VolumesTransfersV357Test-1688045820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:32:54 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-1b31d18b-1cc4-4a9f-873b-f947699300d6 tempest-VolumesTransfersV357Test-1688045820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:32:54 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-1b31d18b-1cc4-4a9f-873b-f947699300d6 tempest-VolumesTransfersV357Test-1688045820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:32:54 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-1b31d18b-1cc4-4a9f-873b-f947699300d6 tempest-VolumesTransfersV357Test-1688045820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:32:54 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-1b31d18b-1cc4-4a9f-873b-f947699300d6 tempest-VolumesTransfersV357Test-1688045820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:32:54 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1b31d18b-1cc4-4a9f-873b-f947699300d6 tempest-VolumesTransfersV357Test-1688045820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:32:54 devstack sudo[99899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:32:54 devstack sudo[99899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:32:54 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-e09e2970-86cd-46f8-bffe-859b36808eb5 tempest-VolumeQuotasAdminTestJSON-703805994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:32:54 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-e09e2970-86cd-46f8-bffe-859b36808eb5 tempest-VolumeQuotasAdminTestJSON-703805994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:32:54 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-e09e2970-86cd-46f8-bffe-859b36808eb5 tempest-VolumeQuotasAdminTestJSON-703805994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:32:54 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-e09e2970-86cd-46f8-bffe-859b36808eb5 tempest-VolumeQuotasAdminTestJSON-703805994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:32:54 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-e09e2970-86cd-46f8-bffe-859b36808eb5 tempest-VolumeQuotasAdminTestJSON-703805994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:32:54 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e09e2970-86cd-46f8-bffe-859b36808eb5 tempest-VolumeQuotasAdminTestJSON-703805994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:32:54 devstack sudo[99893]: pam_unix(sudo:session): session closed for user root Sep 28 09:32:54 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-86ddff90-8232-4062-a355-d9a9ad89cc5a tempest-VolumesDeleteCascade-1244338346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095" returned: 0 in 0.583s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:32:54 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-86ddff90-8232-4062-a355-d9a9ad89cc5a tempest-VolumesDeleteCascade-1244338346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:32:54 devstack sudo[99902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:32:54 devstack sudo[99902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:32:54 devstack sudo[99904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095 Sep 28 09:32:54 devstack sudo[99904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:32:54 devstack sudo[99899]: pam_unix(sudo:session): session closed for user root Sep 28 09:32:54 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1b31d18b-1cc4-4a9f-873b-f947699300d6 tempest-VolumesTransfersV357Test-1688045820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.478s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:32:54 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-1b31d18b-1cc4-4a9f-873b-f947699300d6 tempest-VolumesTransfersV357Test-1688045820 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:32:54 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-1b31d18b-1cc4-4a9f-873b-f947699300d6 tempest-VolumesTransfersV357Test-1688045820 None] Deleted volume successfully. Sep 28 09:32:54 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-1b31d18b-1cc4-4a9f-873b-f947699300d6 tempest-VolumesTransfersV357Test-1688045820 None] Lock "cinder-4ead1197-3540-4459-9318-3a71fc10a7f3-delete_volume" released by "delete_volume" :: held 2.179s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:32:54 devstack sudo[99902]: pam_unix(sudo:session): session closed for user root Sep 28 09:32:54 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e09e2970-86cd-46f8-bffe-859b36808eb5 tempest-VolumeQuotasAdminTestJSON-703805994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.486s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:32:54 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-e09e2970-86cd-46f8-bffe-859b36808eb5 tempest-VolumeQuotasAdminTestJSON-703805994 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:32:54 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-e09e2970-86cd-46f8-bffe-859b36808eb5 tempest-VolumeQuotasAdminTestJSON-703805994 None] Deleted volume successfully. Sep 28 09:32:55 devstack sudo[99904]: pam_unix(sudo:session): session closed for user root Sep 28 09:32:55 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-e09e2970-86cd-46f8-bffe-859b36808eb5 tempest-VolumeQuotasAdminTestJSON-703805994 None] Lock "cinder-213ac74d-84fb-4e85-b63c-c9d58781ab57-delete_volume" released by "delete_volume" :: held 2.081s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:32:55 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-86ddff90-8232-4062-a355-d9a9ad89cc5a tempest-VolumesDeleteCascade-1244338346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ba3624e-bbbc-4e79-a564-0c2025a7d095" returned: 0 in 0.468s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:32:55 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-86ddff90-8232-4062-a355-d9a9ad89cc5a tempest-VolumesDeleteCascade-1244338346 None] Lock "cinder-quobyte-3ba3624e-bbbc-4e79-a564-0c2025a7d095" released by "delete_volume" :: held 1.155s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:32:55 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-86ddff90-8232-4062-a355-d9a9ad89cc5a tempest-VolumesDeleteCascade-1244338346 None] Created reservations ['5c43aee6-a73e-4d3e-ab1d-59e051cc1682', '5068a613-8e28-4a62-87a7-97ca8cf2eb08', 'd3b028bb-076c-4d9c-a384-5d57eb562459', 'bae27aa4-6bbf-4bf1-82b0-d527e0135438'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:32:55 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-86ddff90-8232-4062-a355-d9a9ad89cc5a tempest-VolumesDeleteCascade-1244338346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:32:55 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-86ddff90-8232-4062-a355-d9a9ad89cc5a tempest-VolumesDeleteCascade-1244338346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:32:55 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-86ddff90-8232-4062-a355-d9a9ad89cc5a tempest-VolumesDeleteCascade-1244338346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:32:55 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-86ddff90-8232-4062-a355-d9a9ad89cc5a tempest-VolumesDeleteCascade-1244338346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:32:55 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-86ddff90-8232-4062-a355-d9a9ad89cc5a tempest-VolumesDeleteCascade-1244338346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:32:55 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-86ddff90-8232-4062-a355-d9a9ad89cc5a tempest-VolumesDeleteCascade-1244338346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:32:55 devstack sudo[99909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:32:55 devstack sudo[99909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:32:55 devstack sudo[99909]: pam_unix(sudo:session): session closed for user root Sep 28 09:32:55 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-86ddff90-8232-4062-a355-d9a9ad89cc5a tempest-VolumesDeleteCascade-1244338346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.547s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:32:55 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-86ddff90-8232-4062-a355-d9a9ad89cc5a tempest-VolumesDeleteCascade-1244338346 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:32:55 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-86ddff90-8232-4062-a355-d9a9ad89cc5a tempest-VolumesDeleteCascade-1244338346 None] Deleted volume successfully. Sep 28 09:32:55 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-86ddff90-8232-4062-a355-d9a9ad89cc5a tempest-VolumesDeleteCascade-1244338346 None] Lock "cinder-3ba3624e-bbbc-4e79-a564-0c2025a7d095-delete_volume" released by "delete_volume" :: held 10.425s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:32:56 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-621e50ab-0acd-43d7-8f7b-06e2e7ce233a tempest-VolumesTransfersV357Test-258044696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:32:56 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-621e50ab-0acd-43d7-8f7b-06e2e7ce233a tempest-VolumesTransfersV357Test-258044696 None] Flow 'volume_create_manager' (bf882044-65c8-4b36-bc35-4f6d7b7b5074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:32:56 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-621e50ab-0acd-43d7-8f7b-06e2e7ce233a tempest-VolumesTransfersV357Test-258044696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a952e697-b6f5-4ce6-9e86-5f3ae78b4da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:32:56 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-621e50ab-0acd-43d7-8f7b-06e2e7ce233a tempest-VolumesTransfersV357Test-258044696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a952e697-b6f5-4ce6-9e86-5f3ae78b4da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:32:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-77134870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8d2135e-8b53-4680-ab47-b54a52caa0c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b363fd3a3c924fb983b15db3f7974153',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:32:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:32:56Z,use_quota=True,user_id='d1937bd97d734f7dbcbd01bade56fb0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:32:56 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-621e50ab-0acd-43d7-8f7b-06e2e7ce233a tempest-VolumesTransfersV357Test-258044696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f0d9ec6-f0ae-4894-ae26-444397cd631d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:32:56 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-621e50ab-0acd-43d7-8f7b-06e2e7ce233a tempest-VolumesTransfersV357Test-258044696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f0d9ec6-f0ae-4894-ae26-444397cd631d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:32:56 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-621e50ab-0acd-43d7-8f7b-06e2e7ce233a tempest-VolumesTransfersV357Test-258044696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cda8a1b-cd5a-4957-b3cd-34af06e08605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:32:56 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-621e50ab-0acd-43d7-8f7b-06e2e7ce233a tempest-VolumesTransfersV357Test-258044696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cda8a1b-cd5a-4957-b3cd-34af06e08605) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8d2135e-8b53-4680-ab47-b54a52caa0c9', 'volume_name': 'volume-e8d2135e-8b53-4680-ab47-b54a52caa0c9', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:32:56 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-621e50ab-0acd-43d7-8f7b-06e2e7ce233a tempest-VolumesTransfersV357Test-258044696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aba6aead-429f-4414-9080-801495dc4bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:32:56 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-621e50ab-0acd-43d7-8f7b-06e2e7ce233a tempest-VolumesTransfersV357Test-258044696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aba6aead-429f-4414-9080-801495dc4bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:32:56 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-621e50ab-0acd-43d7-8f7b-06e2e7ce233a tempest-VolumesTransfersV357Test-258044696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c65ca101-2a08-4042-828f-c08378943492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:32:56 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-621e50ab-0acd-43d7-8f7b-06e2e7ce233a tempest-VolumesTransfersV357Test-258044696 None] Volume e8d2135e-8b53-4680-ab47-b54a52caa0c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8d2135e-8b53-4680-ab47-b54a52caa0c9', 'volume_size': 1} Sep 28 09:32:56 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-621e50ab-0acd-43d7-8f7b-06e2e7ce233a tempest-VolumesTransfersV357Test-258044696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:32:56 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-621e50ab-0acd-43d7-8f7b-06e2e7ce233a tempest-VolumesTransfersV357Test-258044696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:32:56 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-621e50ab-0acd-43d7-8f7b-06e2e7ce233a tempest-VolumesTransfersV357Test-258044696 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:32:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-77134870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8d2135e-8b53-4680-ab47-b54a52caa0c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b363fd3a3c924fb983b15db3f7974153',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:32:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:32:56Z,use_quota=True,user_id='d1937bd97d734f7dbcbd01bade56fb0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:32:56 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-621e50ab-0acd-43d7-8f7b-06e2e7ce233a tempest-VolumesTransfersV357Test-258044696 None] Creating volume e8d2135e-8b53-4680-ab47-b54a52caa0c9 {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:32:56 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-621e50ab-0acd-43d7-8f7b-06e2e7ce233a tempest-VolumesTransfersV357Test-258044696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:32:56 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-621e50ab-0acd-43d7-8f7b-06e2e7ce233a tempest-VolumesTransfersV357Test-258044696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:32:56 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-621e50ab-0acd-43d7-8f7b-06e2e7ce233a tempest-VolumesTransfersV357Test-258044696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:32:56 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-621e50ab-0acd-43d7-8f7b-06e2e7ce233a tempest-VolumesTransfersV357Test-258044696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:32:56 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-621e50ab-0acd-43d7-8f7b-06e2e7ce233a tempest-VolumesTransfersV357Test-258044696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:32:56 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-621e50ab-0acd-43d7-8f7b-06e2e7ce233a tempest-VolumesTransfersV357Test-258044696 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:32:56 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-621e50ab-0acd-43d7-8f7b-06e2e7ce233a tempest-VolumesTransfersV357Test-258044696 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:32:56 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-621e50ab-0acd-43d7-8f7b-06e2e7ce233a tempest-VolumesTransfersV357Test-258044696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-e8d2135e-8b53-4680-ab47-b54a52caa0c9 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:32:56 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d72c431-c26d-4ebe-b126-1e0906bf050a tempest-VolumeQuotasAdminTestJSON-703805994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:32:56 devstack sudo[99913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-e8d2135e-8b53-4680-ab47-b54a52caa0c9 1073741824 Sep 28 09:32:56 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-8d72c431-c26d-4ebe-b126-1e0906bf050a tempest-VolumeQuotasAdminTestJSON-703805994 None] Flow 'volume_create_manager' (b1e77a54-bf23-4415-a360-b5aa75692b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:32:56 devstack sudo[99913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:32:56 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-8d72c431-c26d-4ebe-b126-1e0906bf050a tempest-VolumeQuotasAdminTestJSON-703805994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c37eda7-040d-4318-b204-629aa1be07ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:32:56 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-8d72c431-c26d-4ebe-b126-1e0906bf050a tempest-VolumeQuotasAdminTestJSON-703805994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c37eda7-040d-4318-b204-629aa1be07ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:32:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-767772187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a2ddd89-ae4b-4084-a3ee-2c7ffbc47b99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3796b3a5635a4a418d0d97a2a48ea745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:32:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:32:56Z,use_quota=True,user_id='42d49f64541245749592591e1bcd730f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:32:56 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-8d72c431-c26d-4ebe-b126-1e0906bf050a tempest-VolumeQuotasAdminTestJSON-703805994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccca3178-3352-43f1-9e9a-c8536fdca3bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:32:56 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-8d72c431-c26d-4ebe-b126-1e0906bf050a tempest-VolumeQuotasAdminTestJSON-703805994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccca3178-3352-43f1-9e9a-c8536fdca3bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:32:56 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-8d72c431-c26d-4ebe-b126-1e0906bf050a tempest-VolumeQuotasAdminTestJSON-703805994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32cf295b-81c1-466c-ae2d-4afca33a19f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:32:56 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-8d72c431-c26d-4ebe-b126-1e0906bf050a tempest-VolumeQuotasAdminTestJSON-703805994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32cf295b-81c1-466c-ae2d-4afca33a19f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a2ddd89-ae4b-4084-a3ee-2c7ffbc47b99', 'volume_name': 'volume-8a2ddd89-ae4b-4084-a3ee-2c7ffbc47b99', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:32:56 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-8d72c431-c26d-4ebe-b126-1e0906bf050a tempest-VolumeQuotasAdminTestJSON-703805994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f2aa45a-5279-4ea7-95b1-71bc57e8613c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:32:56 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-8d72c431-c26d-4ebe-b126-1e0906bf050a tempest-VolumeQuotasAdminTestJSON-703805994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f2aa45a-5279-4ea7-95b1-71bc57e8613c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:32:56 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-8d72c431-c26d-4ebe-b126-1e0906bf050a tempest-VolumeQuotasAdminTestJSON-703805994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28daa6ee-dcd7-497c-bae8-b3619fed27ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:32:56 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-8d72c431-c26d-4ebe-b126-1e0906bf050a tempest-VolumeQuotasAdminTestJSON-703805994 None] Volume 8a2ddd89-ae4b-4084-a3ee-2c7ffbc47b99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a2ddd89-ae4b-4084-a3ee-2c7ffbc47b99', 'volume_size': 1} Sep 28 09:32:56 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-8d72c431-c26d-4ebe-b126-1e0906bf050a tempest-VolumeQuotasAdminTestJSON-703805994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:32:56 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-fea21b0c-0a1a-4d49-b54c-a08716355b6e tempest-TestMinimumBasicScenario-613097420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:32:56 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-fea21b0c-0a1a-4d49-b54c-a08716355b6e tempest-TestMinimumBasicScenario-613097420 None] Flow 'volume_create_manager' (b54f0249-240b-4eb8-aa3c-15a7f0e8261a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:32:56 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-fea21b0c-0a1a-4d49-b54c-a08716355b6e tempest-TestMinimumBasicScenario-613097420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (722b0e82-c74a-4973-a77e-6424c5b19281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:32:56 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-fea21b0c-0a1a-4d49-b54c-a08716355b6e tempest-TestMinimumBasicScenario-613097420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (722b0e82-c74a-4973-a77e-6424c5b19281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:32:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-521490180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d743dbb-5bc8-4db3-8eca-b702c6e5b91a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1ced62357a8400b85a5f1b381809776',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:32:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:32:57Z,use_quota=True,user_id='97c35f005d8a4567bd8caba6415ac5ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:32:56 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-fea21b0c-0a1a-4d49-b54c-a08716355b6e tempest-TestMinimumBasicScenario-613097420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (529a877b-ddb8-44b5-b292-82db0a1065c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:32:56 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-fea21b0c-0a1a-4d49-b54c-a08716355b6e tempest-TestMinimumBasicScenario-613097420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (529a877b-ddb8-44b5-b292-82db0a1065c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:32:56 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-fea21b0c-0a1a-4d49-b54c-a08716355b6e tempest-TestMinimumBasicScenario-613097420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4407a49-8e64-4e06-b3f8-48d7fb9992d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:32:56 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-fea21b0c-0a1a-4d49-b54c-a08716355b6e tempest-TestMinimumBasicScenario-613097420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4407a49-8e64-4e06-b3f8-48d7fb9992d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d743dbb-5bc8-4db3-8eca-b702c6e5b91a', 'volume_name': 'volume-8d743dbb-5bc8-4db3-8eca-b702c6e5b91a', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:32:56 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-fea21b0c-0a1a-4d49-b54c-a08716355b6e tempest-TestMinimumBasicScenario-613097420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d038bae-ae96-409a-8498-9e55bcbb205d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:32:56 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-fea21b0c-0a1a-4d49-b54c-a08716355b6e tempest-TestMinimumBasicScenario-613097420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d038bae-ae96-409a-8498-9e55bcbb205d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:32:56 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-fea21b0c-0a1a-4d49-b54c-a08716355b6e tempest-TestMinimumBasicScenario-613097420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95c1b18e-9859-449c-98d5-88b930d0c70d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:32:56 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-fea21b0c-0a1a-4d49-b54c-a08716355b6e tempest-TestMinimumBasicScenario-613097420 None] Volume 8d743dbb-5bc8-4db3-8eca-b702c6e5b91a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d743dbb-5bc8-4db3-8eca-b702c6e5b91a', 'volume_size': 1} Sep 28 09:32:56 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-fea21b0c-0a1a-4d49-b54c-a08716355b6e tempest-TestMinimumBasicScenario-613097420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:32:57 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-87e03400-3d01-42ec-84de-37b08dbf48bd tempest-VolumesDeleteCascade-1244338346 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:32:57 devstack sudo[99913]: pam_unix(sudo:session): session closed for user root Sep 28 09:32:57 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-87e03400-3d01-42ec-84de-37b08dbf48bd tempest-VolumesDeleteCascade-1244338346 None] Flow 'volume_create_manager' (0f24828c-ffa3-4ae5-bc8b-60284ea8aee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:32:57 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-87e03400-3d01-42ec-84de-37b08dbf48bd tempest-VolumesDeleteCascade-1244338346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ade442d-8143-4820-830a-3d97bcb75e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:32:57 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-621e50ab-0acd-43d7-8f7b-06e2e7ce233a tempest-VolumesTransfersV357Test-258044696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-e8d2135e-8b53-4680-ab47-b54a52caa0c9 1073741824" returned: 0 in 0.760s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:32:57 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-87e03400-3d01-42ec-84de-37b08dbf48bd tempest-VolumesDeleteCascade-1244338346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ade442d-8143-4820-830a-3d97bcb75e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:32:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1929279658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1097f36-c902-497b-8be3-499f7a369a1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c488dfb6dd74519a316387bbe015180',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:32:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:32:57Z,use_quota=True,user_id='de93fe157e72427aba7706c3b000441c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:32:57 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-87e03400-3d01-42ec-84de-37b08dbf48bd tempest-VolumesDeleteCascade-1244338346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44af0a96-f94f-4731-ab6a-7ce1e4c121be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:32:57 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-87e03400-3d01-42ec-84de-37b08dbf48bd tempest-VolumesDeleteCascade-1244338346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44af0a96-f94f-4731-ab6a-7ce1e4c121be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:32:57 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-87e03400-3d01-42ec-84de-37b08dbf48bd tempest-VolumesDeleteCascade-1244338346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33a9ee8c-cb2f-4f9e-9476-b0deba35807e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:32:57 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-87e03400-3d01-42ec-84de-37b08dbf48bd tempest-VolumesDeleteCascade-1244338346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33a9ee8c-cb2f-4f9e-9476-b0deba35807e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1097f36-c902-497b-8be3-499f7a369a1e', 'volume_name': 'volume-a1097f36-c902-497b-8be3-499f7a369a1e', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:32:57 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-87e03400-3d01-42ec-84de-37b08dbf48bd tempest-VolumesDeleteCascade-1244338346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (136ce4c1-7830-4667-9918-c229fd391e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:32:57 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-87e03400-3d01-42ec-84de-37b08dbf48bd tempest-VolumesDeleteCascade-1244338346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (136ce4c1-7830-4667-9918-c229fd391e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:32:57 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-87e03400-3d01-42ec-84de-37b08dbf48bd tempest-VolumesDeleteCascade-1244338346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f2d5485-db39-4d70-ae0d-227a96beec5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:32:57 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-87e03400-3d01-42ec-84de-37b08dbf48bd tempest-VolumesDeleteCascade-1244338346 None] Volume a1097f36-c902-497b-8be3-499f7a369a1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1097f36-c902-497b-8be3-499f7a369a1e', 'volume_size': 1} Sep 28 09:32:57 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-87e03400-3d01-42ec-84de-37b08dbf48bd tempest-VolumesDeleteCascade-1244338346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:32:57 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-621e50ab-0acd-43d7-8f7b-06e2e7ce233a tempest-VolumesTransfersV357Test-258044696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-e8d2135e-8b53-4680-ab47-b54a52caa0c9 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:32:57 devstack sudo[99919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-e8d2135e-8b53-4680-ab47-b54a52caa0c9 Sep 28 09:32:57 devstack sudo[99919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:32:57 devstack sudo[99919]: pam_unix(sudo:session): session closed for user root Sep 28 09:32:57 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-621e50ab-0acd-43d7-8f7b-06e2e7ce233a tempest-VolumesTransfersV357Test-258044696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-e8d2135e-8b53-4680-ab47-b54a52caa0c9" returned: 0 in 0.258s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:32:57 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-621e50ab-0acd-43d7-8f7b-06e2e7ce233a tempest-VolumesTransfersV357Test-258044696 None] <== create_volume: return (1109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:32:57 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-621e50ab-0acd-43d7-8f7b-06e2e7ce233a tempest-VolumesTransfersV357Test-258044696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.113s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:32:57 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-8d72c431-c26d-4ebe-b126-1e0906bf050a tempest-VolumeQuotasAdminTestJSON-703805994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.878s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:32:57 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-8d72c431-c26d-4ebe-b126-1e0906bf050a tempest-VolumeQuotasAdminTestJSON-703805994 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:32:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-767772187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a2ddd89-ae4b-4084-a3ee-2c7ffbc47b99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3796b3a5635a4a418d0d97a2a48ea745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:32:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:32:56Z,use_quota=True,user_id='42d49f64541245749592591e1bcd730f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:32:57 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-8d72c431-c26d-4ebe-b126-1e0906bf050a tempest-VolumeQuotasAdminTestJSON-703805994 None] Creating volume 8a2ddd89-ae4b-4084-a3ee-2c7ffbc47b99 {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:32:57 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-8d72c431-c26d-4ebe-b126-1e0906bf050a tempest-VolumeQuotasAdminTestJSON-703805994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:32:57 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-8d72c431-c26d-4ebe-b126-1e0906bf050a tempest-VolumeQuotasAdminTestJSON-703805994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:32:57 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-8d72c431-c26d-4ebe-b126-1e0906bf050a tempest-VolumeQuotasAdminTestJSON-703805994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:32:57 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-8d72c431-c26d-4ebe-b126-1e0906bf050a tempest-VolumeQuotasAdminTestJSON-703805994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:32:57 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-8d72c431-c26d-4ebe-b126-1e0906bf050a tempest-VolumeQuotasAdminTestJSON-703805994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:32:57 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-8d72c431-c26d-4ebe-b126-1e0906bf050a tempest-VolumeQuotasAdminTestJSON-703805994 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:32:57 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-8d72c431-c26d-4ebe-b126-1e0906bf050a tempest-VolumeQuotasAdminTestJSON-703805994 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:32:57 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-8d72c431-c26d-4ebe-b126-1e0906bf050a tempest-VolumeQuotasAdminTestJSON-703805994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-8a2ddd89-ae4b-4084-a3ee-2c7ffbc47b99 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:32:57 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-621e50ab-0acd-43d7-8f7b-06e2e7ce233a tempest-VolumesTransfersV357Test-258044696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c65ca101-2a08-4042-828f-c08378943492) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8d2135e-8b53-4680-ab47-b54a52caa0c9', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:32:57 devstack sudo[99922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-8a2ddd89-ae4b-4084-a3ee-2c7ffbc47b99 1073741824 Sep 28 09:32:57 devstack sudo[99922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:32:57 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-621e50ab-0acd-43d7-8f7b-06e2e7ce233a tempest-VolumesTransfersV357Test-258044696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54d2550f-e80a-4b62-8cae-3c1103d152bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:32:57 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-621e50ab-0acd-43d7-8f7b-06e2e7ce233a tempest-VolumesTransfersV357Test-258044696 None] Volume volume-e8d2135e-8b53-4680-ab47-b54a52caa0c9 (e8d2135e-8b53-4680-ab47-b54a52caa0c9): created successfully Sep 28 09:32:57 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-621e50ab-0acd-43d7-8f7b-06e2e7ce233a tempest-VolumesTransfersV357Test-258044696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54d2550f-e80a-4b62-8cae-3c1103d152bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:32:57 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-621e50ab-0acd-43d7-8f7b-06e2e7ce233a tempest-VolumesTransfersV357Test-258044696 None] Flow 'volume_create_manager' (bf882044-65c8-4b36-bc35-4f6d7b7b5074) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:32:57 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-621e50ab-0acd-43d7-8f7b-06e2e7ce233a tempest-VolumesTransfersV357Test-258044696 None] Created volume successfully. Sep 28 09:32:57 devstack sudo[99922]: pam_unix(sudo:session): session closed for user root Sep 28 09:32:57 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-8d72c431-c26d-4ebe-b126-1e0906bf050a tempest-VolumeQuotasAdminTestJSON-703805994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-8a2ddd89-ae4b-4084-a3ee-2c7ffbc47b99 1073741824" returned: 0 in 0.489s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:32:58 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-8d72c431-c26d-4ebe-b126-1e0906bf050a tempest-VolumeQuotasAdminTestJSON-703805994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-8a2ddd89-ae4b-4084-a3ee-2c7ffbc47b99 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:32:58 devstack sudo[99929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-8a2ddd89-ae4b-4084-a3ee-2c7ffbc47b99 Sep 28 09:32:58 devstack sudo[99929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:32:58 devstack sudo[99929]: pam_unix(sudo:session): session closed for user root Sep 28 09:32:58 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-8d72c431-c26d-4ebe-b126-1e0906bf050a tempest-VolumeQuotasAdminTestJSON-703805994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-8a2ddd89-ae4b-4084-a3ee-2c7ffbc47b99" returned: 0 in 0.323s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:32:58 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-8d72c431-c26d-4ebe-b126-1e0906bf050a tempest-VolumeQuotasAdminTestJSON-703805994 None] <== create_volume: return (854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:32:58 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-8d72c431-c26d-4ebe-b126-1e0906bf050a tempest-VolumeQuotasAdminTestJSON-703805994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.857s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:32:58 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-fea21b0c-0a1a-4d49-b54c-a08716355b6e tempest-TestMinimumBasicScenario-613097420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.376s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:32:58 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-fea21b0c-0a1a-4d49-b54c-a08716355b6e tempest-TestMinimumBasicScenario-613097420 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:32:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-521490180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d743dbb-5bc8-4db3-8eca-b702c6e5b91a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1ced62357a8400b85a5f1b381809776',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:32:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:32:57Z,use_quota=True,user_id='97c35f005d8a4567bd8caba6415ac5ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:32:58 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-fea21b0c-0a1a-4d49-b54c-a08716355b6e tempest-TestMinimumBasicScenario-613097420 None] Creating volume 8d743dbb-5bc8-4db3-8eca-b702c6e5b91a {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:32:58 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-fea21b0c-0a1a-4d49-b54c-a08716355b6e tempest-TestMinimumBasicScenario-613097420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:32:58 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-fea21b0c-0a1a-4d49-b54c-a08716355b6e tempest-TestMinimumBasicScenario-613097420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:32:58 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-fea21b0c-0a1a-4d49-b54c-a08716355b6e tempest-TestMinimumBasicScenario-613097420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:32:58 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-fea21b0c-0a1a-4d49-b54c-a08716355b6e tempest-TestMinimumBasicScenario-613097420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:32:58 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-fea21b0c-0a1a-4d49-b54c-a08716355b6e tempest-TestMinimumBasicScenario-613097420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:32:58 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-fea21b0c-0a1a-4d49-b54c-a08716355b6e tempest-TestMinimumBasicScenario-613097420 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:32:58 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-fea21b0c-0a1a-4d49-b54c-a08716355b6e tempest-TestMinimumBasicScenario-613097420 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:32:58 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-fea21b0c-0a1a-4d49-b54c-a08716355b6e tempest-TestMinimumBasicScenario-613097420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-8d743dbb-5bc8-4db3-8eca-b702c6e5b91a 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:32:58 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-fd2cd2b9-8dd2-4df8-b5bc-a1e985936202 tempest-VolumesTransfersV357Test-1688045820 None] Acquiring lock "cinder-e8d2135e-8b53-4680-ab47-b54a52caa0c9-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:32:58 devstack sudo[99932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-8d743dbb-5bc8-4db3-8eca-b702c6e5b91a 1073741824 Sep 28 09:32:58 devstack sudo[99932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:32:58 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-8d72c431-c26d-4ebe-b126-1e0906bf050a tempest-VolumeQuotasAdminTestJSON-703805994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28daa6ee-dcd7-497c-bae8-b3619fed27ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a2ddd89-ae4b-4084-a3ee-2c7ffbc47b99', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:32:58 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-8d72c431-c26d-4ebe-b126-1e0906bf050a tempest-VolumeQuotasAdminTestJSON-703805994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22874340-1c42-4230-a3ed-9149255fb0ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:32:58 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-fd2cd2b9-8dd2-4df8-b5bc-a1e985936202 tempest-VolumesTransfersV357Test-1688045820 None] Lock "cinder-e8d2135e-8b53-4680-ab47-b54a52caa0c9-delete_volume" acquired by "delete_volume" :: waited 0.094s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:32:58 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-8d72c431-c26d-4ebe-b126-1e0906bf050a tempest-VolumeQuotasAdminTestJSON-703805994 None] Volume volume-8a2ddd89-ae4b-4084-a3ee-2c7ffbc47b99 (8a2ddd89-ae4b-4084-a3ee-2c7ffbc47b99): created successfully Sep 28 09:32:58 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-8d72c431-c26d-4ebe-b126-1e0906bf050a tempest-VolumeQuotasAdminTestJSON-703805994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22874340-1c42-4230-a3ed-9149255fb0ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:32:58 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-8d72c431-c26d-4ebe-b126-1e0906bf050a tempest-VolumeQuotasAdminTestJSON-703805994 None] Flow 'volume_create_manager' (b1e77a54-bf23-4415-a360-b5aa75692b46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:32:58 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-8d72c431-c26d-4ebe-b126-1e0906bf050a tempest-VolumeQuotasAdminTestJSON-703805994 None] Created volume successfully. Sep 28 09:32:58 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-fd2cd2b9-8dd2-4df8-b5bc-a1e985936202 tempest-VolumesTransfersV357Test-1688045820 None] Acquiring lock "cinder-quobyte-e8d2135e-8b53-4680-ab47-b54a52caa0c9" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:32:58 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-fd2cd2b9-8dd2-4df8-b5bc-a1e985936202 tempest-VolumesTransfersV357Test-1688045820 None] Lock "cinder-quobyte-e8d2135e-8b53-4680-ab47-b54a52caa0c9" acquired by "delete_volume" :: waited 0.021s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:32:58 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[1834c69a-e195-4f2b-b860-37ec71855f90]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:32:58 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-fd2cd2b9-8dd2-4df8-b5bc-a1e985936202 tempest-VolumesTransfersV357Test-1688045820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-e8d2135e-8b53-4680-ab47-b54a52caa0c9 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:32:58 devstack sudo[99938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-e8d2135e-8b53-4680-ab47-b54a52caa0c9 Sep 28 09:32:58 devstack sudo[99938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:32:58 devstack sudo[99932]: pam_unix(sudo:session): session closed for user root Sep 28 09:32:58 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-fea21b0c-0a1a-4d49-b54c-a08716355b6e tempest-TestMinimumBasicScenario-613097420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-8d743dbb-5bc8-4db3-8eca-b702c6e5b91a 1073741824" returned: 0 in 0.482s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:32:58 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-fea21b0c-0a1a-4d49-b54c-a08716355b6e tempest-TestMinimumBasicScenario-613097420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-8d743dbb-5bc8-4db3-8eca-b702c6e5b91a {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:32:58 devstack sudo[99941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-8d743dbb-5bc8-4db3-8eca-b702c6e5b91a Sep 28 09:32:58 devstack sudo[99941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:32:59 devstack sudo[99938]: pam_unix(sudo:session): session closed for user root Sep 28 09:32:59 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-fd2cd2b9-8dd2-4df8-b5bc-a1e985936202 tempest-VolumesTransfersV357Test-1688045820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-e8d2135e-8b53-4680-ab47-b54a52caa0c9" returned: 0 in 0.430s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:32:59 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-fd2cd2b9-8dd2-4df8-b5bc-a1e985936202 tempest-VolumesTransfersV357Test-1688045820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-e8d2135e-8b53-4680-ab47-b54a52caa0c9 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:32:59 devstack sudo[99946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-e8d2135e-8b53-4680-ab47-b54a52caa0c9 Sep 28 09:32:59 devstack sudo[99946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:32:59 devstack sudo[99941]: pam_unix(sudo:session): session closed for user root Sep 28 09:32:59 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-fea21b0c-0a1a-4d49-b54c-a08716355b6e tempest-TestMinimumBasicScenario-613097420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-8d743dbb-5bc8-4db3-8eca-b702c6e5b91a" returned: 0 in 0.259s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:32:59 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-fea21b0c-0a1a-4d49-b54c-a08716355b6e tempest-TestMinimumBasicScenario-613097420 None] <== create_volume: return (804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:32:59 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-fea21b0c-0a1a-4d49-b54c-a08716355b6e tempest-TestMinimumBasicScenario-613097420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:32:59 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-87e03400-3d01-42ec-84de-37b08dbf48bd tempest-VolumesDeleteCascade-1244338346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.963s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:32:59 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-87e03400-3d01-42ec-84de-37b08dbf48bd tempest-VolumesDeleteCascade-1244338346 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:32:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1929279658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1097f36-c902-497b-8be3-499f7a369a1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c488dfb6dd74519a316387bbe015180',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:32:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:32:57Z,use_quota=True,user_id='de93fe157e72427aba7706c3b000441c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:32:59 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-87e03400-3d01-42ec-84de-37b08dbf48bd tempest-VolumesDeleteCascade-1244338346 None] Creating volume a1097f36-c902-497b-8be3-499f7a369a1e {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:32:59 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-87e03400-3d01-42ec-84de-37b08dbf48bd tempest-VolumesDeleteCascade-1244338346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:32:59 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-87e03400-3d01-42ec-84de-37b08dbf48bd tempest-VolumesDeleteCascade-1244338346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:32:59 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-87e03400-3d01-42ec-84de-37b08dbf48bd tempest-VolumesDeleteCascade-1244338346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:32:59 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-87e03400-3d01-42ec-84de-37b08dbf48bd tempest-VolumesDeleteCascade-1244338346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:32:59 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-87e03400-3d01-42ec-84de-37b08dbf48bd tempest-VolumesDeleteCascade-1244338346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:32:59 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-87e03400-3d01-42ec-84de-37b08dbf48bd tempest-VolumesDeleteCascade-1244338346 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:32:59 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-87e03400-3d01-42ec-84de-37b08dbf48bd tempest-VolumesDeleteCascade-1244338346 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:32:59 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-87e03400-3d01-42ec-84de-37b08dbf48bd tempest-VolumesDeleteCascade-1244338346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a1097f36-c902-497b-8be3-499f7a369a1e 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:32:59 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-fea21b0c-0a1a-4d49-b54c-a08716355b6e tempest-TestMinimumBasicScenario-613097420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95c1b18e-9859-449c-98d5-88b930d0c70d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d743dbb-5bc8-4db3-8eca-b702c6e5b91a', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:32:59 devstack sudo[99949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a1097f36-c902-497b-8be3-499f7a369a1e 1073741824 Sep 28 09:32:59 devstack sudo[99949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:32:59 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-fea21b0c-0a1a-4d49-b54c-a08716355b6e tempest-TestMinimumBasicScenario-613097420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55ac4feb-bbc4-4bf3-9566-0cff13fc335d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:32:59 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-fea21b0c-0a1a-4d49-b54c-a08716355b6e tempest-TestMinimumBasicScenario-613097420 None] Volume volume-8d743dbb-5bc8-4db3-8eca-b702c6e5b91a (8d743dbb-5bc8-4db3-8eca-b702c6e5b91a): created successfully Sep 28 09:32:59 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-fea21b0c-0a1a-4d49-b54c-a08716355b6e tempest-TestMinimumBasicScenario-613097420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55ac4feb-bbc4-4bf3-9566-0cff13fc335d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:32:59 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-fea21b0c-0a1a-4d49-b54c-a08716355b6e tempest-TestMinimumBasicScenario-613097420 None] Flow 'volume_create_manager' (b54f0249-240b-4eb8-aa3c-15a7f0e8261a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:32:59 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-fea21b0c-0a1a-4d49-b54c-a08716355b6e tempest-TestMinimumBasicScenario-613097420 None] Created volume successfully. Sep 28 09:32:59 devstack sudo[99946]: pam_unix(sudo:session): session closed for user root Sep 28 09:32:59 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-fd2cd2b9-8dd2-4df8-b5bc-a1e985936202 tempest-VolumesTransfersV357Test-1688045820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-e8d2135e-8b53-4680-ab47-b54a52caa0c9" returned: 0 in 0.338s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:32:59 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-fd2cd2b9-8dd2-4df8-b5bc-a1e985936202 tempest-VolumesTransfersV357Test-1688045820 None] Lock "cinder-quobyte-e8d2135e-8b53-4680-ab47-b54a52caa0c9" released by "delete_volume" :: held 0.825s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:32:59 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-fd2cd2b9-8dd2-4df8-b5bc-a1e985936202 tempest-VolumesTransfersV357Test-1688045820 None] Created reservations ['de7d4ac0-f922-4272-ac18-e65e764f46b0', 'e0687180-93da-450d-9b59-f2736fb57555', 'd146d189-a942-4735-a816-a4cec45a67a3', 'e5374c8f-bc18-45f1-adf3-07751b81d6f7'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:32:59 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-fd2cd2b9-8dd2-4df8-b5bc-a1e985936202 tempest-VolumesTransfersV357Test-1688045820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:32:59 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-fd2cd2b9-8dd2-4df8-b5bc-a1e985936202 tempest-VolumesTransfersV357Test-1688045820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:32:59 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-fd2cd2b9-8dd2-4df8-b5bc-a1e985936202 tempest-VolumesTransfersV357Test-1688045820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:32:59 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-fd2cd2b9-8dd2-4df8-b5bc-a1e985936202 tempest-VolumesTransfersV357Test-1688045820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:32:59 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-fd2cd2b9-8dd2-4df8-b5bc-a1e985936202 tempest-VolumesTransfersV357Test-1688045820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:32:59 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-fd2cd2b9-8dd2-4df8-b5bc-a1e985936202 tempest-VolumesTransfersV357Test-1688045820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:32:59 devstack sudo[99955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:32:59 devstack sudo[99955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:33:00 devstack sudo[99949]: pam_unix(sudo:session): session closed for user root Sep 28 09:33:00 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-87e03400-3d01-42ec-84de-37b08dbf48bd tempest-VolumesDeleteCascade-1244338346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a1097f36-c902-497b-8be3-499f7a369a1e 1073741824" returned: 0 in 0.853s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:33:00 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-87e03400-3d01-42ec-84de-37b08dbf48bd tempest-VolumesDeleteCascade-1244338346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a1097f36-c902-497b-8be3-499f7a369a1e {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:33:00 devstack sudo[99958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a1097f36-c902-497b-8be3-499f7a369a1e Sep 28 09:33:00 devstack sudo[99958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:33:00 devstack sudo[99955]: pam_unix(sudo:session): session closed for user root Sep 28 09:33:00 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-fd2cd2b9-8dd2-4df8-b5bc-a1e985936202 tempest-VolumesTransfersV357Test-1688045820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.661s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:33:00 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-fd2cd2b9-8dd2-4df8-b5bc-a1e985936202 tempest-VolumesTransfersV357Test-1688045820 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:33:00 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-fd2cd2b9-8dd2-4df8-b5bc-a1e985936202 tempest-VolumesTransfersV357Test-1688045820 None] Deleted volume successfully. Sep 28 09:33:00 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-fd2cd2b9-8dd2-4df8-b5bc-a1e985936202 tempest-VolumesTransfersV357Test-1688045820 None] Lock "cinder-e8d2135e-8b53-4680-ab47-b54a52caa0c9-delete_volume" released by "delete_volume" :: held 1.884s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:33:00 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-fee08e8a-a1f2-48db-9182-2c3c21993d89 tempest-VolumeQuotasAdminTestJSON-625990112 None] Transfer volume completed successfully. Sep 28 09:33:00 devstack sudo[99958]: pam_unix(sudo:session): session closed for user root Sep 28 09:33:00 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-87e03400-3d01-42ec-84de-37b08dbf48bd tempest-VolumesDeleteCascade-1244338346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a1097f36-c902-497b-8be3-499f7a369a1e" returned: 0 in 0.462s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:33:00 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-87e03400-3d01-42ec-84de-37b08dbf48bd tempest-VolumesDeleteCascade-1244338346 None] <== create_volume: return (1407ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:33:00 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-87e03400-3d01-42ec-84de-37b08dbf48bd tempest-VolumesDeleteCascade-1244338346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.410s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:33:00 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-87e03400-3d01-42ec-84de-37b08dbf48bd tempest-VolumesDeleteCascade-1244338346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f2d5485-db39-4d70-ae0d-227a96beec5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1097f36-c902-497b-8be3-499f7a369a1e', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:33:00 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-87e03400-3d01-42ec-84de-37b08dbf48bd tempest-VolumesDeleteCascade-1244338346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9c9d412-f417-4f7f-9645-da69234da4f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:33:00 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-87e03400-3d01-42ec-84de-37b08dbf48bd tempest-VolumesDeleteCascade-1244338346 None] Volume volume-a1097f36-c902-497b-8be3-499f7a369a1e (a1097f36-c902-497b-8be3-499f7a369a1e): created successfully Sep 28 09:33:00 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-87e03400-3d01-42ec-84de-37b08dbf48bd tempest-VolumesDeleteCascade-1244338346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9c9d412-f417-4f7f-9645-da69234da4f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:33:00 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-87e03400-3d01-42ec-84de-37b08dbf48bd tempest-VolumesDeleteCascade-1244338346 None] Flow 'volume_create_manager' (0f24828c-ffa3-4ae5-bc8b-60284ea8aee6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:33:00 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-87e03400-3d01-42ec-84de-37b08dbf48bd tempest-VolumesDeleteCascade-1244338346 None] Created volume successfully. Sep 28 09:33:01 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-66d6e315-0024-4178-b47d-437b6b7fcc70 tempest-VolumeQuotasAdminTestJSON-462746987 None] Acquiring lock "cinder-8a2ddd89-ae4b-4084-a3ee-2c7ffbc47b99-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:33:01 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-66d6e315-0024-4178-b47d-437b6b7fcc70 tempest-VolumeQuotasAdminTestJSON-462746987 None] Lock "cinder-8a2ddd89-ae4b-4084-a3ee-2c7ffbc47b99-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:33:01 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-66d6e315-0024-4178-b47d-437b6b7fcc70 tempest-VolumeQuotasAdminTestJSON-462746987 None] Acquiring lock "cinder-quobyte-8a2ddd89-ae4b-4084-a3ee-2c7ffbc47b99" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:33:01 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-66d6e315-0024-4178-b47d-437b6b7fcc70 tempest-VolumeQuotasAdminTestJSON-462746987 None] Lock "cinder-quobyte-8a2ddd89-ae4b-4084-a3ee-2c7ffbc47b99" acquired by "delete_volume" :: waited 0.039s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:33:01 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7d9fc7a-94a2-4940-856c-535fe9182ef8]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:33:01 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-66d6e315-0024-4178-b47d-437b6b7fcc70 tempest-VolumeQuotasAdminTestJSON-462746987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-8a2ddd89-ae4b-4084-a3ee-2c7ffbc47b99 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:33:01 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-4aebddef-02b2-45fc-a8a5-648cd2b5bb22 req-80c536f8-f8a0-4655-95e1-e3e0a7f45ca7 tempest-TestMinimumBasicScenario-613097420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:33:01 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-4aebddef-02b2-45fc-a8a5-648cd2b5bb22 req-80c536f8-f8a0-4655-95e1-e3e0a7f45ca7 tempest-TestMinimumBasicScenario-613097420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:33:01 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-4aebddef-02b2-45fc-a8a5-648cd2b5bb22 req-80c536f8-f8a0-4655-95e1-e3e0a7f45ca7 tempest-TestMinimumBasicScenario-613097420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:33:01 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [req-4aebddef-02b2-45fc-a8a5-648cd2b5bb22 req-80c536f8-f8a0-4655-95e1-e3e0a7f45ca7 tempest-TestMinimumBasicScenario-613097420 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d', 'name': 'volume-8d743dbb-5bc8-4db3-8eca-b702c6e5b91a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c513e4ce-f05f-48bc-96f3-a309677e96ba', 'enforce_multipath': True} {{(pid=86553) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 09:33:01 devstack cinder-volume[86553]: INFO cinder.volume.manager [req-4aebddef-02b2-45fc-a8a5-648cd2b5bb22 req-80c536f8-f8a0-4655-95e1-e3e0a7f45ca7 tempest-TestMinimumBasicScenario-613097420 None] attachment_update completed successfully. Sep 28 09:33:01 devstack sudo[99975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-8a2ddd89-ae4b-4084-a3ee-2c7ffbc47b99 Sep 28 09:33:01 devstack sudo[99975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:33:01 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-70239a45-8a86-4717-ba73-9f227dee6ada tempest-VolumesDeleteCascade-1244338346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:33:01 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-70239a45-8a86-4717-ba73-9f227dee6ada tempest-VolumesDeleteCascade-1244338346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:33:01 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-70239a45-8a86-4717-ba73-9f227dee6ada tempest-VolumesDeleteCascade-1244338346 None] Creating offline snapshot c6ab9707-8c59-47f6-ab09-d858b91fa7d1 of volume a1097f36-c902-497b-8be3-499f7a369a1e {{(pid=86553) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 09:33:01 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[addae9e6-9695-4926-8a79-abe7304456e9]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:33:01 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-70239a45-8a86-4717-ba73-9f227dee6ada tempest-VolumesDeleteCascade-1244338346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a1097f36-c902-497b-8be3-499f7a369a1e {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:33:01 devstack sudo[99978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a1097f36-c902-497b-8be3-499f7a369a1e Sep 28 09:33:01 devstack sudo[99978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:33:02 devstack sudo[99975]: pam_unix(sudo:session): session closed for user root Sep 28 09:33:02 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-66d6e315-0024-4178-b47d-437b6b7fcc70 tempest-VolumeQuotasAdminTestJSON-462746987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-8a2ddd89-ae4b-4084-a3ee-2c7ffbc47b99" returned: 0 in 0.752s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:33:02 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-66d6e315-0024-4178-b47d-437b6b7fcc70 tempest-VolumeQuotasAdminTestJSON-462746987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-8a2ddd89-ae4b-4084-a3ee-2c7ffbc47b99 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:33:02 devstack sudo[100080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-8a2ddd89-ae4b-4084-a3ee-2c7ffbc47b99 Sep 28 09:33:02 devstack sudo[100080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:33:02 devstack sudo[99978]: pam_unix(sudo:session): session closed for user root Sep 28 09:33:02 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-70239a45-8a86-4717-ba73-9f227dee6ada tempest-VolumesDeleteCascade-1244338346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a1097f36-c902-497b-8be3-499f7a369a1e" returned: 0 in 0.696s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:33:02 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-70239a45-8a86-4717-ba73-9f227dee6ada tempest-VolumesDeleteCascade-1244338346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a1097f36-c902-497b-8be3-499f7a369a1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a1097f36-c902-497b-8be3-499f7a369a1e.c6ab9707-8c59-47f6-ab09-d858b91fa7d1 1G {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:33:02 devstack sudo[100402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a1097f36-c902-497b-8be3-499f7a369a1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a1097f36-c902-497b-8be3-499f7a369a1e.c6ab9707-8c59-47f6-ab09-d858b91fa7d1 1G Sep 28 09:33:02 devstack sudo[100402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:33:02 devstack sudo[100080]: pam_unix(sudo:session): session closed for user root Sep 28 09:33:02 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-66d6e315-0024-4178-b47d-437b6b7fcc70 tempest-VolumeQuotasAdminTestJSON-462746987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-8a2ddd89-ae4b-4084-a3ee-2c7ffbc47b99" returned: 0 in 0.345s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:33:02 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-66d6e315-0024-4178-b47d-437b6b7fcc70 tempest-VolumeQuotasAdminTestJSON-462746987 None] Lock "cinder-quobyte-8a2ddd89-ae4b-4084-a3ee-2c7ffbc47b99" released by "delete_volume" :: held 1.204s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:33:02 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-66d6e315-0024-4178-b47d-437b6b7fcc70 tempest-VolumeQuotasAdminTestJSON-462746987 None] Created reservations ['f219ed7f-e779-486e-a503-12186bbee386', '46279761-d5aa-4ff0-8989-ca912b47ec5e', 'cf52c41d-1cf7-4a48-baa5-6489d165dc40', '0bff163f-52c0-4edb-ae98-1e22a889f665'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:33:02 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-66d6e315-0024-4178-b47d-437b6b7fcc70 tempest-VolumeQuotasAdminTestJSON-462746987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:33:02 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-66d6e315-0024-4178-b47d-437b6b7fcc70 tempest-VolumeQuotasAdminTestJSON-462746987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:33:02 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-66d6e315-0024-4178-b47d-437b6b7fcc70 tempest-VolumeQuotasAdminTestJSON-462746987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:33:02 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-66d6e315-0024-4178-b47d-437b6b7fcc70 tempest-VolumeQuotasAdminTestJSON-462746987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:33:02 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-66d6e315-0024-4178-b47d-437b6b7fcc70 tempest-VolumeQuotasAdminTestJSON-462746987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:33:02 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-66d6e315-0024-4178-b47d-437b6b7fcc70 tempest-VolumeQuotasAdminTestJSON-462746987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:33:02 devstack sudo[100410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:33:02 devstack sudo[100410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:33:03 devstack sudo[100402]: pam_unix(sudo:session): session closed for user root Sep 28 09:33:03 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-70239a45-8a86-4717-ba73-9f227dee6ada tempest-VolumesDeleteCascade-1244338346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a1097f36-c902-497b-8be3-499f7a369a1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a1097f36-c902-497b-8be3-499f7a369a1e.c6ab9707-8c59-47f6-ab09-d858b91fa7d1 1G" returned: 0 in 0.620s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:33:03 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-70239a45-8a86-4717-ba73-9f227dee6ada tempest-VolumesDeleteCascade-1244338346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1097f36-c902-497b-8be3-499f7a369a1e -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a1097f36-c902-497b-8be3-499f7a369a1e.c6ab9707-8c59-47f6-ab09-d858b91fa7d1 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:33:03 devstack sudo[100412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1097f36-c902-497b-8be3-499f7a369a1e -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a1097f36-c902-497b-8be3-499f7a369a1e.c6ab9707-8c59-47f6-ab09-d858b91fa7d1 Sep 28 09:33:03 devstack sudo[100412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:33:03 devstack sudo[100410]: pam_unix(sudo:session): session closed for user root Sep 28 09:33:03 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-66d6e315-0024-4178-b47d-437b6b7fcc70 tempest-VolumeQuotasAdminTestJSON-462746987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.448s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:33:03 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-66d6e315-0024-4178-b47d-437b6b7fcc70 tempest-VolumeQuotasAdminTestJSON-462746987 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:33:03 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-66d6e315-0024-4178-b47d-437b6b7fcc70 tempest-VolumeQuotasAdminTestJSON-462746987 None] Deleted volume successfully. Sep 28 09:33:03 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-66d6e315-0024-4178-b47d-437b6b7fcc70 tempest-VolumeQuotasAdminTestJSON-462746987 None] Lock "cinder-8a2ddd89-ae4b-4084-a3ee-2c7ffbc47b99-delete_volume" released by "delete_volume" :: held 2.151s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:33:03 devstack sudo[100412]: pam_unix(sudo:session): session closed for user root Sep 28 09:33:03 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-70239a45-8a86-4717-ba73-9f227dee6ada tempest-VolumesDeleteCascade-1244338346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1097f36-c902-497b-8be3-499f7a369a1e -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a1097f36-c902-497b-8be3-499f7a369a1e.c6ab9707-8c59-47f6-ab09-d858b91fa7d1" returned: 0 in 0.424s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:33:03 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-70239a45-8a86-4717-ba73-9f227dee6ada tempest-VolumesDeleteCascade-1244338346 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a1097f36-c902-497b-8be3-499f7a369a1e.c6ab9707-8c59-47f6-ab09-d858b91fa7d1 is being set with open permissions: ugo+rw Sep 28 09:33:03 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-70239a45-8a86-4717-ba73-9f227dee6ada tempest-VolumesDeleteCascade-1244338346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a1097f36-c902-497b-8be3-499f7a369a1e.c6ab9707-8c59-47f6-ab09-d858b91fa7d1 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:33:03 devstack sudo[100418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a1097f36-c902-497b-8be3-499f7a369a1e.c6ab9707-8c59-47f6-ab09-d858b91fa7d1 Sep 28 09:33:03 devstack sudo[100418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:33:03 devstack sudo[100418]: pam_unix(sudo:session): session closed for user root Sep 28 09:33:03 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-70239a45-8a86-4717-ba73-9f227dee6ada tempest-VolumesDeleteCascade-1244338346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a1097f36-c902-497b-8be3-499f7a369a1e.c6ab9707-8c59-47f6-ab09-d858b91fa7d1" returned: 0 in 0.440s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:33:04 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-70239a45-8a86-4717-ba73-9f227dee6ada tempest-VolumesDeleteCascade-1244338346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a1097f36-c902-497b-8be3-499f7a369a1e.info {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:33:04 devstack sudo[100421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a1097f36-c902-497b-8be3-499f7a369a1e.info Sep 28 09:33:04 devstack sudo[100421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:33:04 devstack sudo[100421]: pam_unix(sudo:session): session closed for user root Sep 28 09:33:04 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-70239a45-8a86-4717-ba73-9f227dee6ada tempest-VolumesDeleteCascade-1244338346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a1097f36-c902-497b-8be3-499f7a369a1e.info" returned: 0 in 0.312s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:33:04 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-70239a45-8a86-4717-ba73-9f227dee6ada tempest-VolumesDeleteCascade-1244338346 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a1097f36-c902-497b-8be3-499f7a369a1e.info is being set with open permissions: ugo+rw Sep 28 09:33:04 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-70239a45-8a86-4717-ba73-9f227dee6ada tempest-VolumesDeleteCascade-1244338346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a1097f36-c902-497b-8be3-499f7a369a1e.info {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:33:04 devstack sudo[100424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a1097f36-c902-497b-8be3-499f7a369a1e.info Sep 28 09:33:04 devstack sudo[100424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:33:04 devstack sudo[100424]: pam_unix(sudo:session): session closed for user root Sep 28 09:33:04 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-70239a45-8a86-4717-ba73-9f227dee6ada tempest-VolumesDeleteCascade-1244338346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a1097f36-c902-497b-8be3-499f7a369a1e.info" returned: 0 in 0.390s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:33:04 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-70239a45-8a86-4717-ba73-9f227dee6ada tempest-VolumesDeleteCascade-1244338346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.014s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:33:04 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-70239a45-8a86-4717-ba73-9f227dee6ada tempest-VolumesDeleteCascade-1244338346 None] Create snapshot completed successfully Sep 28 09:33:06 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-4005e852-8adf-4484-a9a1-20e50778fae5 tempest-VolumesDeleteCascade-1244338346 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:33:06 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-4005e852-8adf-4484-a9a1-20e50778fae5 tempest-VolumesDeleteCascade-1244338346 None] Flow 'volume_create_manager' (40b9b51c-5cb2-4d95-b4d8-39eb94c8f0ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:33:06 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-4005e852-8adf-4484-a9a1-20e50778fae5 tempest-VolumesDeleteCascade-1244338346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30b46d10-d245-4ef0-bc63-99da4a05d1a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:33:06 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-4005e852-8adf-4484-a9a1-20e50778fae5 tempest-VolumesDeleteCascade-1244338346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30b46d10-d245-4ef0-bc63-99da4a05d1a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:33:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-418053409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57cd13e3-2ff6-495d-a21f-a4812a613906,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c488dfb6dd74519a316387bbe015180',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c6ab9707-8c59-47f6-ab09-d858b91fa7d1,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:33:06Z,use_quota=True,user_id='de93fe157e72427aba7706c3b000441c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:33:06 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-4005e852-8adf-4484-a9a1-20e50778fae5 tempest-VolumesDeleteCascade-1244338346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64302a4c-f26d-4037-9dcf-8217a8659d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:33:06 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-4005e852-8adf-4484-a9a1-20e50778fae5 tempest-VolumesDeleteCascade-1244338346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64302a4c-f26d-4037-9dcf-8217a8659d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:33:06 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-4005e852-8adf-4484-a9a1-20e50778fae5 tempest-VolumesDeleteCascade-1244338346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df71ffc3-af5b-48bb-8953-e20f264eecbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:33:06 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-4005e852-8adf-4484-a9a1-20e50778fae5 tempest-VolumesDeleteCascade-1244338346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df71ffc3-af5b-48bb-8953-e20f264eecbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '57cd13e3-2ff6-495d-a21f-a4812a613906', 'volume_name': 'volume-57cd13e3-2ff6-495d-a21f-a4812a613906', 'volume_size': 1, 'snapshot_id': 'c6ab9707-8c59-47f6-ab09-d858b91fa7d1'}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:33:06 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-4005e852-8adf-4484-a9a1-20e50778fae5 tempest-VolumesDeleteCascade-1244338346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ed0fa7f-1ec8-41c8-a850-afd24817a032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:33:06 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-4005e852-8adf-4484-a9a1-20e50778fae5 tempest-VolumesDeleteCascade-1244338346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ed0fa7f-1ec8-41c8-a850-afd24817a032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:33:06 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-4005e852-8adf-4484-a9a1-20e50778fae5 tempest-VolumesDeleteCascade-1244338346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (588a03f2-cab2-439e-810d-b1c0f98a9365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:33:06 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-4005e852-8adf-4484-a9a1-20e50778fae5 tempest-VolumesDeleteCascade-1244338346 None] Volume 57cd13e3-2ff6-495d-a21f-a4812a613906: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-57cd13e3-2ff6-495d-a21f-a4812a613906', 'volume_size': 1, 'snapshot_id': 'c6ab9707-8c59-47f6-ab09-d858b91fa7d1'} Sep 28 09:33:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-4005e852-8adf-4484-a9a1-20e50778fae5 tempest-VolumesDeleteCascade-1244338346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:33:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-4005e852-8adf-4484-a9a1-20e50778fae5 tempest-VolumesDeleteCascade-1244338346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:33:06 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-4005e852-8adf-4484-a9a1-20e50778fae5 tempest-VolumesDeleteCascade-1244338346 None] Acquiring lock "cinder-quobyte-c6ab9707-8c59-47f6-ab09-d858b91fa7d1-57cd13e3-2ff6-495d-a21f-a4812a613906" by "_create_volume_from_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:33:06 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-4005e852-8adf-4484-a9a1-20e50778fae5 tempest-VolumesDeleteCascade-1244338346 None] Lock "cinder-quobyte-c6ab9707-8c59-47f6-ab09-d858b91fa7d1-57cd13e3-2ff6-495d-a21f-a4812a613906" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:33:06 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-4005e852-8adf-4484-a9a1-20e50778fae5 tempest-VolumesDeleteCascade-1244338346 None] Creating volume 57cd13e3-2ff6-495d-a21f-a4812a613906 from snapshot c6ab9707-8c59-47f6-ab09-d858b91fa7d1 {{(pid=86553) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 09:33:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-4005e852-8adf-4484-a9a1-20e50778fae5 tempest-VolumesDeleteCascade-1244338346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:33:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-4005e852-8adf-4484-a9a1-20e50778fae5 tempest-VolumesDeleteCascade-1244338346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:33:06 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-4005e852-8adf-4484-a9a1-20e50778fae5 tempest-VolumesDeleteCascade-1244338346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:33:06 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-4005e852-8adf-4484-a9a1-20e50778fae5 tempest-VolumesDeleteCascade-1244338346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:33:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-4005e852-8adf-4484-a9a1-20e50778fae5 tempest-VolumesDeleteCascade-1244338346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:33:06 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-4005e852-8adf-4484-a9a1-20e50778fae5 tempest-VolumesDeleteCascade-1244338346 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:33:06 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-4005e852-8adf-4484-a9a1-20e50778fae5 tempest-VolumesDeleteCascade-1244338346 None] Acquiring lock "cinder-quobyte-57cd13e3-2ff6-495d-a21f-a4812a613906" by "_copy_volume_from_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:33:06 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-4005e852-8adf-4484-a9a1-20e50778fae5 tempest-VolumesDeleteCascade-1244338346 None] Lock "cinder-quobyte-57cd13e3-2ff6-495d-a21f-a4812a613906" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:33:06 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-4005e852-8adf-4484-a9a1-20e50778fae5 tempest-VolumesDeleteCascade-1244338346 None] snapshot: c6ab9707-8c59-47f6-ab09-d858b91fa7d1, volume: 57cd13e3-2ff6-495d-a21f-a4812a613906, {{(pid=86553) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 09:33:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-4005e852-8adf-4484-a9a1-20e50778fae5 tempest-VolumesDeleteCascade-1244338346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:33:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-4005e852-8adf-4484-a9a1-20e50778fae5 tempest-VolumesDeleteCascade-1244338346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:33:06 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-4005e852-8adf-4484-a9a1-20e50778fae5 tempest-VolumesDeleteCascade-1244338346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:33:06 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-4005e852-8adf-4484-a9a1-20e50778fae5 tempest-VolumesDeleteCascade-1244338346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:33:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-4005e852-8adf-4484-a9a1-20e50778fae5 tempest-VolumesDeleteCascade-1244338346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:33:06 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[676cc63a-6b0e-4d82-ad28-38e57b73cb96]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:33:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-4005e852-8adf-4484-a9a1-20e50778fae5 tempest-VolumesDeleteCascade-1244338346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a1097f36-c902-497b-8be3-499f7a369a1e.c6ab9707-8c59-47f6-ab09-d858b91fa7d1 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:33:06 devstack sudo[100434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a1097f36-c902-497b-8be3-499f7a369a1e.c6ab9707-8c59-47f6-ab09-d858b91fa7d1 Sep 28 09:33:06 devstack sudo[100434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:33:07 devstack sudo[100434]: pam_unix(sudo:session): session closed for user root Sep 28 09:33:07 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-4005e852-8adf-4484-a9a1-20e50778fae5 tempest-VolumesDeleteCascade-1244338346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a1097f36-c902-497b-8be3-499f7a369a1e.c6ab9707-8c59-47f6-ab09-d858b91fa7d1" returned: 0 in 0.612s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:33:07 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-4005e852-8adf-4484-a9a1-20e50778fae5 tempest-VolumesDeleteCascade-1244338346 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1097f36-c902-497b-8be3-499f7a369a1e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86553) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 09:33:07 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[a928b20c-9302-4d2d-a00b-e7b6643b975e]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:33:07 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-4005e852-8adf-4484-a9a1-20e50778fae5 tempest-VolumesDeleteCascade-1244338346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a1097f36-c902-497b-8be3-499f7a369a1e {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:33:07 devstack sudo[100477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a1097f36-c902-497b-8be3-499f7a369a1e Sep 28 09:33:07 devstack sudo[100477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:33:07 devstack sudo[100477]: pam_unix(sudo:session): session closed for user root Sep 28 09:33:07 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-4005e852-8adf-4484-a9a1-20e50778fae5 tempest-VolumesDeleteCascade-1244338346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a1097f36-c902-497b-8be3-499f7a369a1e" returned: 0 in 0.531s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:33:07 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-4005e852-8adf-4484-a9a1-20e50778fae5 tempest-VolumesDeleteCascade-1244338346 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a1097f36-c902-497b-8be3-499f7a369a1e {{(pid=86553) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 09:33:07 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-4005e852-8adf-4484-a9a1-20e50778fae5 tempest-VolumesDeleteCascade-1244338346 None] Creating direct copy from snapshot {{(pid=86553) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 09:33:07 devstack cinder-volume[86553]: DEBUG cinder.utils [None req-4005e852-8adf-4484-a9a1-20e50778fae5 tempest-VolumesDeleteCascade-1244338346 None] Path /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-57cd13e3-2ff6-495d-a21f-a4812a613906 not found in is_blk_device check {{(pid=86553) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 09:33:07 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-4005e852-8adf-4484-a9a1-20e50778fae5 tempest-VolumesDeleteCascade-1244338346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a1097f36-c902-497b-8be3-499f7a369a1e /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-57cd13e3-2ff6-495d-a21f-a4812a613906 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:33:07 devstack sudo[100483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a1097f36-c902-497b-8be3-499f7a369a1e /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-57cd13e3-2ff6-495d-a21f-a4812a613906 Sep 28 09:33:07 devstack sudo[100483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:33:16 devstack cinder-volume[86553]: DEBUG dbcounter [-] [86553] Writing DB stats cinder:SELECT=108,cinder:UPDATE=130,cinder:DELETE=10,cinder:INSERT=32 {{(pid=86553) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 09:33:17 devstack sudo[100483]: pam_unix(sudo:session): session closed for user root Sep 28 09:33:17 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-4005e852-8adf-4484-a9a1-20e50778fae5 tempest-VolumesDeleteCascade-1244338346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a1097f36-c902-497b-8be3-499f7a369a1e /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-57cd13e3-2ff6-495d-a21f-a4812a613906" returned: 0 in 10.174s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:33:17 devstack cinder-volume[86553]: DEBUG cinder.image.image_utils [None req-4005e852-8adf-4484-a9a1-20e50778fae5 tempest-VolumesDeleteCascade-1244338346 None] Image conversion details: src /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a1097f36-c902-497b-8be3-499f7a369a1e, size 1024.00 MB, duration 10.18 sec, destination /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-57cd13e3-2ff6-495d-a21f-a4812a613906 {{(pid=86553) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 09:33:17 devstack cinder-volume[86553]: INFO cinder.image.image_utils [None req-4005e852-8adf-4484-a9a1-20e50778fae5 tempest-VolumesDeleteCascade-1244338346 None] Converted 1024.00 MB image at 100.64 MB/s Sep 28 09:33:17 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-4005e852-8adf-4484-a9a1-20e50778fae5 tempest-VolumesDeleteCascade-1244338346 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-57cd13e3-2ff6-495d-a21f-a4812a613906 is being set with open permissions: ugo+rw Sep 28 09:33:17 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-4005e852-8adf-4484-a9a1-20e50778fae5 tempest-VolumesDeleteCascade-1244338346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-57cd13e3-2ff6-495d-a21f-a4812a613906 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:33:17 devstack sudo[100499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-57cd13e3-2ff6-495d-a21f-a4812a613906 Sep 28 09:33:17 devstack sudo[100499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:33:18 devstack sudo[100499]: pam_unix(sudo:session): session closed for user root Sep 28 09:33:18 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-4005e852-8adf-4484-a9a1-20e50778fae5 tempest-VolumesDeleteCascade-1244338346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-57cd13e3-2ff6-495d-a21f-a4812a613906" returned: 0 in 0.384s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:33:18 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-4005e852-8adf-4484-a9a1-20e50778fae5 tempest-VolumesDeleteCascade-1244338346 None] Lock "cinder-quobyte-57cd13e3-2ff6-495d-a21f-a4812a613906" released by "_copy_volume_from_snapshot" :: held 11.855s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:33:18 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-4005e852-8adf-4484-a9a1-20e50778fae5 tempest-VolumesDeleteCascade-1244338346 None] Lock "cinder-quobyte-c6ab9707-8c59-47f6-ab09-d858b91fa7d1-57cd13e3-2ff6-495d-a21f-a4812a613906" released by "_create_volume_from_snapshot" :: held 11.952s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:33:18 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-4005e852-8adf-4484-a9a1-20e50778fae5 tempest-VolumesDeleteCascade-1244338346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.972s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:33:18 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-4005e852-8adf-4484-a9a1-20e50778fae5 tempest-VolumesDeleteCascade-1244338346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (588a03f2-cab2-439e-810d-b1c0f98a9365) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57cd13e3-2ff6-495d-a21f-a4812a613906', 'volume_size': 1, 'snapshot_id': 'c6ab9707-8c59-47f6-ab09-d858b91fa7d1'}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:33:18 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-4005e852-8adf-4484-a9a1-20e50778fae5 tempest-VolumesDeleteCascade-1244338346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e700ec9-5bd0-46a4-b7b6-b35c5ff3c97a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:33:18 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-4005e852-8adf-4484-a9a1-20e50778fae5 tempest-VolumesDeleteCascade-1244338346 None] Volume volume-57cd13e3-2ff6-495d-a21f-a4812a613906 (57cd13e3-2ff6-495d-a21f-a4812a613906): created successfully Sep 28 09:33:18 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-4005e852-8adf-4484-a9a1-20e50778fae5 tempest-VolumesDeleteCascade-1244338346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e700ec9-5bd0-46a4-b7b6-b35c5ff3c97a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:33:18 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-4005e852-8adf-4484-a9a1-20e50778fae5 tempest-VolumesDeleteCascade-1244338346 None] Flow 'volume_create_manager' (40b9b51c-5cb2-4d95-b4d8-39eb94c8f0ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:33:18 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-4005e852-8adf-4484-a9a1-20e50778fae5 tempest-VolumesDeleteCascade-1244338346 None] Created volume successfully. Sep 28 09:33:18 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-04a5c119-6939-4f9d-929e-2677de70c0aa tempest-VolumesDeleteCascade-1244338346 None] Acquiring lock "cinder-a1097f36-c902-497b-8be3-499f7a369a1e-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:33:18 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-04a5c119-6939-4f9d-929e-2677de70c0aa tempest-VolumesDeleteCascade-1244338346 None] Lock "cinder-a1097f36-c902-497b-8be3-499f7a369a1e-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:33:19 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-04a5c119-6939-4f9d-929e-2677de70c0aa tempest-VolumesDeleteCascade-1244338346 None] Performing cascade delete. {{(pid=86553) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 28 09:33:19 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-04a5c119-6939-4f9d-929e-2677de70c0aa tempest-VolumesDeleteCascade-1244338346 None] Acquiring lock "cinder-c6ab9707-8c59-47f6-ab09-d858b91fa7d1-delete_snapshot" by "delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:33:19 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-04a5c119-6939-4f9d-929e-2677de70c0aa tempest-VolumesDeleteCascade-1244338346 None] Lock "cinder-c6ab9707-8c59-47f6-ab09-d858b91fa7d1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:33:19 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-04a5c119-6939-4f9d-929e-2677de70c0aa tempest-VolumesDeleteCascade-1244338346 None] Acquiring lock "cinder-quobyte-a1097f36-c902-497b-8be3-499f7a369a1e" by "delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:33:19 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-04a5c119-6939-4f9d-929e-2677de70c0aa tempest-VolumesDeleteCascade-1244338346 None] Lock "cinder-quobyte-a1097f36-c902-497b-8be3-499f7a369a1e" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:33:19 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-04a5c119-6939-4f9d-929e-2677de70c0aa tempest-VolumesDeleteCascade-1244338346 None] Acquiring lock "cinder-quobyte-c6ab9707-8c59-47f6-ab09-d858b91fa7d1" by "_delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:33:19 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-04a5c119-6939-4f9d-929e-2677de70c0aa tempest-VolumesDeleteCascade-1244338346 None] Lock "cinder-quobyte-c6ab9707-8c59-47f6-ab09-d858b91fa7d1" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:33:19 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-04a5c119-6939-4f9d-929e-2677de70c0aa tempest-VolumesDeleteCascade-1244338346 None] Deleting offline snapshot c6ab9707-8c59-47f6-ab09-d858b91fa7d1 of volume a1097f36-c902-497b-8be3-499f7a369a1e {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 09:33:19 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-04a5c119-6939-4f9d-929e-2677de70c0aa tempest-VolumesDeleteCascade-1244338346 None] snapshot_file for this snap is: volume-a1097f36-c902-497b-8be3-499f7a369a1e.c6ab9707-8c59-47f6-ab09-d858b91fa7d1 {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 09:33:19 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe52aa48-1ac7-43ad-bf78-08f7fa6093b6]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:33:19 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-04a5c119-6939-4f9d-929e-2677de70c0aa tempest-VolumesDeleteCascade-1244338346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a1097f36-c902-497b-8be3-499f7a369a1e.c6ab9707-8c59-47f6-ab09-d858b91fa7d1 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:33:19 devstack sudo[100544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a1097f36-c902-497b-8be3-499f7a369a1e.c6ab9707-8c59-47f6-ab09-d858b91fa7d1 Sep 28 09:33:19 devstack sudo[100544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:33:19 devstack sudo[100544]: pam_unix(sudo:session): session closed for user root Sep 28 09:33:19 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-04a5c119-6939-4f9d-929e-2677de70c0aa tempest-VolumesDeleteCascade-1244338346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a1097f36-c902-497b-8be3-499f7a369a1e.c6ab9707-8c59-47f6-ab09-d858b91fa7d1" returned: 0 in 0.644s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:33:19 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-04a5c119-6939-4f9d-929e-2677de70c0aa tempest-VolumesDeleteCascade-1244338346 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1097f36-c902-497b-8be3-499f7a369a1e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86553) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 09:33:19 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d872838-f11f-44ee-b732-7a3d404f3458]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:33:19 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-04a5c119-6939-4f9d-929e-2677de70c0aa tempest-VolumesDeleteCascade-1244338346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a1097f36-c902-497b-8be3-499f7a369a1e {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:33:20 devstack sudo[100553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a1097f36-c902-497b-8be3-499f7a369a1e Sep 28 09:33:20 devstack sudo[100553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:33:20 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b5d57df-47e4-4288-b7ea-0008303e6ddf tempest-VolumeRetypeWithoutMigrationTest-1473969864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:33:20 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-4b5d57df-47e4-4288-b7ea-0008303e6ddf tempest-VolumeRetypeWithoutMigrationTest-1473969864 None] Flow 'volume_create_manager' (c6c5ea08-a433-4e05-8eff-518b693ee660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:33:20 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-4b5d57df-47e4-4288-b7ea-0008303e6ddf tempest-VolumeRetypeWithoutMigrationTest-1473969864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bee8a297-d5f8-40c6-a2b8-ba3b9f9ae030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:33:20 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-4b5d57df-47e4-4288-b7ea-0008303e6ddf tempest-VolumeRetypeWithoutMigrationTest-1473969864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bee8a297-d5f8-40c6-a2b8-ba3b9f9ae030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:33:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1509349497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12bcefdd-64ae-4417-a88f-ce281a8e7582,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f595a84782b41a28243199a2b2ed3c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:33:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:33:20Z,use_quota=True,user_id='2938a46b00a8478e8ff85cb567c3bf66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(acd578a8-5f6e-47ac-93b2-2b0846db568d),volume_type_id=acd578a8-5f6e-47ac-93b2-2b0846db568d)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:33:20 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-4b5d57df-47e4-4288-b7ea-0008303e6ddf tempest-VolumeRetypeWithoutMigrationTest-1473969864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bd9d268-7aaf-4fe7-af82-24e0b0a21adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:33:20 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-4b5d57df-47e4-4288-b7ea-0008303e6ddf tempest-VolumeRetypeWithoutMigrationTest-1473969864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bd9d268-7aaf-4fe7-af82-24e0b0a21adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:33:20 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-4b5d57df-47e4-4288-b7ea-0008303e6ddf tempest-VolumeRetypeWithoutMigrationTest-1473969864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ee73336-b695-448e-a821-e43a3a626cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:33:20 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-4b5d57df-47e4-4288-b7ea-0008303e6ddf tempest-VolumeRetypeWithoutMigrationTest-1473969864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ee73336-b695-448e-a821-e43a3a626cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12bcefdd-64ae-4417-a88f-ce281a8e7582', 'volume_name': 'volume-12bcefdd-64ae-4417-a88f-ce281a8e7582', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:33:20 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-4b5d57df-47e4-4288-b7ea-0008303e6ddf tempest-VolumeRetypeWithoutMigrationTest-1473969864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6796636a-677d-494b-a777-315e830cac24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:33:20 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-4b5d57df-47e4-4288-b7ea-0008303e6ddf tempest-VolumeRetypeWithoutMigrationTest-1473969864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6796636a-677d-494b-a777-315e830cac24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:33:20 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-4b5d57df-47e4-4288-b7ea-0008303e6ddf tempest-VolumeRetypeWithoutMigrationTest-1473969864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af2e4de4-5d29-4853-9e01-44530dfedfb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:33:20 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-4b5d57df-47e4-4288-b7ea-0008303e6ddf tempest-VolumeRetypeWithoutMigrationTest-1473969864 None] Volume 12bcefdd-64ae-4417-a88f-ce281a8e7582: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12bcefdd-64ae-4417-a88f-ce281a8e7582', 'volume_size': 1} Sep 28 09:33:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-4b5d57df-47e4-4288-b7ea-0008303e6ddf tempest-VolumeRetypeWithoutMigrationTest-1473969864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:33:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-4b5d57df-47e4-4288-b7ea-0008303e6ddf tempest-VolumeRetypeWithoutMigrationTest-1473969864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:33:20 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-4b5d57df-47e4-4288-b7ea-0008303e6ddf tempest-VolumeRetypeWithoutMigrationTest-1473969864 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:33:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1509349497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12bcefdd-64ae-4417-a88f-ce281a8e7582,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f595a84782b41a28243199a2b2ed3c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:33:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:33:20Z,use_quota=True,user_id='2938a46b00a8478e8ff85cb567c3bf66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(acd578a8-5f6e-47ac-93b2-2b0846db568d),volume_type_id=acd578a8-5f6e-47ac-93b2-2b0846db568d)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:33:20 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-4b5d57df-47e4-4288-b7ea-0008303e6ddf tempest-VolumeRetypeWithoutMigrationTest-1473969864 None] Creating volume 12bcefdd-64ae-4417-a88f-ce281a8e7582 {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:33:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-4b5d57df-47e4-4288-b7ea-0008303e6ddf tempest-VolumeRetypeWithoutMigrationTest-1473969864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:33:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-4b5d57df-47e4-4288-b7ea-0008303e6ddf tempest-VolumeRetypeWithoutMigrationTest-1473969864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:33:20 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-4b5d57df-47e4-4288-b7ea-0008303e6ddf tempest-VolumeRetypeWithoutMigrationTest-1473969864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:33:20 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-4b5d57df-47e4-4288-b7ea-0008303e6ddf tempest-VolumeRetypeWithoutMigrationTest-1473969864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:33:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-4b5d57df-47e4-4288-b7ea-0008303e6ddf tempest-VolumeRetypeWithoutMigrationTest-1473969864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:33:20 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-4b5d57df-47e4-4288-b7ea-0008303e6ddf tempest-VolumeRetypeWithoutMigrationTest-1473969864 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:33:20 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-4b5d57df-47e4-4288-b7ea-0008303e6ddf tempest-VolumeRetypeWithoutMigrationTest-1473969864 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:33:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-4b5d57df-47e4-4288-b7ea-0008303e6ddf tempest-VolumeRetypeWithoutMigrationTest-1473969864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-12bcefdd-64ae-4417-a88f-ce281a8e7582 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:33:20 devstack sudo[100557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-12bcefdd-64ae-4417-a88f-ce281a8e7582 1073741824 Sep 28 09:33:20 devstack sudo[100557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:33:20 devstack sudo[100553]: pam_unix(sudo:session): session closed for user root Sep 28 09:33:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-04a5c119-6939-4f9d-929e-2677de70c0aa tempest-VolumesDeleteCascade-1244338346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a1097f36-c902-497b-8be3-499f7a369a1e" returned: 0 in 0.855s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:33:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-04a5c119-6939-4f9d-929e-2677de70c0aa tempest-VolumesDeleteCascade-1244338346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a1097f36-c902-497b-8be3-499f7a369a1e.c6ab9707-8c59-47f6-ab09-d858b91fa7d1 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:33:20 devstack sudo[100567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a1097f36-c902-497b-8be3-499f7a369a1e.c6ab9707-8c59-47f6-ab09-d858b91fa7d1 Sep 28 09:33:20 devstack sudo[100567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:33:20 devstack sudo[100557]: pam_unix(sudo:session): session closed for user root Sep 28 09:33:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-4b5d57df-47e4-4288-b7ea-0008303e6ddf tempest-VolumeRetypeWithoutMigrationTest-1473969864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-12bcefdd-64ae-4417-a88f-ce281a8e7582 1073741824" returned: 0 in 0.680s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:33:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-4b5d57df-47e4-4288-b7ea-0008303e6ddf tempest-VolumeRetypeWithoutMigrationTest-1473969864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-12bcefdd-64ae-4417-a88f-ce281a8e7582 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:33:21 devstack sudo[100569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-12bcefdd-64ae-4417-a88f-ce281a8e7582 Sep 28 09:33:21 devstack sudo[100569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:33:21 devstack sudo[100567]: pam_unix(sudo:session): session closed for user root Sep 28 09:33:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-04a5c119-6939-4f9d-929e-2677de70c0aa tempest-VolumesDeleteCascade-1244338346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a1097f36-c902-497b-8be3-499f7a369a1e.c6ab9707-8c59-47f6-ab09-d858b91fa7d1" returned: 0 in 0.471s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:33:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-04a5c119-6939-4f9d-929e-2677de70c0aa tempest-VolumesDeleteCascade-1244338346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a1097f36-c902-497b-8be3-499f7a369a1e.c6ab9707-8c59-47f6-ab09-d858b91fa7d1 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:33:21 devstack sudo[100575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a1097f36-c902-497b-8be3-499f7a369a1e.c6ab9707-8c59-47f6-ab09-d858b91fa7d1 Sep 28 09:33:21 devstack sudo[100575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:33:21 devstack sudo[100569]: pam_unix(sudo:session): session closed for user root Sep 28 09:33:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-4b5d57df-47e4-4288-b7ea-0008303e6ddf tempest-VolumeRetypeWithoutMigrationTest-1473969864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-12bcefdd-64ae-4417-a88f-ce281a8e7582" returned: 0 in 0.337s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:33:21 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-4b5d57df-47e4-4288-b7ea-0008303e6ddf tempest-VolumeRetypeWithoutMigrationTest-1473969864 None] <== create_volume: return (1085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:33:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-4b5d57df-47e4-4288-b7ea-0008303e6ddf tempest-VolumeRetypeWithoutMigrationTest-1473969864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:33:21 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-4b5d57df-47e4-4288-b7ea-0008303e6ddf tempest-VolumeRetypeWithoutMigrationTest-1473969864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af2e4de4-5d29-4853-9e01-44530dfedfb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12bcefdd-64ae-4417-a88f-ce281a8e7582', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:33:21 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-4b5d57df-47e4-4288-b7ea-0008303e6ddf tempest-VolumeRetypeWithoutMigrationTest-1473969864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd218602-2ff7-4739-b925-5123901231f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:33:21 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-4b5d57df-47e4-4288-b7ea-0008303e6ddf tempest-VolumeRetypeWithoutMigrationTest-1473969864 None] Volume volume-12bcefdd-64ae-4417-a88f-ce281a8e7582 (12bcefdd-64ae-4417-a88f-ce281a8e7582): created successfully Sep 28 09:33:21 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-4b5d57df-47e4-4288-b7ea-0008303e6ddf tempest-VolumeRetypeWithoutMigrationTest-1473969864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd218602-2ff7-4739-b925-5123901231f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:33:21 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-4b5d57df-47e4-4288-b7ea-0008303e6ddf tempest-VolumeRetypeWithoutMigrationTest-1473969864 None] Flow 'volume_create_manager' (c6c5ea08-a433-4e05-8eff-518b693ee660) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:33:21 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-4b5d57df-47e4-4288-b7ea-0008303e6ddf tempest-VolumeRetypeWithoutMigrationTest-1473969864 None] Created volume successfully. Sep 28 09:33:21 devstack cinder-volume[86553]: DEBUG oslo_service.periodic_task [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Running periodic task VolumeManager._thread_info {{(pid=86553) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 09:33:21 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] thread count: 28 {{(pid=86553) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 09:33:21 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] thread info: [<_MainThread(MainThread, started 134684877779072)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86553) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 09:33:21 devstack sudo[100575]: pam_unix(sudo:session): session closed for user root Sep 28 09:33:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-04a5c119-6939-4f9d-929e-2677de70c0aa tempest-VolumesDeleteCascade-1244338346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a1097f36-c902-497b-8be3-499f7a369a1e.c6ab9707-8c59-47f6-ab09-d858b91fa7d1" returned: 0 in 0.374s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:33:21 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-04a5c119-6939-4f9d-929e-2677de70c0aa tempest-VolumesDeleteCascade-1244338346 None] Lock "cinder-quobyte-c6ab9707-8c59-47f6-ab09-d858b91fa7d1" released by "_delete_snapshot" :: held 2.518s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:33:21 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-04a5c119-6939-4f9d-929e-2677de70c0aa tempest-VolumesDeleteCascade-1244338346 None] Lock "cinder-quobyte-a1097f36-c902-497b-8be3-499f7a369a1e" released by "delete_snapshot" :: held 2.548s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:33:21 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-04a5c119-6939-4f9d-929e-2677de70c0aa tempest-VolumesDeleteCascade-1244338346 None] Created reservations ['0f706510-2f6c-4ae1-bdef-761f9ae3d1f6', 'dc7cf12a-b96a-426c-a11e-1befea6d1b43', '3bd26c5e-e505-4ae0-82c7-8844657ff5e1', 'dc04d7b7-789c-40d8-9df1-8b02e4d662bf'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:33:21 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-04a5c119-6939-4f9d-929e-2677de70c0aa tempest-VolumesDeleteCascade-1244338346 None] Delete snapshot completed successfully. Sep 28 09:33:21 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-04a5c119-6939-4f9d-929e-2677de70c0aa tempest-VolumesDeleteCascade-1244338346 None] Lock "cinder-c6ab9707-8c59-47f6-ab09-d858b91fa7d1-delete_snapshot" released by "delete_snapshot" :: held 2.740s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:33:21 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-04a5c119-6939-4f9d-929e-2677de70c0aa tempest-VolumesDeleteCascade-1244338346 None] Snapshots deleted, issuing volume delete {{(pid=86553) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 28 09:33:21 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-04a5c119-6939-4f9d-929e-2677de70c0aa tempest-VolumesDeleteCascade-1244338346 None] Acquiring lock "cinder-quobyte-a1097f36-c902-497b-8be3-499f7a369a1e" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:33:21 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-04a5c119-6939-4f9d-929e-2677de70c0aa tempest-VolumesDeleteCascade-1244338346 None] Lock "cinder-quobyte-a1097f36-c902-497b-8be3-499f7a369a1e" acquired by "delete_volume" :: waited 0.025s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:33:21 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f01303-9577-46c0-82b9-3468dbb664ae]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:33:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-04a5c119-6939-4f9d-929e-2677de70c0aa tempest-VolumesDeleteCascade-1244338346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a1097f36-c902-497b-8be3-499f7a369a1e {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:33:22 devstack sudo[100579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a1097f36-c902-497b-8be3-499f7a369a1e Sep 28 09:33:22 devstack sudo[100579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:33:22 devstack sudo[100579]: pam_unix(sudo:session): session closed for user root Sep 28 09:33:22 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-04a5c119-6939-4f9d-929e-2677de70c0aa tempest-VolumesDeleteCascade-1244338346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a1097f36-c902-497b-8be3-499f7a369a1e" returned: 0 in 0.544s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:33:22 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-04a5c119-6939-4f9d-929e-2677de70c0aa tempest-VolumesDeleteCascade-1244338346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a1097f36-c902-497b-8be3-499f7a369a1e {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:33:22 devstack sudo[100608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a1097f36-c902-497b-8be3-499f7a369a1e Sep 28 09:33:22 devstack sudo[100608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:33:22 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-0abdb798-7643-4f18-9efa-824b9bf0c661 tempest-VolumeRetypeWithoutMigrationTest-1473969864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:33:22 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-0abdb798-7643-4f18-9efa-824b9bf0c661 tempest-VolumeRetypeWithoutMigrationTest-1473969864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:33:22 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-0abdb798-7643-4f18-9efa-824b9bf0c661 tempest-VolumeRetypeWithoutMigrationTest-1473969864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:33:22 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-0abdb798-7643-4f18-9efa-824b9bf0c661 tempest-VolumeRetypeWithoutMigrationTest-1473969864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:33:22 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-0abdb798-7643-4f18-9efa-824b9bf0c661 tempest-VolumeRetypeWithoutMigrationTest-1473969864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:33:22 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0abdb798-7643-4f18-9efa-824b9bf0c661 tempest-VolumeRetypeWithoutMigrationTest-1473969864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:33:22 devstack sudo[100608]: pam_unix(sudo:session): session closed for user root Sep 28 09:33:22 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-04a5c119-6939-4f9d-929e-2677de70c0aa tempest-VolumesDeleteCascade-1244338346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a1097f36-c902-497b-8be3-499f7a369a1e" returned: 0 in 0.358s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:33:22 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-04a5c119-6939-4f9d-929e-2677de70c0aa tempest-VolumesDeleteCascade-1244338346 None] Lock "cinder-quobyte-a1097f36-c902-497b-8be3-499f7a369a1e" released by "delete_volume" :: held 0.995s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:33:22 devstack sudo[100611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:33:22 devstack sudo[100611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:33:22 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-04a5c119-6939-4f9d-929e-2677de70c0aa tempest-VolumesDeleteCascade-1244338346 None] Created reservations ['448287e1-bf3e-4f8d-9891-94a95f840e61', '3cbcf978-2631-4e17-bbcf-11f1dbaad3e7', 'd6f7f498-5f57-40e1-bded-ec51a8a758d0', '14d633e0-6fa5-4b90-aaec-8733d6c6a1f8'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:33:22 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-04a5c119-6939-4f9d-929e-2677de70c0aa tempest-VolumesDeleteCascade-1244338346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:33:22 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-04a5c119-6939-4f9d-929e-2677de70c0aa tempest-VolumesDeleteCascade-1244338346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:33:22 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-04a5c119-6939-4f9d-929e-2677de70c0aa tempest-VolumesDeleteCascade-1244338346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:33:22 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-04a5c119-6939-4f9d-929e-2677de70c0aa tempest-VolumesDeleteCascade-1244338346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:33:22 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-04a5c119-6939-4f9d-929e-2677de70c0aa tempest-VolumesDeleteCascade-1244338346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:33:22 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-04a5c119-6939-4f9d-929e-2677de70c0aa tempest-VolumesDeleteCascade-1244338346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:33:23 devstack sudo[100613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:33:23 devstack sudo[100613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:33:23 devstack sudo[100611]: pam_unix(sudo:session): session closed for user root Sep 28 09:33:23 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0abdb798-7643-4f18-9efa-824b9bf0c661 tempest-VolumeRetypeWithoutMigrationTest-1473969864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.316s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:33:23 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-0abdb798-7643-4f18-9efa-824b9bf0c661 tempest-VolumeRetypeWithoutMigrationTest-1473969864 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:33:23 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-0abdb798-7643-4f18-9efa-824b9bf0c661 tempest-VolumeRetypeWithoutMigrationTest-1473969864 None] Retype volume completed successfully. Sep 28 09:33:23 devstack sudo[100613]: pam_unix(sudo:session): session closed for user root Sep 28 09:33:23 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-04a5c119-6939-4f9d-929e-2677de70c0aa tempest-VolumesDeleteCascade-1244338346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.301s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:33:23 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-04a5c119-6939-4f9d-929e-2677de70c0aa tempest-VolumesDeleteCascade-1244338346 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:33:23 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-04a5c119-6939-4f9d-929e-2677de70c0aa tempest-VolumesDeleteCascade-1244338346 None] Deleted volume successfully. Sep 28 09:33:23 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-04a5c119-6939-4f9d-929e-2677de70c0aa tempest-VolumesDeleteCascade-1244338346 None] Lock "cinder-a1097f36-c902-497b-8be3-499f7a369a1e-delete_volume" released by "delete_volume" :: held 4.417s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:33:23 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-4056d3ed-df21-4643-8ca1-86d830a66501 tempest-VolumesDeleteCascade-1244338346 None] Acquiring lock "cinder-57cd13e3-2ff6-495d-a21f-a4812a613906-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:33:23 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-4056d3ed-df21-4643-8ca1-86d830a66501 tempest-VolumesDeleteCascade-1244338346 None] Lock "cinder-57cd13e3-2ff6-495d-a21f-a4812a613906-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:33:23 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-4056d3ed-df21-4643-8ca1-86d830a66501 tempest-VolumesDeleteCascade-1244338346 None] Acquiring lock "cinder-quobyte-57cd13e3-2ff6-495d-a21f-a4812a613906" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:33:23 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-4056d3ed-df21-4643-8ca1-86d830a66501 tempest-VolumesDeleteCascade-1244338346 None] Lock "cinder-quobyte-57cd13e3-2ff6-495d-a21f-a4812a613906" acquired by "delete_volume" :: waited 0.016s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:33:23 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[182694e1-ac9a-4de1-b47b-36e14e85f623]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:33:23 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-4056d3ed-df21-4643-8ca1-86d830a66501 tempest-VolumesDeleteCascade-1244338346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-57cd13e3-2ff6-495d-a21f-a4812a613906 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:33:23 devstack sudo[100617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-57cd13e3-2ff6-495d-a21f-a4812a613906 Sep 28 09:33:23 devstack sudo[100617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:33:24 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-5dad39ab-0418-4e99-8b18-aea7283f6752 tempest-VolumeRetypeWithoutMigrationTest-1473969864 None] Acquiring lock "cinder-12bcefdd-64ae-4417-a88f-ce281a8e7582-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:33:24 devstack sudo[100617]: pam_unix(sudo:session): session closed for user root Sep 28 09:33:24 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-4056d3ed-df21-4643-8ca1-86d830a66501 tempest-VolumesDeleteCascade-1244338346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-57cd13e3-2ff6-495d-a21f-a4812a613906" returned: 0 in 0.536s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:33:24 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-4056d3ed-df21-4643-8ca1-86d830a66501 tempest-VolumesDeleteCascade-1244338346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-57cd13e3-2ff6-495d-a21f-a4812a613906 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:33:24 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-5dad39ab-0418-4e99-8b18-aea7283f6752 tempest-VolumeRetypeWithoutMigrationTest-1473969864 None] Lock "cinder-12bcefdd-64ae-4417-a88f-ce281a8e7582-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:33:24 devstack sudo[100622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-57cd13e3-2ff6-495d-a21f-a4812a613906 Sep 28 09:33:24 devstack sudo[100622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:33:24 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-5dad39ab-0418-4e99-8b18-aea7283f6752 tempest-VolumeRetypeWithoutMigrationTest-1473969864 None] Acquiring lock "cinder-quobyte-12bcefdd-64ae-4417-a88f-ce281a8e7582" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:33:24 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-5dad39ab-0418-4e99-8b18-aea7283f6752 tempest-VolumeRetypeWithoutMigrationTest-1473969864 None] Lock "cinder-quobyte-12bcefdd-64ae-4417-a88f-ce281a8e7582" acquired by "delete_volume" :: waited 0.025s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:33:24 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[c691b58b-bed4-4a55-91e5-0e7b90e8ec56]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:33:24 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-5dad39ab-0418-4e99-8b18-aea7283f6752 tempest-VolumeRetypeWithoutMigrationTest-1473969864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-12bcefdd-64ae-4417-a88f-ce281a8e7582 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:33:24 devstack sudo[100624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-12bcefdd-64ae-4417-a88f-ce281a8e7582 Sep 28 09:33:24 devstack sudo[100624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:33:24 devstack sudo[100622]: pam_unix(sudo:session): session closed for user root Sep 28 09:33:24 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-4056d3ed-df21-4643-8ca1-86d830a66501 tempest-VolumesDeleteCascade-1244338346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-57cd13e3-2ff6-495d-a21f-a4812a613906" returned: 0 in 0.339s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:33:24 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-4056d3ed-df21-4643-8ca1-86d830a66501 tempest-VolumesDeleteCascade-1244338346 None] Lock "cinder-quobyte-57cd13e3-2ff6-495d-a21f-a4812a613906" released by "delete_volume" :: held 0.936s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:33:24 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-4056d3ed-df21-4643-8ca1-86d830a66501 tempest-VolumesDeleteCascade-1244338346 None] Created reservations ['96d798bf-6771-4ad7-bf73-092622e71bcf', '50a45885-6f75-4f5f-8e28-6492a8f9f6c2', '950cf11b-1ffb-4096-8606-a74724766b1e', '134ba297-7b12-48d7-a9b9-273ef0bbec8c'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:33:24 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-4056d3ed-df21-4643-8ca1-86d830a66501 tempest-VolumesDeleteCascade-1244338346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:33:24 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-4056d3ed-df21-4643-8ca1-86d830a66501 tempest-VolumesDeleteCascade-1244338346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:33:24 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-4056d3ed-df21-4643-8ca1-86d830a66501 tempest-VolumesDeleteCascade-1244338346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:33:24 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-4056d3ed-df21-4643-8ca1-86d830a66501 tempest-VolumesDeleteCascade-1244338346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:33:24 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-4056d3ed-df21-4643-8ca1-86d830a66501 tempest-VolumesDeleteCascade-1244338346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:33:24 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-4056d3ed-df21-4643-8ca1-86d830a66501 tempest-VolumesDeleteCascade-1244338346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:33:24 devstack sudo[100624]: pam_unix(sudo:session): session closed for user root Sep 28 09:33:24 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-5dad39ab-0418-4e99-8b18-aea7283f6752 tempest-VolumeRetypeWithoutMigrationTest-1473969864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-12bcefdd-64ae-4417-a88f-ce281a8e7582" returned: 0 in 0.517s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:33:24 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-5dad39ab-0418-4e99-8b18-aea7283f6752 tempest-VolumeRetypeWithoutMigrationTest-1473969864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-12bcefdd-64ae-4417-a88f-ce281a8e7582 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:33:24 devstack sudo[100630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:33:24 devstack sudo[100630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:33:24 devstack sudo[100632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-12bcefdd-64ae-4417-a88f-ce281a8e7582 Sep 28 09:33:24 devstack sudo[100632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:33:25 devstack sudo[100630]: pam_unix(sudo:session): session closed for user root Sep 28 09:33:25 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-4056d3ed-df21-4643-8ca1-86d830a66501 tempest-VolumesDeleteCascade-1244338346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.297s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:33:25 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-4056d3ed-df21-4643-8ca1-86d830a66501 tempest-VolumesDeleteCascade-1244338346 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:33:25 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-4056d3ed-df21-4643-8ca1-86d830a66501 tempest-VolumesDeleteCascade-1244338346 None] Deleted volume successfully. Sep 28 09:33:25 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-4056d3ed-df21-4643-8ca1-86d830a66501 tempest-VolumesDeleteCascade-1244338346 None] Lock "cinder-57cd13e3-2ff6-495d-a21f-a4812a613906-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:33:25 devstack sudo[100632]: pam_unix(sudo:session): session closed for user root Sep 28 09:33:25 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-5dad39ab-0418-4e99-8b18-aea7283f6752 tempest-VolumeRetypeWithoutMigrationTest-1473969864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-12bcefdd-64ae-4417-a88f-ce281a8e7582" returned: 0 in 0.319s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:33:25 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-5dad39ab-0418-4e99-8b18-aea7283f6752 tempest-VolumeRetypeWithoutMigrationTest-1473969864 None] Lock "cinder-quobyte-12bcefdd-64ae-4417-a88f-ce281a8e7582" released by "delete_volume" :: held 0.887s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:33:25 devstack cinder-volume[86553]: WARNING cinder.quota [None req-5dad39ab-0418-4e99-8b18-aea7283f6752 tempest-VolumeRetypeWithoutMigrationTest-1473969864 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 28 09:33:25 devstack cinder-volume[86553]: WARNING cinder.quota [None req-5dad39ab-0418-4e99-8b18-aea7283f6752 tempest-VolumeRetypeWithoutMigrationTest-1473969864 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 28 09:33:25 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-5dad39ab-0418-4e99-8b18-aea7283f6752 tempest-VolumeRetypeWithoutMigrationTest-1473969864 None] Created reservations ['665c3039-c142-4341-862e-ff81e5f0b209', '0b098555-db34-4b90-b663-1abffcacabd8', '4b506a77-fe7f-4eb7-a11a-be76f674c02f', '167d39e4-6f4c-4a23-9315-626a5f23708f'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:33:25 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-5dad39ab-0418-4e99-8b18-aea7283f6752 tempest-VolumeRetypeWithoutMigrationTest-1473969864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:33:25 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-5dad39ab-0418-4e99-8b18-aea7283f6752 tempest-VolumeRetypeWithoutMigrationTest-1473969864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:33:25 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-5dad39ab-0418-4e99-8b18-aea7283f6752 tempest-VolumeRetypeWithoutMigrationTest-1473969864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:33:25 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-5dad39ab-0418-4e99-8b18-aea7283f6752 tempest-VolumeRetypeWithoutMigrationTest-1473969864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:33:25 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-5dad39ab-0418-4e99-8b18-aea7283f6752 tempest-VolumeRetypeWithoutMigrationTest-1473969864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:33:25 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-5dad39ab-0418-4e99-8b18-aea7283f6752 tempest-VolumeRetypeWithoutMigrationTest-1473969864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:33:25 devstack sudo[100636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:33:25 devstack sudo[100636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:33:25 devstack sudo[100636]: pam_unix(sudo:session): session closed for user root Sep 28 09:33:25 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-5dad39ab-0418-4e99-8b18-aea7283f6752 tempest-VolumeRetypeWithoutMigrationTest-1473969864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.292s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:33:25 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-5dad39ab-0418-4e99-8b18-aea7283f6752 tempest-VolumeRetypeWithoutMigrationTest-1473969864 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:33:25 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-5dad39ab-0418-4e99-8b18-aea7283f6752 tempest-VolumeRetypeWithoutMigrationTest-1473969864 None] Deleted volume successfully. Sep 28 09:33:25 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-5dad39ab-0418-4e99-8b18-aea7283f6752 tempest-VolumeRetypeWithoutMigrationTest-1473969864 None] Lock "cinder-12bcefdd-64ae-4417-a88f-ce281a8e7582-delete_volume" released by "delete_volume" :: held 1.450s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:33:32 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-57608b25-6f56-4b38-98cd-266514cb3d1c tempest-VolumesTransfersTest-1773550242 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:33:32 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-57608b25-6f56-4b38-98cd-266514cb3d1c tempest-VolumesTransfersTest-1773550242 None] Flow 'volume_create_manager' (890e4147-dc75-485b-b4a5-860fb654497d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:33:32 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-57608b25-6f56-4b38-98cd-266514cb3d1c tempest-VolumesTransfersTest-1773550242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dccb9bd5-4b54-49e4-ad1e-9ce6f2bd8900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:33:32 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-57608b25-6f56-4b38-98cd-266514cb3d1c tempest-VolumesTransfersTest-1773550242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dccb9bd5-4b54-49e4-ad1e-9ce6f2bd8900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:33:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1491987096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7063abbd-3ed1-4804-aded-55a183f592b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7d15581098d4c43acb9da9c6bb3562f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:33:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:33:33Z,use_quota=True,user_id='b89770f2eb564a0e8d38920193ebdc7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:33:32 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-57608b25-6f56-4b38-98cd-266514cb3d1c tempest-VolumesTransfersTest-1773550242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd80e259-e226-435c-946e-c1e21939415b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:33:32 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-57608b25-6f56-4b38-98cd-266514cb3d1c tempest-VolumesTransfersTest-1773550242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd80e259-e226-435c-946e-c1e21939415b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:33:32 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-57608b25-6f56-4b38-98cd-266514cb3d1c tempest-VolumesTransfersTest-1773550242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5eaf60fd-8e6e-4af0-adb1-8df89af640b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:33:32 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-57608b25-6f56-4b38-98cd-266514cb3d1c tempest-VolumesTransfersTest-1773550242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5eaf60fd-8e6e-4af0-adb1-8df89af640b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7063abbd-3ed1-4804-aded-55a183f592b5', 'volume_name': 'volume-7063abbd-3ed1-4804-aded-55a183f592b5', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:33:32 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-57608b25-6f56-4b38-98cd-266514cb3d1c tempest-VolumesTransfersTest-1773550242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa59261c-740f-4f1d-8dc2-7868baa9fe7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:33:32 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-57608b25-6f56-4b38-98cd-266514cb3d1c tempest-VolumesTransfersTest-1773550242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa59261c-740f-4f1d-8dc2-7868baa9fe7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:33:32 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-57608b25-6f56-4b38-98cd-266514cb3d1c tempest-VolumesTransfersTest-1773550242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a91d3ac1-7cdb-48de-b78f-3ac5008c0920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:33:32 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-57608b25-6f56-4b38-98cd-266514cb3d1c tempest-VolumesTransfersTest-1773550242 None] Volume 7063abbd-3ed1-4804-aded-55a183f592b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7063abbd-3ed1-4804-aded-55a183f592b5', 'volume_size': 1} Sep 28 09:33:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-57608b25-6f56-4b38-98cd-266514cb3d1c tempest-VolumesTransfersTest-1773550242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:33:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-57608b25-6f56-4b38-98cd-266514cb3d1c tempest-VolumesTransfersTest-1773550242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:33:32 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-57608b25-6f56-4b38-98cd-266514cb3d1c tempest-VolumesTransfersTest-1773550242 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:33:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1491987096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7063abbd-3ed1-4804-aded-55a183f592b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7d15581098d4c43acb9da9c6bb3562f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:33:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:33:33Z,use_quota=True,user_id='b89770f2eb564a0e8d38920193ebdc7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:33:32 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-57608b25-6f56-4b38-98cd-266514cb3d1c tempest-VolumesTransfersTest-1773550242 None] Creating volume 7063abbd-3ed1-4804-aded-55a183f592b5 {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:33:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-57608b25-6f56-4b38-98cd-266514cb3d1c tempest-VolumesTransfersTest-1773550242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:33:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-57608b25-6f56-4b38-98cd-266514cb3d1c tempest-VolumesTransfersTest-1773550242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:33:32 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-57608b25-6f56-4b38-98cd-266514cb3d1c tempest-VolumesTransfersTest-1773550242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:33:32 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-57608b25-6f56-4b38-98cd-266514cb3d1c tempest-VolumesTransfersTest-1773550242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:33:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-57608b25-6f56-4b38-98cd-266514cb3d1c tempest-VolumesTransfersTest-1773550242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:33:32 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-57608b25-6f56-4b38-98cd-266514cb3d1c tempest-VolumesTransfersTest-1773550242 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:33:32 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-57608b25-6f56-4b38-98cd-266514cb3d1c tempest-VolumesTransfersTest-1773550242 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:33:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-57608b25-6f56-4b38-98cd-266514cb3d1c tempest-VolumesTransfersTest-1773550242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-7063abbd-3ed1-4804-aded-55a183f592b5 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:33:32 devstack sudo[100671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-7063abbd-3ed1-4804-aded-55a183f592b5 1073741824 Sep 28 09:33:32 devstack sudo[100671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:33:33 devstack sudo[100671]: pam_unix(sudo:session): session closed for user root Sep 28 09:33:33 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-57608b25-6f56-4b38-98cd-266514cb3d1c tempest-VolumesTransfersTest-1773550242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-7063abbd-3ed1-4804-aded-55a183f592b5 1073741824" returned: 0 in 0.754s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:33:33 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-57608b25-6f56-4b38-98cd-266514cb3d1c tempest-VolumesTransfersTest-1773550242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-7063abbd-3ed1-4804-aded-55a183f592b5 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:33:33 devstack sudo[100698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-7063abbd-3ed1-4804-aded-55a183f592b5 Sep 28 09:33:33 devstack sudo[100698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:33:34 devstack sudo[100698]: pam_unix(sudo:session): session closed for user root Sep 28 09:33:34 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-57608b25-6f56-4b38-98cd-266514cb3d1c tempest-VolumesTransfersTest-1773550242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-7063abbd-3ed1-4804-aded-55a183f592b5" returned: 0 in 0.362s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:33:34 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-57608b25-6f56-4b38-98cd-266514cb3d1c tempest-VolumesTransfersTest-1773550242 None] <== create_volume: return (1237ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:33:34 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-57608b25-6f56-4b38-98cd-266514cb3d1c tempest-VolumesTransfersTest-1773550242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.242s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:33:34 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-57608b25-6f56-4b38-98cd-266514cb3d1c tempest-VolumesTransfersTest-1773550242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a91d3ac1-7cdb-48de-b78f-3ac5008c0920) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7063abbd-3ed1-4804-aded-55a183f592b5', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:33:34 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-57608b25-6f56-4b38-98cd-266514cb3d1c tempest-VolumesTransfersTest-1773550242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddc2afdf-8132-433d-9a9a-2b639aa20738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:33:34 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-57608b25-6f56-4b38-98cd-266514cb3d1c tempest-VolumesTransfersTest-1773550242 None] Volume volume-7063abbd-3ed1-4804-aded-55a183f592b5 (7063abbd-3ed1-4804-aded-55a183f592b5): created successfully Sep 28 09:33:34 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-57608b25-6f56-4b38-98cd-266514cb3d1c tempest-VolumesTransfersTest-1773550242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddc2afdf-8132-433d-9a9a-2b639aa20738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:33:34 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-57608b25-6f56-4b38-98cd-266514cb3d1c tempest-VolumesTransfersTest-1773550242 None] Flow 'volume_create_manager' (890e4147-dc75-485b-b4a5-860fb654497d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:33:34 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-57608b25-6f56-4b38-98cd-266514cb3d1c tempest-VolumesTransfersTest-1773550242 None] Created volume successfully. Sep 28 09:33:36 devstack cinder-volume[86553]: DEBUG dbcounter [-] [86553] Writing DB stats cinder:INSERT=32,cinder:UPDATE=116,cinder:DELETE=12,cinder:SELECT=111 {{(pid=86553) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 09:33:36 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-d246ff2f-82f0-403f-b2a4-10f0280c4811 tempest-VolumesTransfersTest-357077564 None] Transfer volume completed successfully. Sep 28 09:33:37 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-1495e8c2-e4c7-4408-b4e6-77e7b959f6bd tempest-VolumesTransfersTest-1346750817 None] Acquiring lock "cinder-7063abbd-3ed1-4804-aded-55a183f592b5-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:33:37 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-1495e8c2-e4c7-4408-b4e6-77e7b959f6bd tempest-VolumesTransfersTest-1346750817 None] Lock "cinder-7063abbd-3ed1-4804-aded-55a183f592b5-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:33:37 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-1495e8c2-e4c7-4408-b4e6-77e7b959f6bd tempest-VolumesTransfersTest-1346750817 None] Acquiring lock "cinder-quobyte-7063abbd-3ed1-4804-aded-55a183f592b5" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:33:37 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-1495e8c2-e4c7-4408-b4e6-77e7b959f6bd tempest-VolumesTransfersTest-1346750817 None] Lock "cinder-quobyte-7063abbd-3ed1-4804-aded-55a183f592b5" acquired by "delete_volume" :: waited 0.023s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:33:37 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f8959a-490b-47d9-9b13-62f643ecfdc9]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:33:37 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1495e8c2-e4c7-4408-b4e6-77e7b959f6bd tempest-VolumesTransfersTest-1346750817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-7063abbd-3ed1-4804-aded-55a183f592b5 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:33:37 devstack sudo[100707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-7063abbd-3ed1-4804-aded-55a183f592b5 Sep 28 09:33:38 devstack sudo[100707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:33:38 devstack sudo[100707]: pam_unix(sudo:session): session closed for user root Sep 28 09:33:38 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1495e8c2-e4c7-4408-b4e6-77e7b959f6bd tempest-VolumesTransfersTest-1346750817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-7063abbd-3ed1-4804-aded-55a183f592b5" returned: 0 in 0.764s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:33:38 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1495e8c2-e4c7-4408-b4e6-77e7b959f6bd tempest-VolumesTransfersTest-1346750817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-7063abbd-3ed1-4804-aded-55a183f592b5 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:33:38 devstack sudo[100714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-7063abbd-3ed1-4804-aded-55a183f592b5 Sep 28 09:33:38 devstack sudo[100714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:33:39 devstack sudo[100714]: pam_unix(sudo:session): session closed for user root Sep 28 09:33:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1495e8c2-e4c7-4408-b4e6-77e7b959f6bd tempest-VolumesTransfersTest-1346750817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-7063abbd-3ed1-4804-aded-55a183f592b5" returned: 0 in 0.517s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:33:39 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-1495e8c2-e4c7-4408-b4e6-77e7b959f6bd tempest-VolumesTransfersTest-1346750817 None] Lock "cinder-quobyte-7063abbd-3ed1-4804-aded-55a183f592b5" released by "delete_volume" :: held 1.368s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:33:39 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-1495e8c2-e4c7-4408-b4e6-77e7b959f6bd tempest-VolumesTransfersTest-1346750817 None] Created reservations ['5bbd8a49-c48f-41cc-b38d-88d1dbb5287f', 'b8fc688c-e6c4-4c5b-a54b-016bfb6df27d', '0316c331-9941-4120-9505-09c703438bb5', 'a1f37e0b-f028-41d4-8e01-f92d1bd039fb'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:33:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-1495e8c2-e4c7-4408-b4e6-77e7b959f6bd tempest-VolumesTransfersTest-1346750817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:33:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-1495e8c2-e4c7-4408-b4e6-77e7b959f6bd tempest-VolumesTransfersTest-1346750817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:33:39 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-1495e8c2-e4c7-4408-b4e6-77e7b959f6bd tempest-VolumesTransfersTest-1346750817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:33:39 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-1495e8c2-e4c7-4408-b4e6-77e7b959f6bd tempest-VolumesTransfersTest-1346750817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:33:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-1495e8c2-e4c7-4408-b4e6-77e7b959f6bd tempest-VolumesTransfersTest-1346750817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:33:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1495e8c2-e4c7-4408-b4e6-77e7b959f6bd tempest-VolumesTransfersTest-1346750817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:33:39 devstack sudo[100717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:33:39 devstack sudo[100717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:33:39 devstack sudo[100717]: pam_unix(sudo:session): session closed for user root Sep 28 09:33:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1495e8c2-e4c7-4408-b4e6-77e7b959f6bd tempest-VolumesTransfersTest-1346750817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.492s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:33:39 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-1495e8c2-e4c7-4408-b4e6-77e7b959f6bd tempest-VolumesTransfersTest-1346750817 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:33:39 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-1495e8c2-e4c7-4408-b4e6-77e7b959f6bd tempest-VolumesTransfersTest-1346750817 None] Deleted volume successfully. Sep 28 09:33:39 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-1495e8c2-e4c7-4408-b4e6-77e7b959f6bd tempest-VolumesTransfersTest-1346750817 None] Lock "cinder-7063abbd-3ed1-4804-aded-55a183f592b5-delete_volume" released by "delete_volume" :: held 2.198s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:33:41 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-17148011-6860-4375-8172-d04085c3d294 tempest-VolumesTransfersTest-1773550242 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:33:41 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-17148011-6860-4375-8172-d04085c3d294 tempest-VolumesTransfersTest-1773550242 None] Flow 'volume_create_manager' (de160770-1ffc-494e-8cce-eeda5634947c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:33:41 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-17148011-6860-4375-8172-d04085c3d294 tempest-VolumesTransfersTest-1773550242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26cb522d-2259-4325-8fa5-a316ec234410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:33:41 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-17148011-6860-4375-8172-d04085c3d294 tempest-VolumesTransfersTest-1773550242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26cb522d-2259-4325-8fa5-a316ec234410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:33:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1641784243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70e06df8-a735-4c79-b98b-69072d1ba3ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7d15581098d4c43acb9da9c6bb3562f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:33:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:33:41Z,use_quota=True,user_id='b89770f2eb564a0e8d38920193ebdc7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:33:41 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-17148011-6860-4375-8172-d04085c3d294 tempest-VolumesTransfersTest-1773550242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c643b122-1867-4372-ab69-477e35f55f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:33:41 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-17148011-6860-4375-8172-d04085c3d294 tempest-VolumesTransfersTest-1773550242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c643b122-1867-4372-ab69-477e35f55f21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:33:41 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-17148011-6860-4375-8172-d04085c3d294 tempest-VolumesTransfersTest-1773550242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0c8675a-c343-42d3-96c2-36df7d7db4d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:33:41 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-17148011-6860-4375-8172-d04085c3d294 tempest-VolumesTransfersTest-1773550242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0c8675a-c343-42d3-96c2-36df7d7db4d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70e06df8-a735-4c79-b98b-69072d1ba3ee', 'volume_name': 'volume-70e06df8-a735-4c79-b98b-69072d1ba3ee', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:33:41 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-17148011-6860-4375-8172-d04085c3d294 tempest-VolumesTransfersTest-1773550242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36b35858-c19e-4254-a0be-6e4dd9d543e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:33:41 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-17148011-6860-4375-8172-d04085c3d294 tempest-VolumesTransfersTest-1773550242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36b35858-c19e-4254-a0be-6e4dd9d543e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:33:41 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-17148011-6860-4375-8172-d04085c3d294 tempest-VolumesTransfersTest-1773550242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (897e633b-79cf-49ff-8966-7f0167de6bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:33:41 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-17148011-6860-4375-8172-d04085c3d294 tempest-VolumesTransfersTest-1773550242 None] Volume 70e06df8-a735-4c79-b98b-69072d1ba3ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70e06df8-a735-4c79-b98b-69072d1ba3ee', 'volume_size': 1} Sep 28 09:33:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-17148011-6860-4375-8172-d04085c3d294 tempest-VolumesTransfersTest-1773550242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:33:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-17148011-6860-4375-8172-d04085c3d294 tempest-VolumesTransfersTest-1773550242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:33:41 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-17148011-6860-4375-8172-d04085c3d294 tempest-VolumesTransfersTest-1773550242 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:33:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1641784243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70e06df8-a735-4c79-b98b-69072d1ba3ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7d15581098d4c43acb9da9c6bb3562f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:33:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:33:41Z,use_quota=True,user_id='b89770f2eb564a0e8d38920193ebdc7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:33:41 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-17148011-6860-4375-8172-d04085c3d294 tempest-VolumesTransfersTest-1773550242 None] Creating volume 70e06df8-a735-4c79-b98b-69072d1ba3ee {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:33:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-17148011-6860-4375-8172-d04085c3d294 tempest-VolumesTransfersTest-1773550242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:33:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-17148011-6860-4375-8172-d04085c3d294 tempest-VolumesTransfersTest-1773550242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:33:41 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-17148011-6860-4375-8172-d04085c3d294 tempest-VolumesTransfersTest-1773550242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:33:41 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-17148011-6860-4375-8172-d04085c3d294 tempest-VolumesTransfersTest-1773550242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:33:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-17148011-6860-4375-8172-d04085c3d294 tempest-VolumesTransfersTest-1773550242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:33:41 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-17148011-6860-4375-8172-d04085c3d294 tempest-VolumesTransfersTest-1773550242 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:33:41 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-17148011-6860-4375-8172-d04085c3d294 tempest-VolumesTransfersTest-1773550242 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:33:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-17148011-6860-4375-8172-d04085c3d294 tempest-VolumesTransfersTest-1773550242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-70e06df8-a735-4c79-b98b-69072d1ba3ee 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:33:41 devstack sudo[100720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-70e06df8-a735-4c79-b98b-69072d1ba3ee 1073741824 Sep 28 09:33:41 devstack sudo[100720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:33:41 devstack sudo[100720]: pam_unix(sudo:session): session closed for user root Sep 28 09:33:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-17148011-6860-4375-8172-d04085c3d294 tempest-VolumesTransfersTest-1773550242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-70e06df8-a735-4c79-b98b-69072d1ba3ee 1073741824" returned: 0 in 0.602s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:33:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-17148011-6860-4375-8172-d04085c3d294 tempest-VolumesTransfersTest-1773550242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-70e06df8-a735-4c79-b98b-69072d1ba3ee {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:33:42 devstack sudo[100726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-70e06df8-a735-4c79-b98b-69072d1ba3ee Sep 28 09:33:42 devstack sudo[100726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:33:42 devstack sudo[100726]: pam_unix(sudo:session): session closed for user root Sep 28 09:33:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-17148011-6860-4375-8172-d04085c3d294 tempest-VolumesTransfersTest-1773550242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-70e06df8-a735-4c79-b98b-69072d1ba3ee" returned: 0 in 0.402s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:33:42 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-17148011-6860-4375-8172-d04085c3d294 tempest-VolumesTransfersTest-1773550242 None] <== create_volume: return (1102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:33:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-17148011-6860-4375-8172-d04085c3d294 tempest-VolumesTransfersTest-1773550242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.105s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:33:42 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-17148011-6860-4375-8172-d04085c3d294 tempest-VolumesTransfersTest-1773550242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (897e633b-79cf-49ff-8966-7f0167de6bdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70e06df8-a735-4c79-b98b-69072d1ba3ee', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:33:42 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-17148011-6860-4375-8172-d04085c3d294 tempest-VolumesTransfersTest-1773550242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f21418cf-8dbc-46e3-a4fd-9048708444eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:33:42 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-17148011-6860-4375-8172-d04085c3d294 tempest-VolumesTransfersTest-1773550242 None] Volume volume-70e06df8-a735-4c79-b98b-69072d1ba3ee (70e06df8-a735-4c79-b98b-69072d1ba3ee): created successfully Sep 28 09:33:42 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-17148011-6860-4375-8172-d04085c3d294 tempest-VolumesTransfersTest-1773550242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f21418cf-8dbc-46e3-a4fd-9048708444eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:33:42 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-17148011-6860-4375-8172-d04085c3d294 tempest-VolumesTransfersTest-1773550242 None] Flow 'volume_create_manager' (de160770-1ffc-494e-8cce-eeda5634947c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:33:42 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-17148011-6860-4375-8172-d04085c3d294 tempest-VolumesTransfersTest-1773550242 None] Created volume successfully. Sep 28 09:33:43 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-5128fcf3-4f09-45c6-97ae-c77aa8a63a16 tempest-VolumesTransfersTest-1346750817 None] Acquiring lock "cinder-70e06df8-a735-4c79-b98b-69072d1ba3ee-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:33:43 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-5128fcf3-4f09-45c6-97ae-c77aa8a63a16 tempest-VolumesTransfersTest-1346750817 None] Lock "cinder-70e06df8-a735-4c79-b98b-69072d1ba3ee-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:33:43 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-5128fcf3-4f09-45c6-97ae-c77aa8a63a16 tempest-VolumesTransfersTest-1346750817 None] Acquiring lock "cinder-quobyte-70e06df8-a735-4c79-b98b-69072d1ba3ee" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:33:43 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-5128fcf3-4f09-45c6-97ae-c77aa8a63a16 tempest-VolumesTransfersTest-1346750817 None] Lock "cinder-quobyte-70e06df8-a735-4c79-b98b-69072d1ba3ee" acquired by "delete_volume" :: waited 0.030s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:33:43 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab096a31-96dd-46eb-8dba-ec1fc707e292]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:33:43 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-5128fcf3-4f09-45c6-97ae-c77aa8a63a16 tempest-VolumesTransfersTest-1346750817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-70e06df8-a735-4c79-b98b-69072d1ba3ee {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:33:43 devstack sudo[100732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-70e06df8-a735-4c79-b98b-69072d1ba3ee Sep 28 09:33:43 devstack sudo[100732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:33:44 devstack sudo[100732]: pam_unix(sudo:session): session closed for user root Sep 28 09:33:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-5128fcf3-4f09-45c6-97ae-c77aa8a63a16 tempest-VolumesTransfersTest-1346750817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-70e06df8-a735-4c79-b98b-69072d1ba3ee" returned: 0 in 0.544s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:33:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-5128fcf3-4f09-45c6-97ae-c77aa8a63a16 tempest-VolumesTransfersTest-1346750817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-70e06df8-a735-4c79-b98b-69072d1ba3ee {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:33:44 devstack sudo[100737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-70e06df8-a735-4c79-b98b-69072d1ba3ee Sep 28 09:33:44 devstack sudo[100737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:33:44 devstack sudo[100737]: pam_unix(sudo:session): session closed for user root Sep 28 09:33:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-5128fcf3-4f09-45c6-97ae-c77aa8a63a16 tempest-VolumesTransfersTest-1346750817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-70e06df8-a735-4c79-b98b-69072d1ba3ee" returned: 0 in 0.409s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:33:44 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-5128fcf3-4f09-45c6-97ae-c77aa8a63a16 tempest-VolumesTransfersTest-1346750817 None] Lock "cinder-quobyte-70e06df8-a735-4c79-b98b-69072d1ba3ee" released by "delete_volume" :: held 1.037s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:33:44 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-5128fcf3-4f09-45c6-97ae-c77aa8a63a16 tempest-VolumesTransfersTest-1346750817 None] Created reservations ['3ef88920-6827-409c-aeca-5ee6dadb5701', '4a034832-2a82-4f98-b7fa-c133696a82a0', '814b83c3-9b42-426f-8052-9caf8b1ee913', '2ec8bcf5-e72e-4113-b44b-dfe02441ff3b'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:33:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-5128fcf3-4f09-45c6-97ae-c77aa8a63a16 tempest-VolumesTransfersTest-1346750817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:33:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-5128fcf3-4f09-45c6-97ae-c77aa8a63a16 tempest-VolumesTransfersTest-1346750817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:33:44 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-5128fcf3-4f09-45c6-97ae-c77aa8a63a16 tempest-VolumesTransfersTest-1346750817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:33:44 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-5128fcf3-4f09-45c6-97ae-c77aa8a63a16 tempest-VolumesTransfersTest-1346750817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:33:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-5128fcf3-4f09-45c6-97ae-c77aa8a63a16 tempest-VolumesTransfersTest-1346750817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:33:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-5128fcf3-4f09-45c6-97ae-c77aa8a63a16 tempest-VolumesTransfersTest-1346750817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:33:44 devstack sudo[100740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:33:44 devstack sudo[100740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:33:45 devstack sudo[100740]: pam_unix(sudo:session): session closed for user root Sep 28 09:33:45 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-5128fcf3-4f09-45c6-97ae-c77aa8a63a16 tempest-VolumesTransfersTest-1346750817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.446s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:33:45 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-5128fcf3-4f09-45c6-97ae-c77aa8a63a16 tempest-VolumesTransfersTest-1346750817 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:33:45 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-5128fcf3-4f09-45c6-97ae-c77aa8a63a16 tempest-VolumesTransfersTest-1346750817 None] Deleted volume successfully. Sep 28 09:33:45 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-5128fcf3-4f09-45c6-97ae-c77aa8a63a16 tempest-VolumesTransfersTest-1346750817 None] Lock "cinder-70e06df8-a735-4c79-b98b-69072d1ba3ee-delete_volume" released by "delete_volume" :: held 1.884s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:33:54 devstack cinder-volume[86553]: DEBUG dbcounter [-] [86553] Writing DB stats cinder:SELECT=14,cinder:INSERT=4,cinder:UPDATE=23,cinder:DELETE=2 {{(pid=86553) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 09:33:55 devstack cinder-volume[86553]: DEBUG dbcounter [-] [86553] Writing DB stats cinder:SELECT=39,cinder:INSERT=17,cinder:UPDATE=60,cinder:DELETE=4 {{(pid=86553) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 09:33:56 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ea1645b-7b85-4ac7-af4e-34bdc2452089 tempest-VolumesListAdminTestJSON-2142137126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:33:56 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-6ea1645b-7b85-4ac7-af4e-34bdc2452089 tempest-VolumesListAdminTestJSON-2142137126 None] Flow 'volume_create_manager' (50d6445f-f779-44cc-bc54-6b346f442354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:33:56 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-6ea1645b-7b85-4ac7-af4e-34bdc2452089 tempest-VolumesListAdminTestJSON-2142137126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3b5252a-a3e5-43f8-a3d7-9dd5eddb1b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:33:56 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-6ea1645b-7b85-4ac7-af4e-34bdc2452089 tempest-VolumesListAdminTestJSON-2142137126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3b5252a-a3e5-43f8-a3d7-9dd5eddb1b5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:33:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-983854397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17b38ba8-1ee8-4133-8f36-0a0d5d627b4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adccbd2ab5b241d5add7937a5b5043a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:33:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:33:56Z,use_quota=True,user_id='77e6977d754d4d8abe142828f7834ee1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:33:56 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-6ea1645b-7b85-4ac7-af4e-34bdc2452089 tempest-VolumesListAdminTestJSON-2142137126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c00242d-e493-443e-a993-5bf69848257b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:33:56 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-6ea1645b-7b85-4ac7-af4e-34bdc2452089 tempest-VolumesListAdminTestJSON-2142137126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c00242d-e493-443e-a993-5bf69848257b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:33:56 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-6ea1645b-7b85-4ac7-af4e-34bdc2452089 tempest-VolumesListAdminTestJSON-2142137126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b055dff6-7c69-4fa9-aba9-cbd7532a6459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:33:56 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-6ea1645b-7b85-4ac7-af4e-34bdc2452089 tempest-VolumesListAdminTestJSON-2142137126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b055dff6-7c69-4fa9-aba9-cbd7532a6459) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17b38ba8-1ee8-4133-8f36-0a0d5d627b4b', 'volume_name': 'volume-17b38ba8-1ee8-4133-8f36-0a0d5d627b4b', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:33:56 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-6ea1645b-7b85-4ac7-af4e-34bdc2452089 tempest-VolumesListAdminTestJSON-2142137126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eba355bf-3e1e-4621-bff0-e9fc18c1b2e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:33:56 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-6ea1645b-7b85-4ac7-af4e-34bdc2452089 tempest-VolumesListAdminTestJSON-2142137126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eba355bf-3e1e-4621-bff0-e9fc18c1b2e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:33:56 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-6ea1645b-7b85-4ac7-af4e-34bdc2452089 tempest-VolumesListAdminTestJSON-2142137126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3502dbb-da1d-4c16-a382-b6c5ab9bfd33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:33:56 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-6ea1645b-7b85-4ac7-af4e-34bdc2452089 tempest-VolumesListAdminTestJSON-2142137126 None] Volume 17b38ba8-1ee8-4133-8f36-0a0d5d627b4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17b38ba8-1ee8-4133-8f36-0a0d5d627b4b', 'volume_size': 1} Sep 28 09:33:56 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-6ea1645b-7b85-4ac7-af4e-34bdc2452089 tempest-VolumesListAdminTestJSON-2142137126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:33:56 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-6ea1645b-7b85-4ac7-af4e-34bdc2452089 tempest-VolumesListAdminTestJSON-2142137126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:33:56 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-6ea1645b-7b85-4ac7-af4e-34bdc2452089 tempest-VolumesListAdminTestJSON-2142137126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:33:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-983854397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17b38ba8-1ee8-4133-8f36-0a0d5d627b4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adccbd2ab5b241d5add7937a5b5043a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:33:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:33:56Z,use_quota=True,user_id='77e6977d754d4d8abe142828f7834ee1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:33:56 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-6ea1645b-7b85-4ac7-af4e-34bdc2452089 tempest-VolumesListAdminTestJSON-2142137126 None] Creating volume 17b38ba8-1ee8-4133-8f36-0a0d5d627b4b {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:33:56 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-6ea1645b-7b85-4ac7-af4e-34bdc2452089 tempest-VolumesListAdminTestJSON-2142137126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:33:56 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-6ea1645b-7b85-4ac7-af4e-34bdc2452089 tempest-VolumesListAdminTestJSON-2142137126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:33:56 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-6ea1645b-7b85-4ac7-af4e-34bdc2452089 tempest-VolumesListAdminTestJSON-2142137126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:33:56 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-6ea1645b-7b85-4ac7-af4e-34bdc2452089 tempest-VolumesListAdminTestJSON-2142137126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:33:56 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-6ea1645b-7b85-4ac7-af4e-34bdc2452089 tempest-VolumesListAdminTestJSON-2142137126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:33:56 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-6ea1645b-7b85-4ac7-af4e-34bdc2452089 tempest-VolumesListAdminTestJSON-2142137126 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:33:56 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-6ea1645b-7b85-4ac7-af4e-34bdc2452089 tempest-VolumesListAdminTestJSON-2142137126 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:33:56 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-6ea1645b-7b85-4ac7-af4e-34bdc2452089 tempest-VolumesListAdminTestJSON-2142137126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-17b38ba8-1ee8-4133-8f36-0a0d5d627b4b 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:33:56 devstack sudo[100852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-17b38ba8-1ee8-4133-8f36-0a0d5d627b4b 1073741824 Sep 28 09:33:56 devstack sudo[100852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:33:56 devstack sudo[100852]: pam_unix(sudo:session): session closed for user root Sep 28 09:33:56 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-6ea1645b-7b85-4ac7-af4e-34bdc2452089 tempest-VolumesListAdminTestJSON-2142137126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-17b38ba8-1ee8-4133-8f36-0a0d5d627b4b 1073741824" returned: 0 in 0.637s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:33:56 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-6ea1645b-7b85-4ac7-af4e-34bdc2452089 tempest-VolumesListAdminTestJSON-2142137126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-17b38ba8-1ee8-4133-8f36-0a0d5d627b4b {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:33:57 devstack sudo[100858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-17b38ba8-1ee8-4133-8f36-0a0d5d627b4b Sep 28 09:33:57 devstack sudo[100858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:33:57 devstack sudo[100858]: pam_unix(sudo:session): session closed for user root Sep 28 09:33:57 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-6ea1645b-7b85-4ac7-af4e-34bdc2452089 tempest-VolumesListAdminTestJSON-2142137126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-17b38ba8-1ee8-4133-8f36-0a0d5d627b4b" returned: 0 in 0.352s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:33:57 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-6ea1645b-7b85-4ac7-af4e-34bdc2452089 tempest-VolumesListAdminTestJSON-2142137126 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:33:57 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-6ea1645b-7b85-4ac7-af4e-34bdc2452089 tempest-VolumesListAdminTestJSON-2142137126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.059s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:33:57 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-6ea1645b-7b85-4ac7-af4e-34bdc2452089 tempest-VolumesListAdminTestJSON-2142137126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3502dbb-da1d-4c16-a382-b6c5ab9bfd33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17b38ba8-1ee8-4133-8f36-0a0d5d627b4b', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:33:57 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-6ea1645b-7b85-4ac7-af4e-34bdc2452089 tempest-VolumesListAdminTestJSON-2142137126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73a6c25c-5d3d-4e9f-81ce-e21f3c0f6d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:33:57 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-6ea1645b-7b85-4ac7-af4e-34bdc2452089 tempest-VolumesListAdminTestJSON-2142137126 None] Volume volume-17b38ba8-1ee8-4133-8f36-0a0d5d627b4b (17b38ba8-1ee8-4133-8f36-0a0d5d627b4b): created successfully Sep 28 09:33:57 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-6ea1645b-7b85-4ac7-af4e-34bdc2452089 tempest-VolumesListAdminTestJSON-2142137126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73a6c25c-5d3d-4e9f-81ce-e21f3c0f6d6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:33:57 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-6ea1645b-7b85-4ac7-af4e-34bdc2452089 tempest-VolumesListAdminTestJSON-2142137126 None] Flow 'volume_create_manager' (50d6445f-f779-44cc-bc54-6b346f442354) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:33:57 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-6ea1645b-7b85-4ac7-af4e-34bdc2452089 tempest-VolumesListAdminTestJSON-2142137126 None] Created volume successfully. Sep 28 09:33:58 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-b28ee0e6-424d-4c30-82a6-702d3a6e2c8a tempest-VolumesTransfersV355Test-1350552129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:33:58 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b28ee0e6-424d-4c30-82a6-702d3a6e2c8a tempest-VolumesTransfersV355Test-1350552129 None] Flow 'volume_create_manager' (fa06e88d-fc47-43bf-9616-e4f333d6cda4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:33:58 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b28ee0e6-424d-4c30-82a6-702d3a6e2c8a tempest-VolumesTransfersV355Test-1350552129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dcee9b3-6092-4bf7-9d4b-76b24b1077c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:33:58 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b28ee0e6-424d-4c30-82a6-702d3a6e2c8a tempest-VolumesTransfersV355Test-1350552129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dcee9b3-6092-4bf7-9d4b-76b24b1077c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:33:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-128788051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d44d3e16-31a6-4f2e-ab94-e29f2b2e4f45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae5b2d0a788641089add2e01777bbbed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:33:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:33:58Z,use_quota=True,user_id='7be22bce98c84bed9ddffa7286a1c7ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:33:58 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b28ee0e6-424d-4c30-82a6-702d3a6e2c8a tempest-VolumesTransfersV355Test-1350552129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67c9a7c7-1036-41d2-9c32-773e6d189e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:33:58 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b28ee0e6-424d-4c30-82a6-702d3a6e2c8a tempest-VolumesTransfersV355Test-1350552129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67c9a7c7-1036-41d2-9c32-773e6d189e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:33:58 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b28ee0e6-424d-4c30-82a6-702d3a6e2c8a tempest-VolumesTransfersV355Test-1350552129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8d4c74f-517b-4f24-bc31-19d7eac40e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:33:58 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b28ee0e6-424d-4c30-82a6-702d3a6e2c8a tempest-VolumesTransfersV355Test-1350552129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8d4c74f-517b-4f24-bc31-19d7eac40e0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd44d3e16-31a6-4f2e-ab94-e29f2b2e4f45', 'volume_name': 'volume-d44d3e16-31a6-4f2e-ab94-e29f2b2e4f45', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:33:58 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b28ee0e6-424d-4c30-82a6-702d3a6e2c8a tempest-VolumesTransfersV355Test-1350552129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca9e56b9-8bb8-4f72-8ad0-1d49e8c5271f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:33:58 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b28ee0e6-424d-4c30-82a6-702d3a6e2c8a tempest-VolumesTransfersV355Test-1350552129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca9e56b9-8bb8-4f72-8ad0-1d49e8c5271f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:33:58 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b28ee0e6-424d-4c30-82a6-702d3a6e2c8a tempest-VolumesTransfersV355Test-1350552129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7aa7fd7-a952-49cb-acf2-0e5a878c9d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:33:58 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-b28ee0e6-424d-4c30-82a6-702d3a6e2c8a tempest-VolumesTransfersV355Test-1350552129 None] Volume d44d3e16-31a6-4f2e-ab94-e29f2b2e4f45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d44d3e16-31a6-4f2e-ab94-e29f2b2e4f45', 'volume_size': 1} Sep 28 09:33:58 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-b28ee0e6-424d-4c30-82a6-702d3a6e2c8a tempest-VolumesTransfersV355Test-1350552129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:33:58 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-b28ee0e6-424d-4c30-82a6-702d3a6e2c8a tempest-VolumesTransfersV355Test-1350552129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:33:58 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-b28ee0e6-424d-4c30-82a6-702d3a6e2c8a tempest-VolumesTransfersV355Test-1350552129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:33:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-128788051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d44d3e16-31a6-4f2e-ab94-e29f2b2e4f45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae5b2d0a788641089add2e01777bbbed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:33:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:33:58Z,use_quota=True,user_id='7be22bce98c84bed9ddffa7286a1c7ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:33:58 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-b28ee0e6-424d-4c30-82a6-702d3a6e2c8a tempest-VolumesTransfersV355Test-1350552129 None] Creating volume d44d3e16-31a6-4f2e-ab94-e29f2b2e4f45 {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:33:58 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-b28ee0e6-424d-4c30-82a6-702d3a6e2c8a tempest-VolumesTransfersV355Test-1350552129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:33:58 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-b28ee0e6-424d-4c30-82a6-702d3a6e2c8a tempest-VolumesTransfersV355Test-1350552129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:33:58 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-b28ee0e6-424d-4c30-82a6-702d3a6e2c8a tempest-VolumesTransfersV355Test-1350552129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:33:58 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-b28ee0e6-424d-4c30-82a6-702d3a6e2c8a tempest-VolumesTransfersV355Test-1350552129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:33:58 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-b28ee0e6-424d-4c30-82a6-702d3a6e2c8a tempest-VolumesTransfersV355Test-1350552129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:33:58 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-b28ee0e6-424d-4c30-82a6-702d3a6e2c8a tempest-VolumesTransfersV355Test-1350552129 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:33:58 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-b28ee0e6-424d-4c30-82a6-702d3a6e2c8a tempest-VolumesTransfersV355Test-1350552129 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:33:58 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b28ee0e6-424d-4c30-82a6-702d3a6e2c8a tempest-VolumesTransfersV355Test-1350552129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d44d3e16-31a6-4f2e-ab94-e29f2b2e4f45 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:33:58 devstack sudo[100862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d44d3e16-31a6-4f2e-ab94-e29f2b2e4f45 1073741824 Sep 28 09:33:58 devstack sudo[100862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:33:58 devstack sudo[100862]: pam_unix(sudo:session): session closed for user root Sep 28 09:33:58 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b28ee0e6-424d-4c30-82a6-702d3a6e2c8a tempest-VolumesTransfersV355Test-1350552129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d44d3e16-31a6-4f2e-ab94-e29f2b2e4f45 1073741824" returned: 0 in 0.563s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:33:58 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a8ce383-bef6-4f34-9324-863dddab3b1c tempest-VolumesListAdminTestJSON-2142137126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:33:58 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-8a8ce383-bef6-4f34-9324-863dddab3b1c tempest-VolumesListAdminTestJSON-2142137126 None] Flow 'volume_create_manager' (32c08c7c-d7d1-43be-9294-d76db4b59a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:33:58 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-8a8ce383-bef6-4f34-9324-863dddab3b1c tempest-VolumesListAdminTestJSON-2142137126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e8619d0-abde-4f3f-83be-59fde3f3349f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:33:58 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b28ee0e6-424d-4c30-82a6-702d3a6e2c8a tempest-VolumesTransfersV355Test-1350552129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d44d3e16-31a6-4f2e-ab94-e29f2b2e4f45 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:33:58 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-8a8ce383-bef6-4f34-9324-863dddab3b1c tempest-VolumesListAdminTestJSON-2142137126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e8619d0-abde-4f3f-83be-59fde3f3349f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:33:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-727340411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17df17a4-e6fd-496d-8da1-bfbcf1133e93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adccbd2ab5b241d5add7937a5b5043a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:33:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:33:59Z,use_quota=True,user_id='77e6977d754d4d8abe142828f7834ee1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:33:58 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-8a8ce383-bef6-4f34-9324-863dddab3b1c tempest-VolumesListAdminTestJSON-2142137126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c63cfcd-789d-41d5-8276-902c6856e338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:33:58 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-8a8ce383-bef6-4f34-9324-863dddab3b1c tempest-VolumesListAdminTestJSON-2142137126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c63cfcd-789d-41d5-8276-902c6856e338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:33:58 devstack sudo[100873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d44d3e16-31a6-4f2e-ab94-e29f2b2e4f45 Sep 28 09:33:58 devstack sudo[100873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:33:58 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-8a8ce383-bef6-4f34-9324-863dddab3b1c tempest-VolumesListAdminTestJSON-2142137126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a23d27d2-6e53-4225-b233-90dc1e475220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:33:58 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-8a8ce383-bef6-4f34-9324-863dddab3b1c tempest-VolumesListAdminTestJSON-2142137126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a23d27d2-6e53-4225-b233-90dc1e475220) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17df17a4-e6fd-496d-8da1-bfbcf1133e93', 'volume_name': 'volume-17df17a4-e6fd-496d-8da1-bfbcf1133e93', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:33:58 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-8a8ce383-bef6-4f34-9324-863dddab3b1c tempest-VolumesListAdminTestJSON-2142137126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6b72da5-397a-43a4-b501-0cb5d30b87b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:33:58 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-8a8ce383-bef6-4f34-9324-863dddab3b1c tempest-VolumesListAdminTestJSON-2142137126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6b72da5-397a-43a4-b501-0cb5d30b87b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:33:58 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-8a8ce383-bef6-4f34-9324-863dddab3b1c tempest-VolumesListAdminTestJSON-2142137126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bc92217-99a2-406c-adcf-cc7eec102b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:33:58 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-8a8ce383-bef6-4f34-9324-863dddab3b1c tempest-VolumesListAdminTestJSON-2142137126 None] Volume 17df17a4-e6fd-496d-8da1-bfbcf1133e93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17df17a4-e6fd-496d-8da1-bfbcf1133e93', 'volume_size': 1} Sep 28 09:33:58 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-8a8ce383-bef6-4f34-9324-863dddab3b1c tempest-VolumesListAdminTestJSON-2142137126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:33:59 devstack sudo[100873]: pam_unix(sudo:session): session closed for user root Sep 28 09:33:59 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b28ee0e6-424d-4c30-82a6-702d3a6e2c8a tempest-VolumesTransfersV355Test-1350552129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d44d3e16-31a6-4f2e-ab94-e29f2b2e4f45" returned: 0 in 0.342s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:33:59 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-b28ee0e6-424d-4c30-82a6-702d3a6e2c8a tempest-VolumesTransfersV355Test-1350552129 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:33:59 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-b28ee0e6-424d-4c30-82a6-702d3a6e2c8a tempest-VolumesTransfersV355Test-1350552129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:33:59 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-8a8ce383-bef6-4f34-9324-863dddab3b1c tempest-VolumesListAdminTestJSON-2142137126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.275s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:33:59 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-8a8ce383-bef6-4f34-9324-863dddab3b1c tempest-VolumesListAdminTestJSON-2142137126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:33:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-727340411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17df17a4-e6fd-496d-8da1-bfbcf1133e93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adccbd2ab5b241d5add7937a5b5043a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:33:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:33:59Z,use_quota=True,user_id='77e6977d754d4d8abe142828f7834ee1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:33:59 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-8a8ce383-bef6-4f34-9324-863dddab3b1c tempest-VolumesListAdminTestJSON-2142137126 None] Creating volume 17df17a4-e6fd-496d-8da1-bfbcf1133e93 {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:33:59 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-8a8ce383-bef6-4f34-9324-863dddab3b1c tempest-VolumesListAdminTestJSON-2142137126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:33:59 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-8a8ce383-bef6-4f34-9324-863dddab3b1c tempest-VolumesListAdminTestJSON-2142137126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:33:59 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-8a8ce383-bef6-4f34-9324-863dddab3b1c tempest-VolumesListAdminTestJSON-2142137126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:33:59 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-8a8ce383-bef6-4f34-9324-863dddab3b1c tempest-VolumesListAdminTestJSON-2142137126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:33:59 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-8a8ce383-bef6-4f34-9324-863dddab3b1c tempest-VolumesListAdminTestJSON-2142137126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:33:59 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-8a8ce383-bef6-4f34-9324-863dddab3b1c tempest-VolumesListAdminTestJSON-2142137126 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:33:59 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-8a8ce383-bef6-4f34-9324-863dddab3b1c tempest-VolumesListAdminTestJSON-2142137126 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:33:59 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-8a8ce383-bef6-4f34-9324-863dddab3b1c tempest-VolumesListAdminTestJSON-2142137126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-17df17a4-e6fd-496d-8da1-bfbcf1133e93 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:33:59 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b28ee0e6-424d-4c30-82a6-702d3a6e2c8a tempest-VolumesTransfersV355Test-1350552129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7aa7fd7-a952-49cb-acf2-0e5a878c9d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d44d3e16-31a6-4f2e-ab94-e29f2b2e4f45', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:33:59 devstack sudo[100876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-17df17a4-e6fd-496d-8da1-bfbcf1133e93 1073741824 Sep 28 09:33:59 devstack sudo[100876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:33:59 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b28ee0e6-424d-4c30-82a6-702d3a6e2c8a tempest-VolumesTransfersV355Test-1350552129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (291c04c1-0ade-413d-a376-76828b033603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:33:59 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-b28ee0e6-424d-4c30-82a6-702d3a6e2c8a tempest-VolumesTransfersV355Test-1350552129 None] Volume volume-d44d3e16-31a6-4f2e-ab94-e29f2b2e4f45 (d44d3e16-31a6-4f2e-ab94-e29f2b2e4f45): created successfully Sep 28 09:33:59 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b28ee0e6-424d-4c30-82a6-702d3a6e2c8a tempest-VolumesTransfersV355Test-1350552129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (291c04c1-0ade-413d-a376-76828b033603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:33:59 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b28ee0e6-424d-4c30-82a6-702d3a6e2c8a tempest-VolumesTransfersV355Test-1350552129 None] Flow 'volume_create_manager' (fa06e88d-fc47-43bf-9616-e4f333d6cda4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:33:59 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-b28ee0e6-424d-4c30-82a6-702d3a6e2c8a tempest-VolumesTransfersV355Test-1350552129 None] Created volume successfully. Sep 28 09:33:59 devstack sudo[100876]: pam_unix(sudo:session): session closed for user root Sep 28 09:33:59 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-8a8ce383-bef6-4f34-9324-863dddab3b1c tempest-VolumesListAdminTestJSON-2142137126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-17df17a4-e6fd-496d-8da1-bfbcf1133e93 1073741824" returned: 0 in 0.617s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:33:59 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-8a8ce383-bef6-4f34-9324-863dddab3b1c tempest-VolumesListAdminTestJSON-2142137126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-17df17a4-e6fd-496d-8da1-bfbcf1133e93 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:00 devstack sudo[100884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-17df17a4-e6fd-496d-8da1-bfbcf1133e93 Sep 28 09:34:00 devstack sudo[100884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:00 devstack sudo[100884]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:00 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-8a8ce383-bef6-4f34-9324-863dddab3b1c tempest-VolumesListAdminTestJSON-2142137126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-17df17a4-e6fd-496d-8da1-bfbcf1133e93" returned: 0 in 0.436s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:00 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-8a8ce383-bef6-4f34-9324-863dddab3b1c tempest-VolumesListAdminTestJSON-2142137126 None] <== create_volume: return (1135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:34:00 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-8a8ce383-bef6-4f34-9324-863dddab3b1c tempest-VolumesListAdminTestJSON-2142137126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.143s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:34:00 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-8a8ce383-bef6-4f34-9324-863dddab3b1c tempest-VolumesListAdminTestJSON-2142137126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bc92217-99a2-406c-adcf-cc7eec102b41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17df17a4-e6fd-496d-8da1-bfbcf1133e93', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:34:00 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-8a8ce383-bef6-4f34-9324-863dddab3b1c tempest-VolumesListAdminTestJSON-2142137126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4b72b36-51e0-443e-aa29-07b61fce1835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:34:00 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-8a8ce383-bef6-4f34-9324-863dddab3b1c tempest-VolumesListAdminTestJSON-2142137126 None] Volume volume-17df17a4-e6fd-496d-8da1-bfbcf1133e93 (17df17a4-e6fd-496d-8da1-bfbcf1133e93): created successfully Sep 28 09:34:00 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-8a8ce383-bef6-4f34-9324-863dddab3b1c tempest-VolumesListAdminTestJSON-2142137126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4b72b36-51e0-443e-aa29-07b61fce1835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:34:00 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-8a8ce383-bef6-4f34-9324-863dddab3b1c tempest-VolumesListAdminTestJSON-2142137126 None] Flow 'volume_create_manager' (32c08c7c-d7d1-43be-9294-d76db4b59a1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:34:00 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-8a8ce383-bef6-4f34-9324-863dddab3b1c tempest-VolumesListAdminTestJSON-2142137126 None] Created volume successfully. Sep 28 09:34:01 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-6340d521-74ed-4f7a-a6b7-b6782b464328 tempest-VolumesTransfersV355Test-1744757009 None] Transfer volume completed successfully. Sep 28 09:34:01 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cde6aec-1d88-4542-a363-70805c409aaa tempest-VolumesListAdminTestJSON-2142137126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:34:01 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-5cde6aec-1d88-4542-a363-70805c409aaa tempest-VolumesListAdminTestJSON-2142137126 None] Flow 'volume_create_manager' (4a4d9e31-11b0-4369-a7ac-78b9f133ddef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:34:01 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-5cde6aec-1d88-4542-a363-70805c409aaa tempest-VolumesListAdminTestJSON-2142137126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90fbd18b-856b-4e39-9651-cf1079c3cde5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:34:01 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-5cde6aec-1d88-4542-a363-70805c409aaa tempest-VolumesListAdminTestJSON-2142137126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90fbd18b-856b-4e39-9651-cf1079c3cde5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:34:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2132439505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4689266-ed0c-4373-8d2f-39607037b00e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adccbd2ab5b241d5add7937a5b5043a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:34:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:34:02Z,use_quota=True,user_id='77e6977d754d4d8abe142828f7834ee1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:34:01 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-5cde6aec-1d88-4542-a363-70805c409aaa tempest-VolumesListAdminTestJSON-2142137126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (835156c0-227f-4489-927a-41da784e6372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:34:01 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-5cde6aec-1d88-4542-a363-70805c409aaa tempest-VolumesListAdminTestJSON-2142137126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (835156c0-227f-4489-927a-41da784e6372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:34:01 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-5cde6aec-1d88-4542-a363-70805c409aaa tempest-VolumesListAdminTestJSON-2142137126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77e6c270-018d-4c02-9c35-11a2bfcc8b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:34:01 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-5cde6aec-1d88-4542-a363-70805c409aaa tempest-VolumesListAdminTestJSON-2142137126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77e6c270-018d-4c02-9c35-11a2bfcc8b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4689266-ed0c-4373-8d2f-39607037b00e', 'volume_name': 'volume-d4689266-ed0c-4373-8d2f-39607037b00e', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:34:01 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-5cde6aec-1d88-4542-a363-70805c409aaa tempest-VolumesListAdminTestJSON-2142137126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34f1e866-0bb4-479c-a181-958fed1892cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:34:01 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-5cde6aec-1d88-4542-a363-70805c409aaa tempest-VolumesListAdminTestJSON-2142137126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34f1e866-0bb4-479c-a181-958fed1892cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:34:01 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-5cde6aec-1d88-4542-a363-70805c409aaa tempest-VolumesListAdminTestJSON-2142137126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bb26f55-fca3-4cf5-9b9b-e61b85c80ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:34:01 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-5cde6aec-1d88-4542-a363-70805c409aaa tempest-VolumesListAdminTestJSON-2142137126 None] Volume d4689266-ed0c-4373-8d2f-39607037b00e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4689266-ed0c-4373-8d2f-39607037b00e', 'volume_size': 1} Sep 28 09:34:01 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-5cde6aec-1d88-4542-a363-70805c409aaa tempest-VolumesListAdminTestJSON-2142137126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:34:01 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-5cde6aec-1d88-4542-a363-70805c409aaa tempest-VolumesListAdminTestJSON-2142137126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:34:01 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-5cde6aec-1d88-4542-a363-70805c409aaa tempest-VolumesListAdminTestJSON-2142137126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:34:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2132439505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4689266-ed0c-4373-8d2f-39607037b00e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adccbd2ab5b241d5add7937a5b5043a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:34:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:34:02Z,use_quota=True,user_id='77e6977d754d4d8abe142828f7834ee1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:34:01 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-5cde6aec-1d88-4542-a363-70805c409aaa tempest-VolumesListAdminTestJSON-2142137126 None] Creating volume d4689266-ed0c-4373-8d2f-39607037b00e {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:34:01 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-5cde6aec-1d88-4542-a363-70805c409aaa tempest-VolumesListAdminTestJSON-2142137126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:34:01 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-5cde6aec-1d88-4542-a363-70805c409aaa tempest-VolumesListAdminTestJSON-2142137126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:34:01 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-5cde6aec-1d88-4542-a363-70805c409aaa tempest-VolumesListAdminTestJSON-2142137126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:34:01 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-5cde6aec-1d88-4542-a363-70805c409aaa tempest-VolumesListAdminTestJSON-2142137126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:34:01 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-5cde6aec-1d88-4542-a363-70805c409aaa tempest-VolumesListAdminTestJSON-2142137126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:34:01 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-5cde6aec-1d88-4542-a363-70805c409aaa tempest-VolumesListAdminTestJSON-2142137126 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:34:01 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-5cde6aec-1d88-4542-a363-70805c409aaa tempest-VolumesListAdminTestJSON-2142137126 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:34:01 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-5cde6aec-1d88-4542-a363-70805c409aaa tempest-VolumesListAdminTestJSON-2142137126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d4689266-ed0c-4373-8d2f-39607037b00e 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:02 devstack sudo[100891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d4689266-ed0c-4373-8d2f-39607037b00e 1073741824 Sep 28 09:34:02 devstack sudo[100891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:02 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-bf98192c-f7d9-4a37-a0a8-8e66b86e13fd tempest-VolumesTransfersV355Test-1030273810 None] Acquiring lock "cinder-d44d3e16-31a6-4f2e-ab94-e29f2b2e4f45-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:34:02 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-bf98192c-f7d9-4a37-a0a8-8e66b86e13fd tempest-VolumesTransfersV355Test-1030273810 None] Lock "cinder-d44d3e16-31a6-4f2e-ab94-e29f2b2e4f45-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:34:02 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-bf98192c-f7d9-4a37-a0a8-8e66b86e13fd tempest-VolumesTransfersV355Test-1030273810 None] Acquiring lock "cinder-quobyte-d44d3e16-31a6-4f2e-ab94-e29f2b2e4f45" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:34:02 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-bf98192c-f7d9-4a37-a0a8-8e66b86e13fd tempest-VolumesTransfersV355Test-1030273810 None] Lock "cinder-quobyte-d44d3e16-31a6-4f2e-ab94-e29f2b2e4f45" acquired by "delete_volume" :: waited 0.027s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:34:02 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[867b6d92-9fa6-42d6-91c1-bd033cd3480f]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:34:02 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-bf98192c-f7d9-4a37-a0a8-8e66b86e13fd tempest-VolumesTransfersV355Test-1030273810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d44d3e16-31a6-4f2e-ab94-e29f2b2e4f45 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:02 devstack sudo[100891]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:02 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-5cde6aec-1d88-4542-a363-70805c409aaa tempest-VolumesListAdminTestJSON-2142137126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d4689266-ed0c-4373-8d2f-39607037b00e 1073741824" returned: 0 in 0.714s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:02 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-5cde6aec-1d88-4542-a363-70805c409aaa tempest-VolumesListAdminTestJSON-2142137126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d4689266-ed0c-4373-8d2f-39607037b00e {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:02 devstack sudo[100903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d4689266-ed0c-4373-8d2f-39607037b00e Sep 28 09:34:02 devstack sudo[100903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:02 devstack cinder-volume[86553]: INFO cinder.volume.manager [req-984270ec-c250-4549-a042-30edd49bc3b4 req-748c6c25-4586-403a-81a3-454c9977d6a4 tempest-TestMinimumBasicScenario-613097420 None] Terminate volume connection completed successfully. Sep 28 09:34:02 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [req-984270ec-c250-4549-a042-30edd49bc3b4 req-748c6c25-4586-403a-81a3-454c9977d6a4 tempest-TestMinimumBasicScenario-613097420 None] Deleting attachment c513e4ce-f05f-48bc-96f3-a309677e96ba. {{(pid=86553) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 09:34:02 devstack sudo[100901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d44d3e16-31a6-4f2e-ab94-e29f2b2e4f45 Sep 28 09:34:02 devstack sudo[100901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:03 devstack sudo[100903]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:03 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-5cde6aec-1d88-4542-a363-70805c409aaa tempest-VolumesListAdminTestJSON-2142137126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d4689266-ed0c-4373-8d2f-39607037b00e" returned: 0 in 0.336s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:03 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-5cde6aec-1d88-4542-a363-70805c409aaa tempest-VolumesListAdminTestJSON-2142137126 None] <== create_volume: return (1121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:34:03 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-5cde6aec-1d88-4542-a363-70805c409aaa tempest-VolumesListAdminTestJSON-2142137126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.125s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:34:03 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-5cde6aec-1d88-4542-a363-70805c409aaa tempest-VolumesListAdminTestJSON-2142137126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bb26f55-fca3-4cf5-9b9b-e61b85c80ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4689266-ed0c-4373-8d2f-39607037b00e', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:34:03 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-5cde6aec-1d88-4542-a363-70805c409aaa tempest-VolumesListAdminTestJSON-2142137126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28f32954-759c-4daf-ab32-73b2630614c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:34:03 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-5cde6aec-1d88-4542-a363-70805c409aaa tempest-VolumesListAdminTestJSON-2142137126 None] Volume volume-d4689266-ed0c-4373-8d2f-39607037b00e (d4689266-ed0c-4373-8d2f-39607037b00e): created successfully Sep 28 09:34:03 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-5cde6aec-1d88-4542-a363-70805c409aaa tempest-VolumesListAdminTestJSON-2142137126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28f32954-759c-4daf-ab32-73b2630614c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:34:03 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-5cde6aec-1d88-4542-a363-70805c409aaa tempest-VolumesListAdminTestJSON-2142137126 None] Flow 'volume_create_manager' (4a4d9e31-11b0-4369-a7ac-78b9f133ddef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:34:03 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-5cde6aec-1d88-4542-a363-70805c409aaa tempest-VolumesListAdminTestJSON-2142137126 None] Created volume successfully. Sep 28 09:34:03 devstack sudo[100901]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:03 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-bf98192c-f7d9-4a37-a0a8-8e66b86e13fd tempest-VolumesTransfersV355Test-1030273810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d44d3e16-31a6-4f2e-ab94-e29f2b2e4f45" returned: 0 in 0.579s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:03 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-bf98192c-f7d9-4a37-a0a8-8e66b86e13fd tempest-VolumesTransfersV355Test-1030273810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d44d3e16-31a6-4f2e-ab94-e29f2b2e4f45 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:03 devstack sudo[100911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d44d3e16-31a6-4f2e-ab94-e29f2b2e4f45 Sep 28 09:34:03 devstack sudo[100911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:03 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-30860301-436a-4799-849c-67678aaadd40 tempest-TestMinimumBasicScenario-613097420 None] Acquiring lock "cinder-8d743dbb-5bc8-4db3-8eca-b702c6e5b91a-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:34:03 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-30860301-436a-4799-849c-67678aaadd40 tempest-TestMinimumBasicScenario-613097420 None] Lock "cinder-8d743dbb-5bc8-4db3-8eca-b702c6e5b91a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:34:03 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-30860301-436a-4799-849c-67678aaadd40 tempest-TestMinimumBasicScenario-613097420 None] Acquiring lock "cinder-quobyte-8d743dbb-5bc8-4db3-8eca-b702c6e5b91a" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:34:03 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-30860301-436a-4799-849c-67678aaadd40 tempest-TestMinimumBasicScenario-613097420 None] Lock "cinder-quobyte-8d743dbb-5bc8-4db3-8eca-b702c6e5b91a" acquired by "delete_volume" :: waited 0.020s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:34:03 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[e80c3722-a7da-4f90-b8c3-801a3aa46fb7]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:34:03 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-30860301-436a-4799-849c-67678aaadd40 tempest-TestMinimumBasicScenario-613097420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-8d743dbb-5bc8-4db3-8eca-b702c6e5b91a {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:03 devstack sudo[100911]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:03 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-bf98192c-f7d9-4a37-a0a8-8e66b86e13fd tempest-VolumesTransfersV355Test-1030273810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d44d3e16-31a6-4f2e-ab94-e29f2b2e4f45" returned: 0 in 0.319s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:03 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-bf98192c-f7d9-4a37-a0a8-8e66b86e13fd tempest-VolumesTransfersV355Test-1030273810 None] Lock "cinder-quobyte-d44d3e16-31a6-4f2e-ab94-e29f2b2e4f45" released by "delete_volume" :: held 0.971s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:34:03 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-bf98192c-f7d9-4a37-a0a8-8e66b86e13fd tempest-VolumesTransfersV355Test-1030273810 None] Created reservations ['75c569d7-d019-46cd-94f7-db6c01ce18e5', '42343404-c879-4d3d-9223-4a1009c7c223', '55d9e279-f780-400e-a0c4-769dc5153e5c', '3674ef75-f1f5-468c-a1dc-1848c87c9702'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:34:03 devstack sudo[100914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-8d743dbb-5bc8-4db3-8eca-b702c6e5b91a Sep 28 09:34:03 devstack sudo[100914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:03 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-bf98192c-f7d9-4a37-a0a8-8e66b86e13fd tempest-VolumesTransfersV355Test-1030273810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:34:03 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-bf98192c-f7d9-4a37-a0a8-8e66b86e13fd tempest-VolumesTransfersV355Test-1030273810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:34:03 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-bf98192c-f7d9-4a37-a0a8-8e66b86e13fd tempest-VolumesTransfersV355Test-1030273810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:34:03 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-bf98192c-f7d9-4a37-a0a8-8e66b86e13fd tempest-VolumesTransfersV355Test-1030273810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:34:03 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-bf98192c-f7d9-4a37-a0a8-8e66b86e13fd tempest-VolumesTransfersV355Test-1030273810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:34:03 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-bf98192c-f7d9-4a37-a0a8-8e66b86e13fd tempest-VolumesTransfersV355Test-1030273810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:03 devstack sudo[100916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:34:03 devstack sudo[100916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:03 devstack sudo[100914]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:03 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-30860301-436a-4799-849c-67678aaadd40 tempest-TestMinimumBasicScenario-613097420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-8d743dbb-5bc8-4db3-8eca-b702c6e5b91a" returned: 0 in 0.437s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:03 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-30860301-436a-4799-849c-67678aaadd40 tempest-TestMinimumBasicScenario-613097420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-8d743dbb-5bc8-4db3-8eca-b702c6e5b91a {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:03 devstack sudo[100921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-8d743dbb-5bc8-4db3-8eca-b702c6e5b91a Sep 28 09:34:03 devstack sudo[100921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:04 devstack sudo[100916]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:04 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-bf98192c-f7d9-4a37-a0a8-8e66b86e13fd tempest-VolumesTransfersV355Test-1030273810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.309s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:04 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-bf98192c-f7d9-4a37-a0a8-8e66b86e13fd tempest-VolumesTransfersV355Test-1030273810 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:34:04 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-bf98192c-f7d9-4a37-a0a8-8e66b86e13fd tempest-VolumesTransfersV355Test-1030273810 None] Deleted volume successfully. Sep 28 09:34:04 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-bf98192c-f7d9-4a37-a0a8-8e66b86e13fd tempest-VolumesTransfersV355Test-1030273810 None] Lock "cinder-d44d3e16-31a6-4f2e-ab94-e29f2b2e4f45-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:34:04 devstack sudo[100921]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:04 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-30860301-436a-4799-849c-67678aaadd40 tempest-TestMinimumBasicScenario-613097420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-8d743dbb-5bc8-4db3-8eca-b702c6e5b91a" returned: 0 in 0.295s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:04 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-30860301-436a-4799-849c-67678aaadd40 tempest-TestMinimumBasicScenario-613097420 None] Lock "cinder-quobyte-8d743dbb-5bc8-4db3-8eca-b702c6e5b91a" released by "delete_volume" :: held 0.783s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:34:04 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-30860301-436a-4799-849c-67678aaadd40 tempest-TestMinimumBasicScenario-613097420 None] Created reservations ['50f14c79-532b-4a54-88a6-3ddde190a9fc', '21039b30-ef9c-457c-9122-d8f023fbed43', '69a72a8e-6615-47f3-90a8-d71b47042f02', '6dd21ed4-9c5f-453a-b4a5-c95061f49062'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:34:04 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-30860301-436a-4799-849c-67678aaadd40 tempest-TestMinimumBasicScenario-613097420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:34:04 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-30860301-436a-4799-849c-67678aaadd40 tempest-TestMinimumBasicScenario-613097420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:34:04 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-30860301-436a-4799-849c-67678aaadd40 tempest-TestMinimumBasicScenario-613097420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:34:04 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-30860301-436a-4799-849c-67678aaadd40 tempest-TestMinimumBasicScenario-613097420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:34:04 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-30860301-436a-4799-849c-67678aaadd40 tempest-TestMinimumBasicScenario-613097420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:34:04 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-30860301-436a-4799-849c-67678aaadd40 tempest-TestMinimumBasicScenario-613097420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:04 devstack sudo[100925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:34:04 devstack sudo[100925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:04 devstack sudo[100925]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:04 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-30860301-436a-4799-849c-67678aaadd40 tempest-TestMinimumBasicScenario-613097420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.436s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:04 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-30860301-436a-4799-849c-67678aaadd40 tempest-TestMinimumBasicScenario-613097420 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:34:04 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-30860301-436a-4799-849c-67678aaadd40 tempest-TestMinimumBasicScenario-613097420 None] Deleted volume successfully. Sep 28 09:34:04 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-30860301-436a-4799-849c-67678aaadd40 tempest-TestMinimumBasicScenario-613097420 None] Lock "cinder-8d743dbb-5bc8-4db3-8eca-b702c6e5b91a-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:34:05 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-8afbf499-fc1a-4de7-bde0-e20f094f6c95 tempest-VolumesListAdminTestJSON-581762636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:34:05 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-8afbf499-fc1a-4de7-bde0-e20f094f6c95 tempest-VolumesListAdminTestJSON-581762636 None] Flow 'volume_create_manager' (5cd1d6b3-bc90-4238-b557-d36774f8ddc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:34:05 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-8afbf499-fc1a-4de7-bde0-e20f094f6c95 tempest-VolumesListAdminTestJSON-581762636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (435992c4-9b02-4363-8912-1ba1690b8d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:34:05 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-8afbf499-fc1a-4de7-bde0-e20f094f6c95 tempest-VolumesListAdminTestJSON-581762636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (435992c4-9b02-4363-8912-1ba1690b8d19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:34:04Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb0359c6-e516-4767-9e1c-d02064e739bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6641b9f63ede42d88da71c22643a9a04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:34:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:34:05Z,use_quota=True,user_id='555e96d662df48b79f57b2d4ec00e218',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:34:05 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-8afbf499-fc1a-4de7-bde0-e20f094f6c95 tempest-VolumesListAdminTestJSON-581762636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22755678-0fdc-4f54-9477-5225037a6d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:34:05 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-8afbf499-fc1a-4de7-bde0-e20f094f6c95 tempest-VolumesListAdminTestJSON-581762636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22755678-0fdc-4f54-9477-5225037a6d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:34:05 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-8afbf499-fc1a-4de7-bde0-e20f094f6c95 tempest-VolumesListAdminTestJSON-581762636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dc478ad-30ee-4bc4-be91-e3f1f3f48261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:34:05 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-8afbf499-fc1a-4de7-bde0-e20f094f6c95 tempest-VolumesListAdminTestJSON-581762636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dc478ad-30ee-4bc4-be91-e3f1f3f48261) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb0359c6-e516-4767-9e1c-d02064e739bf', 'volume_name': 'volume-eb0359c6-e516-4767-9e1c-d02064e739bf', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:34:05 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-8afbf499-fc1a-4de7-bde0-e20f094f6c95 tempest-VolumesListAdminTestJSON-581762636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ea410f0-7fd5-40b9-8edc-0533f7447861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:34:05 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-8afbf499-fc1a-4de7-bde0-e20f094f6c95 tempest-VolumesListAdminTestJSON-581762636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ea410f0-7fd5-40b9-8edc-0533f7447861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:34:05 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-8afbf499-fc1a-4de7-bde0-e20f094f6c95 tempest-VolumesListAdminTestJSON-581762636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e1bb8a5-4dca-4665-a387-67bf31202925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:34:05 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-8afbf499-fc1a-4de7-bde0-e20f094f6c95 tempest-VolumesListAdminTestJSON-581762636 None] Volume eb0359c6-e516-4767-9e1c-d02064e739bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb0359c6-e516-4767-9e1c-d02064e739bf', 'volume_size': 1} Sep 28 09:34:05 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-8afbf499-fc1a-4de7-bde0-e20f094f6c95 tempest-VolumesListAdminTestJSON-581762636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:34:05 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-8afbf499-fc1a-4de7-bde0-e20f094f6c95 tempest-VolumesListAdminTestJSON-581762636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:34:05 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-8afbf499-fc1a-4de7-bde0-e20f094f6c95 tempest-VolumesListAdminTestJSON-581762636 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:34:04Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb0359c6-e516-4767-9e1c-d02064e739bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6641b9f63ede42d88da71c22643a9a04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:34:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:34:05Z,use_quota=True,user_id='555e96d662df48b79f57b2d4ec00e218',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:34:05 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-8afbf499-fc1a-4de7-bde0-e20f094f6c95 tempest-VolumesListAdminTestJSON-581762636 None] Creating volume eb0359c6-e516-4767-9e1c-d02064e739bf {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:34:05 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-8afbf499-fc1a-4de7-bde0-e20f094f6c95 tempest-VolumesListAdminTestJSON-581762636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:34:05 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-8afbf499-fc1a-4de7-bde0-e20f094f6c95 tempest-VolumesListAdminTestJSON-581762636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:34:05 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-8afbf499-fc1a-4de7-bde0-e20f094f6c95 tempest-VolumesListAdminTestJSON-581762636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:34:05 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-8afbf499-fc1a-4de7-bde0-e20f094f6c95 tempest-VolumesListAdminTestJSON-581762636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:34:05 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-8afbf499-fc1a-4de7-bde0-e20f094f6c95 tempest-VolumesListAdminTestJSON-581762636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:34:05 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-8afbf499-fc1a-4de7-bde0-e20f094f6c95 tempest-VolumesListAdminTestJSON-581762636 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:34:05 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-8afbf499-fc1a-4de7-bde0-e20f094f6c95 tempest-VolumesListAdminTestJSON-581762636 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:34:05 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-8afbf499-fc1a-4de7-bde0-e20f094f6c95 tempest-VolumesListAdminTestJSON-581762636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-eb0359c6-e516-4767-9e1c-d02064e739bf 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:05 devstack sudo[100928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-eb0359c6-e516-4767-9e1c-d02064e739bf 1073741824 Sep 28 09:34:05 devstack sudo[100928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:06 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c0698de-b969-4d40-8932-53330225bf1f tempest-VolumesTransfersV355Test-1350552129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:34:06 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0c0698de-b969-4d40-8932-53330225bf1f tempest-VolumesTransfersV355Test-1350552129 None] Flow 'volume_create_manager' (ea22c1ce-2b9f-4fd5-bba4-6a54e6b6dbd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:34:06 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0c0698de-b969-4d40-8932-53330225bf1f tempest-VolumesTransfersV355Test-1350552129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d97a7cf-477a-4f7c-97fb-d242976a62cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:34:06 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0c0698de-b969-4d40-8932-53330225bf1f tempest-VolumesTransfersV355Test-1350552129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d97a7cf-477a-4f7c-97fb-d242976a62cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:34:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2019017564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8edc21b5-ad52-4584-a0b1-e6bd6facae84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae5b2d0a788641089add2e01777bbbed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:34:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:34:06Z,use_quota=True,user_id='7be22bce98c84bed9ddffa7286a1c7ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:34:06 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0c0698de-b969-4d40-8932-53330225bf1f tempest-VolumesTransfersV355Test-1350552129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3581c94e-6705-4c64-b101-ab08f3130811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:34:06 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0c0698de-b969-4d40-8932-53330225bf1f tempest-VolumesTransfersV355Test-1350552129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3581c94e-6705-4c64-b101-ab08f3130811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:34:06 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0c0698de-b969-4d40-8932-53330225bf1f tempest-VolumesTransfersV355Test-1350552129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c967584-65e8-47bd-a0e3-f57c7c58b0b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:34:06 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0c0698de-b969-4d40-8932-53330225bf1f tempest-VolumesTransfersV355Test-1350552129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c967584-65e8-47bd-a0e3-f57c7c58b0b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8edc21b5-ad52-4584-a0b1-e6bd6facae84', 'volume_name': 'volume-8edc21b5-ad52-4584-a0b1-e6bd6facae84', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:34:06 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0c0698de-b969-4d40-8932-53330225bf1f tempest-VolumesTransfersV355Test-1350552129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b2dd29a-b1d1-489a-913b-69557ab94160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:34:06 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0c0698de-b969-4d40-8932-53330225bf1f tempest-VolumesTransfersV355Test-1350552129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b2dd29a-b1d1-489a-913b-69557ab94160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:34:06 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0c0698de-b969-4d40-8932-53330225bf1f tempest-VolumesTransfersV355Test-1350552129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d6db6fe-dd83-48b2-a868-0104b0898b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:34:06 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-0c0698de-b969-4d40-8932-53330225bf1f tempest-VolumesTransfersV355Test-1350552129 None] Volume 8edc21b5-ad52-4584-a0b1-e6bd6facae84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8edc21b5-ad52-4584-a0b1-e6bd6facae84', 'volume_size': 1} Sep 28 09:34:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-0c0698de-b969-4d40-8932-53330225bf1f tempest-VolumesTransfersV355Test-1350552129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:34:06 devstack sudo[100928]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-8afbf499-fc1a-4de7-bde0-e20f094f6c95 tempest-VolumesListAdminTestJSON-581762636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-eb0359c6-e516-4767-9e1c-d02064e739bf 1073741824" returned: 0 in 1.052s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-8afbf499-fc1a-4de7-bde0-e20f094f6c95 tempest-VolumesListAdminTestJSON-581762636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-eb0359c6-e516-4767-9e1c-d02064e739bf {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:06 devstack sudo[100981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-eb0359c6-e516-4767-9e1c-d02064e739bf Sep 28 09:34:06 devstack sudo[100981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:06 devstack sudo[100981]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-8afbf499-fc1a-4de7-bde0-e20f094f6c95 tempest-VolumesListAdminTestJSON-581762636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-eb0359c6-e516-4767-9e1c-d02064e739bf" returned: 0 in 0.297s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:06 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-8afbf499-fc1a-4de7-bde0-e20f094f6c95 tempest-VolumesListAdminTestJSON-581762636 None] <== create_volume: return (1402ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:34:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-8afbf499-fc1a-4de7-bde0-e20f094f6c95 tempest-VolumesListAdminTestJSON-581762636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.405s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:34:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-0c0698de-b969-4d40-8932-53330225bf1f tempest-VolumesTransfersV355Test-1350552129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.443s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:34:06 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-0c0698de-b969-4d40-8932-53330225bf1f tempest-VolumesTransfersV355Test-1350552129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:34:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2019017564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8edc21b5-ad52-4584-a0b1-e6bd6facae84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae5b2d0a788641089add2e01777bbbed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:34:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:34:06Z,use_quota=True,user_id='7be22bce98c84bed9ddffa7286a1c7ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:34:06 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-0c0698de-b969-4d40-8932-53330225bf1f tempest-VolumesTransfersV355Test-1350552129 None] Creating volume 8edc21b5-ad52-4584-a0b1-e6bd6facae84 {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:34:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-0c0698de-b969-4d40-8932-53330225bf1f tempest-VolumesTransfersV355Test-1350552129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:34:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-0c0698de-b969-4d40-8932-53330225bf1f tempest-VolumesTransfersV355Test-1350552129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:34:06 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-0c0698de-b969-4d40-8932-53330225bf1f tempest-VolumesTransfersV355Test-1350552129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:34:06 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-0c0698de-b969-4d40-8932-53330225bf1f tempest-VolumesTransfersV355Test-1350552129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:34:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-0c0698de-b969-4d40-8932-53330225bf1f tempest-VolumesTransfersV355Test-1350552129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:34:06 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-0c0698de-b969-4d40-8932-53330225bf1f tempest-VolumesTransfersV355Test-1350552129 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:34:06 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-0c0698de-b969-4d40-8932-53330225bf1f tempest-VolumesTransfersV355Test-1350552129 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:34:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0c0698de-b969-4d40-8932-53330225bf1f tempest-VolumesTransfersV355Test-1350552129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-8edc21b5-ad52-4584-a0b1-e6bd6facae84 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:06 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-8afbf499-fc1a-4de7-bde0-e20f094f6c95 tempest-VolumesListAdminTestJSON-581762636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e1bb8a5-4dca-4665-a387-67bf31202925) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb0359c6-e516-4767-9e1c-d02064e739bf', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:34:06 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-8afbf499-fc1a-4de7-bde0-e20f094f6c95 tempest-VolumesListAdminTestJSON-581762636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92d9b206-ad4f-4c0f-98bd-4b789ba3aa7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:34:06 devstack sudo[100985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-8edc21b5-ad52-4584-a0b1-e6bd6facae84 1073741824 Sep 28 09:34:06 devstack sudo[100985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:06 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-8afbf499-fc1a-4de7-bde0-e20f094f6c95 tempest-VolumesListAdminTestJSON-581762636 None] Volume volume-eb0359c6-e516-4767-9e1c-d02064e739bf (eb0359c6-e516-4767-9e1c-d02064e739bf): created successfully Sep 28 09:34:06 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-8afbf499-fc1a-4de7-bde0-e20f094f6c95 tempest-VolumesListAdminTestJSON-581762636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92d9b206-ad4f-4c0f-98bd-4b789ba3aa7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:34:06 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-8afbf499-fc1a-4de7-bde0-e20f094f6c95 tempest-VolumesListAdminTestJSON-581762636 None] Flow 'volume_create_manager' (5cd1d6b3-bc90-4238-b557-d36774f8ddc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:34:06 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-8afbf499-fc1a-4de7-bde0-e20f094f6c95 tempest-VolumesListAdminTestJSON-581762636 None] Created volume successfully. Sep 28 09:34:07 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-b50881b5-a9ea-4196-99f7-577daf525ab4 tempest-VolumesListAdminTestJSON-581762636 None] Acquiring lock "cinder-eb0359c6-e516-4767-9e1c-d02064e739bf-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:34:07 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-b50881b5-a9ea-4196-99f7-577daf525ab4 tempest-VolumesListAdminTestJSON-581762636 None] Lock "cinder-eb0359c6-e516-4767-9e1c-d02064e739bf-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:34:07 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-b50881b5-a9ea-4196-99f7-577daf525ab4 tempest-VolumesListAdminTestJSON-581762636 None] Acquiring lock "cinder-quobyte-eb0359c6-e516-4767-9e1c-d02064e739bf" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:34:07 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-b50881b5-a9ea-4196-99f7-577daf525ab4 tempest-VolumesListAdminTestJSON-581762636 None] Lock "cinder-quobyte-eb0359c6-e516-4767-9e1c-d02064e739bf" acquired by "delete_volume" :: waited 0.019s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:34:07 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e6011b-6472-4d0c-a256-044eab9ed933]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:34:07 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b50881b5-a9ea-4196-99f7-577daf525ab4 tempest-VolumesListAdminTestJSON-581762636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-eb0359c6-e516-4767-9e1c-d02064e739bf {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:07 devstack sudo[100985]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:07 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-bc2ca117-061c-432e-b5c7-be4808df8efc tempest-VolumesListAdminTestJSON-2142137126 None] Acquiring lock "cinder-d4689266-ed0c-4373-8d2f-39607037b00e-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:34:07 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0c0698de-b969-4d40-8932-53330225bf1f tempest-VolumesTransfersV355Test-1350552129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-8edc21b5-ad52-4584-a0b1-e6bd6facae84 1073741824" returned: 0 in 0.686s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:07 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-bc2ca117-061c-432e-b5c7-be4808df8efc tempest-VolumesListAdminTestJSON-2142137126 None] Lock "cinder-d4689266-ed0c-4373-8d2f-39607037b00e-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:34:07 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0c0698de-b969-4d40-8932-53330225bf1f tempest-VolumesTransfersV355Test-1350552129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-8edc21b5-ad52-4584-a0b1-e6bd6facae84 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:07 devstack sudo[100992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-eb0359c6-e516-4767-9e1c-d02064e739bf Sep 28 09:34:07 devstack sudo[100992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:07 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-bc2ca117-061c-432e-b5c7-be4808df8efc tempest-VolumesListAdminTestJSON-2142137126 None] Acquiring lock "cinder-quobyte-d4689266-ed0c-4373-8d2f-39607037b00e" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:34:07 devstack sudo[100993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-8edc21b5-ad52-4584-a0b1-e6bd6facae84 Sep 28 09:34:07 devstack sudo[100993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:07 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-bc2ca117-061c-432e-b5c7-be4808df8efc tempest-VolumesListAdminTestJSON-2142137126 None] Lock "cinder-quobyte-d4689266-ed0c-4373-8d2f-39607037b00e" acquired by "delete_volume" :: waited 0.018s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:34:07 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf3cd89-4fb6-4564-88c0-494e0af6f711]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:34:07 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-bc2ca117-061c-432e-b5c7-be4808df8efc tempest-VolumesListAdminTestJSON-2142137126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d4689266-ed0c-4373-8d2f-39607037b00e {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:07 devstack sudo[100996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d4689266-ed0c-4373-8d2f-39607037b00e Sep 28 09:34:07 devstack sudo[100996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:07 devstack sudo[100993]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:07 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0c0698de-b969-4d40-8932-53330225bf1f tempest-VolumesTransfersV355Test-1350552129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-8edc21b5-ad52-4584-a0b1-e6bd6facae84" returned: 0 in 0.301s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:07 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-0c0698de-b969-4d40-8932-53330225bf1f tempest-VolumesTransfersV355Test-1350552129 None] <== create_volume: return (1079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:34:07 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-0c0698de-b969-4d40-8932-53330225bf1f tempest-VolumesTransfersV355Test-1350552129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:34:07 devstack sudo[100992]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:07 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0c0698de-b969-4d40-8932-53330225bf1f tempest-VolumesTransfersV355Test-1350552129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d6db6fe-dd83-48b2-a868-0104b0898b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8edc21b5-ad52-4584-a0b1-e6bd6facae84', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:34:07 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0c0698de-b969-4d40-8932-53330225bf1f tempest-VolumesTransfersV355Test-1350552129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c413b40-b448-4d4d-bad2-156da334b722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:34:07 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b50881b5-a9ea-4196-99f7-577daf525ab4 tempest-VolumesListAdminTestJSON-581762636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-eb0359c6-e516-4767-9e1c-d02064e739bf" returned: 0 in 0.485s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:07 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b50881b5-a9ea-4196-99f7-577daf525ab4 tempest-VolumesListAdminTestJSON-581762636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-eb0359c6-e516-4767-9e1c-d02064e739bf {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:07 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-0c0698de-b969-4d40-8932-53330225bf1f tempest-VolumesTransfersV355Test-1350552129 None] Volume volume-8edc21b5-ad52-4584-a0b1-e6bd6facae84 (8edc21b5-ad52-4584-a0b1-e6bd6facae84): created successfully Sep 28 09:34:07 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0c0698de-b969-4d40-8932-53330225bf1f tempest-VolumesTransfersV355Test-1350552129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c413b40-b448-4d4d-bad2-156da334b722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:34:07 devstack sudo[101003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-eb0359c6-e516-4767-9e1c-d02064e739bf Sep 28 09:34:07 devstack sudo[101003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:07 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0c0698de-b969-4d40-8932-53330225bf1f tempest-VolumesTransfersV355Test-1350552129 None] Flow 'volume_create_manager' (ea22c1ce-2b9f-4fd5-bba4-6a54e6b6dbd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:34:07 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-0c0698de-b969-4d40-8932-53330225bf1f tempest-VolumesTransfersV355Test-1350552129 None] Created volume successfully. Sep 28 09:34:07 devstack sudo[100996]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:07 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-bc2ca117-061c-432e-b5c7-be4808df8efc tempest-VolumesListAdminTestJSON-2142137126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d4689266-ed0c-4373-8d2f-39607037b00e" returned: 0 in 0.437s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:07 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-bc2ca117-061c-432e-b5c7-be4808df8efc tempest-VolumesListAdminTestJSON-2142137126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d4689266-ed0c-4373-8d2f-39607037b00e {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:07 devstack sudo[101008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d4689266-ed0c-4373-8d2f-39607037b00e Sep 28 09:34:07 devstack sudo[101008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:07 devstack sudo[101003]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:07 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b50881b5-a9ea-4196-99f7-577daf525ab4 tempest-VolumesListAdminTestJSON-581762636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-eb0359c6-e516-4767-9e1c-d02064e739bf" returned: 0 in 0.271s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:07 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-b50881b5-a9ea-4196-99f7-577daf525ab4 tempest-VolumesListAdminTestJSON-581762636 None] Lock "cinder-quobyte-eb0359c6-e516-4767-9e1c-d02064e739bf" released by "delete_volume" :: held 0.818s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:34:08 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-b50881b5-a9ea-4196-99f7-577daf525ab4 tempest-VolumesListAdminTestJSON-581762636 None] Created reservations ['5c777633-96f0-4df4-877a-c9a921c33c70', 'b4ddb7be-2f53-4744-b8dd-36e3efc57fae', '21fa25bb-5dd7-477d-9199-34069f97604a', 'fdcd8698-7d8c-4d61-b32c-d54b72216852'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:34:08 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-b50881b5-a9ea-4196-99f7-577daf525ab4 tempest-VolumesListAdminTestJSON-581762636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:34:08 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-b50881b5-a9ea-4196-99f7-577daf525ab4 tempest-VolumesListAdminTestJSON-581762636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:34:08 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-b50881b5-a9ea-4196-99f7-577daf525ab4 tempest-VolumesListAdminTestJSON-581762636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:34:08 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-b50881b5-a9ea-4196-99f7-577daf525ab4 tempest-VolumesListAdminTestJSON-581762636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:34:08 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-b50881b5-a9ea-4196-99f7-577daf525ab4 tempest-VolumesListAdminTestJSON-581762636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:34:08 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b50881b5-a9ea-4196-99f7-577daf525ab4 tempest-VolumesListAdminTestJSON-581762636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:08 devstack sudo[101011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:34:08 devstack sudo[101011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:08 devstack sudo[101008]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:08 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-bc2ca117-061c-432e-b5c7-be4808df8efc tempest-VolumesListAdminTestJSON-2142137126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d4689266-ed0c-4373-8d2f-39607037b00e" returned: 0 in 0.292s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:08 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-bc2ca117-061c-432e-b5c7-be4808df8efc tempest-VolumesListAdminTestJSON-2142137126 None] Lock "cinder-quobyte-d4689266-ed0c-4373-8d2f-39607037b00e" released by "delete_volume" :: held 0.783s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:34:08 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-bc2ca117-061c-432e-b5c7-be4808df8efc tempest-VolumesListAdminTestJSON-2142137126 None] Created reservations ['358b66c5-efdc-4084-94af-38f3427533a2', '0ba30677-faee-4c16-b965-7d421fa2db99', '40e88259-4163-49de-85c9-7fabf3c5435a', '11086fdc-39ae-47d5-a70e-360b7694e189'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:34:08 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-bc2ca117-061c-432e-b5c7-be4808df8efc tempest-VolumesListAdminTestJSON-2142137126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:34:08 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-bc2ca117-061c-432e-b5c7-be4808df8efc tempest-VolumesListAdminTestJSON-2142137126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:34:08 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-bc2ca117-061c-432e-b5c7-be4808df8efc tempest-VolumesListAdminTestJSON-2142137126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:34:08 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-bc2ca117-061c-432e-b5c7-be4808df8efc tempest-VolumesListAdminTestJSON-2142137126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:34:08 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-bc2ca117-061c-432e-b5c7-be4808df8efc tempest-VolumesListAdminTestJSON-2142137126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:34:08 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-bc2ca117-061c-432e-b5c7-be4808df8efc tempest-VolumesListAdminTestJSON-2142137126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:08 devstack sudo[101014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:34:08 devstack sudo[101014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:08 devstack sudo[101011]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:08 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b50881b5-a9ea-4196-99f7-577daf525ab4 tempest-VolumesListAdminTestJSON-581762636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.286s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:08 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-b50881b5-a9ea-4196-99f7-577daf525ab4 tempest-VolumesListAdminTestJSON-581762636 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:34:08 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-b50881b5-a9ea-4196-99f7-577daf525ab4 tempest-VolumesListAdminTestJSON-581762636 None] Deleted volume successfully. Sep 28 09:34:08 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-b50881b5-a9ea-4196-99f7-577daf525ab4 tempest-VolumesListAdminTestJSON-581762636 None] Lock "cinder-eb0359c6-e516-4767-9e1c-d02064e739bf-delete_volume" released by "delete_volume" :: held 1.342s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:34:08 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-58819430-ea04-46df-aba0-475e1d18c804 tempest-VolumesListAdminTestJSON-2142137126 None] Acquiring lock "cinder-17df17a4-e6fd-496d-8da1-bfbcf1133e93-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:34:08 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-58819430-ea04-46df-aba0-475e1d18c804 tempest-VolumesListAdminTestJSON-2142137126 None] Lock "cinder-17df17a4-e6fd-496d-8da1-bfbcf1133e93-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:34:08 devstack sudo[101014]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:08 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-bc2ca117-061c-432e-b5c7-be4808df8efc tempest-VolumesListAdminTestJSON-2142137126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.299s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:08 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-bc2ca117-061c-432e-b5c7-be4808df8efc tempest-VolumesListAdminTestJSON-2142137126 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:34:08 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-bc2ca117-061c-432e-b5c7-be4808df8efc tempest-VolumesListAdminTestJSON-2142137126 None] Deleted volume successfully. Sep 28 09:34:08 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-58819430-ea04-46df-aba0-475e1d18c804 tempest-VolumesListAdminTestJSON-2142137126 None] Acquiring lock "cinder-quobyte-17df17a4-e6fd-496d-8da1-bfbcf1133e93" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:34:08 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-58819430-ea04-46df-aba0-475e1d18c804 tempest-VolumesListAdminTestJSON-2142137126 None] Lock "cinder-quobyte-17df17a4-e6fd-496d-8da1-bfbcf1133e93" acquired by "delete_volume" :: waited 0.021s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:34:08 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-bc2ca117-061c-432e-b5c7-be4808df8efc tempest-VolumesListAdminTestJSON-2142137126 None] Lock "cinder-d4689266-ed0c-4373-8d2f-39607037b00e-delete_volume" released by "delete_volume" :: held 1.370s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:34:08 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[457436b0-e3d8-44bb-bff4-f31017fcd340]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:34:08 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-58819430-ea04-46df-aba0-475e1d18c804 tempest-VolumesListAdminTestJSON-2142137126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-17df17a4-e6fd-496d-8da1-bfbcf1133e93 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:08 devstack sudo[101018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-17df17a4-e6fd-496d-8da1-bfbcf1133e93 Sep 28 09:34:08 devstack sudo[101018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:09 devstack sudo[101018]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-58819430-ea04-46df-aba0-475e1d18c804 tempest-VolumesListAdminTestJSON-2142137126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-17df17a4-e6fd-496d-8da1-bfbcf1133e93" returned: 0 in 0.444s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-58819430-ea04-46df-aba0-475e1d18c804 tempest-VolumesListAdminTestJSON-2142137126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-17df17a4-e6fd-496d-8da1-bfbcf1133e93 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:09 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-247f5156-b2bf-49fa-a61c-367470912464 tempest-VolumesTransfersV355Test-1030273810 None] Acquiring lock "cinder-8edc21b5-ad52-4584-a0b1-e6bd6facae84-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:34:09 devstack sudo[101023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-17df17a4-e6fd-496d-8da1-bfbcf1133e93 Sep 28 09:34:09 devstack sudo[101023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:09 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-247f5156-b2bf-49fa-a61c-367470912464 tempest-VolumesTransfersV355Test-1030273810 None] Lock "cinder-8edc21b5-ad52-4584-a0b1-e6bd6facae84-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:34:09 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-247f5156-b2bf-49fa-a61c-367470912464 tempest-VolumesTransfersV355Test-1030273810 None] Acquiring lock "cinder-quobyte-8edc21b5-ad52-4584-a0b1-e6bd6facae84" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:34:09 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-247f5156-b2bf-49fa-a61c-367470912464 tempest-VolumesTransfersV355Test-1030273810 None] Lock "cinder-quobyte-8edc21b5-ad52-4584-a0b1-e6bd6facae84" acquired by "delete_volume" :: waited 0.031s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:34:09 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda04e6a-2345-4a44-9fed-c7f80a52dd57]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:34:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-247f5156-b2bf-49fa-a61c-367470912464 tempest-VolumesTransfersV355Test-1030273810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-8edc21b5-ad52-4584-a0b1-e6bd6facae84 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:09 devstack sudo[101025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-8edc21b5-ad52-4584-a0b1-e6bd6facae84 Sep 28 09:34:09 devstack sudo[101025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:09 devstack sudo[101023]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-58819430-ea04-46df-aba0-475e1d18c804 tempest-VolumesListAdminTestJSON-2142137126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-17df17a4-e6fd-496d-8da1-bfbcf1133e93" returned: 0 in 0.290s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:09 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-58819430-ea04-46df-aba0-475e1d18c804 tempest-VolumesListAdminTestJSON-2142137126 None] Lock "cinder-quobyte-17df17a4-e6fd-496d-8da1-bfbcf1133e93" released by "delete_volume" :: held 0.788s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:34:09 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-58819430-ea04-46df-aba0-475e1d18c804 tempest-VolumesListAdminTestJSON-2142137126 None] Created reservations ['c3b91a50-1370-4390-8011-7c448d742545', '5db785f4-3772-4244-a6df-7375ca968b63', '4b5bfd1c-a1dd-4dec-ae6e-24664ef30281', '4dbcfa5e-ff25-47a7-889d-ed346d923026'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:34:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-58819430-ea04-46df-aba0-475e1d18c804 tempest-VolumesListAdminTestJSON-2142137126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:34:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-58819430-ea04-46df-aba0-475e1d18c804 tempest-VolumesListAdminTestJSON-2142137126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:34:09 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-58819430-ea04-46df-aba0-475e1d18c804 tempest-VolumesListAdminTestJSON-2142137126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:34:09 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-58819430-ea04-46df-aba0-475e1d18c804 tempest-VolumesListAdminTestJSON-2142137126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:34:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-58819430-ea04-46df-aba0-475e1d18c804 tempest-VolumesListAdminTestJSON-2142137126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:34:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-58819430-ea04-46df-aba0-475e1d18c804 tempest-VolumesListAdminTestJSON-2142137126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:09 devstack sudo[101028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:34:09 devstack sudo[101028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:09 devstack sudo[101025]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-247f5156-b2bf-49fa-a61c-367470912464 tempest-VolumesTransfersV355Test-1030273810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-8edc21b5-ad52-4584-a0b1-e6bd6facae84" returned: 0 in 0.515s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-247f5156-b2bf-49fa-a61c-367470912464 tempest-VolumesTransfersV355Test-1030273810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-8edc21b5-ad52-4584-a0b1-e6bd6facae84 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:09 devstack sudo[101035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-8edc21b5-ad52-4584-a0b1-e6bd6facae84 Sep 28 09:34:09 devstack sudo[101035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:09 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-08697734-7faf-4079-ab48-bd96b5e9a59a tempest-VolumesListAdminTestJSON-2142137126 None] Acquiring lock "cinder-17b38ba8-1ee8-4133-8f36-0a0d5d627b4b-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:34:09 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-08697734-7faf-4079-ab48-bd96b5e9a59a tempest-VolumesListAdminTestJSON-2142137126 None] Lock "cinder-17b38ba8-1ee8-4133-8f36-0a0d5d627b4b-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:34:09 devstack sudo[101028]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-58819430-ea04-46df-aba0-475e1d18c804 tempest-VolumesListAdminTestJSON-2142137126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.343s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:09 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-58819430-ea04-46df-aba0-475e1d18c804 tempest-VolumesListAdminTestJSON-2142137126 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:34:09 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-58819430-ea04-46df-aba0-475e1d18c804 tempest-VolumesListAdminTestJSON-2142137126 None] Deleted volume successfully. Sep 28 09:34:10 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-58819430-ea04-46df-aba0-475e1d18c804 tempest-VolumesListAdminTestJSON-2142137126 None] Lock "cinder-17df17a4-e6fd-496d-8da1-bfbcf1133e93-delete_volume" released by "delete_volume" :: held 1.401s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:34:10 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-08697734-7faf-4079-ab48-bd96b5e9a59a tempest-VolumesListAdminTestJSON-2142137126 None] Acquiring lock "cinder-quobyte-17b38ba8-1ee8-4133-8f36-0a0d5d627b4b" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:34:10 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-08697734-7faf-4079-ab48-bd96b5e9a59a tempest-VolumesListAdminTestJSON-2142137126 None] Lock "cinder-quobyte-17b38ba8-1ee8-4133-8f36-0a0d5d627b4b" acquired by "delete_volume" :: waited 0.017s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:34:10 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[a96964a5-fe86-4f8e-a6f9-e9c2e95e3d36]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:34:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-08697734-7faf-4079-ab48-bd96b5e9a59a tempest-VolumesListAdminTestJSON-2142137126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-17b38ba8-1ee8-4133-8f36-0a0d5d627b4b {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:10 devstack sudo[101035]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-247f5156-b2bf-49fa-a61c-367470912464 tempest-VolumesTransfersV355Test-1030273810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-8edc21b5-ad52-4584-a0b1-e6bd6facae84" returned: 0 in 0.352s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:10 devstack sudo[101038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-17b38ba8-1ee8-4133-8f36-0a0d5d627b4b Sep 28 09:34:10 devstack sudo[101038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:10 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-247f5156-b2bf-49fa-a61c-367470912464 tempest-VolumesTransfersV355Test-1030273810 None] Lock "cinder-quobyte-8edc21b5-ad52-4584-a0b1-e6bd6facae84" released by "delete_volume" :: held 0.927s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:34:10 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-247f5156-b2bf-49fa-a61c-367470912464 tempest-VolumesTransfersV355Test-1030273810 None] Created reservations ['0a782031-c12d-4b17-b47b-8abb13693a07', '3a60e37d-a31f-447b-8d4f-1faade16628f', 'cab99214-2532-4dab-b15c-4651ce7e4a66', '21da3e23-5b3c-43ff-bdf0-152382c2b7c4'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:34:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-247f5156-b2bf-49fa-a61c-367470912464 tempest-VolumesTransfersV355Test-1030273810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:34:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-247f5156-b2bf-49fa-a61c-367470912464 tempest-VolumesTransfersV355Test-1030273810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:34:10 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-247f5156-b2bf-49fa-a61c-367470912464 tempest-VolumesTransfersV355Test-1030273810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:34:10 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-247f5156-b2bf-49fa-a61c-367470912464 tempest-VolumesTransfersV355Test-1030273810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:34:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-247f5156-b2bf-49fa-a61c-367470912464 tempest-VolumesTransfersV355Test-1030273810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:34:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-247f5156-b2bf-49fa-a61c-367470912464 tempest-VolumesTransfersV355Test-1030273810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:10 devstack sudo[101041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:34:10 devstack sudo[101041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:10 devstack sudo[101038]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-08697734-7faf-4079-ab48-bd96b5e9a59a tempest-VolumesListAdminTestJSON-2142137126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-17b38ba8-1ee8-4133-8f36-0a0d5d627b4b" returned: 0 in 0.459s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-08697734-7faf-4079-ab48-bd96b5e9a59a tempest-VolumesListAdminTestJSON-2142137126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-17b38ba8-1ee8-4133-8f36-0a0d5d627b4b {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:10 devstack sudo[101047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-17b38ba8-1ee8-4133-8f36-0a0d5d627b4b Sep 28 09:34:10 devstack sudo[101047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:10 devstack sudo[101041]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-247f5156-b2bf-49fa-a61c-367470912464 tempest-VolumesTransfersV355Test-1030273810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.334s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:10 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-247f5156-b2bf-49fa-a61c-367470912464 tempest-VolumesTransfersV355Test-1030273810 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:34:10 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-247f5156-b2bf-49fa-a61c-367470912464 tempest-VolumesTransfersV355Test-1030273810 None] Deleted volume successfully. Sep 28 09:34:10 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-247f5156-b2bf-49fa-a61c-367470912464 tempest-VolumesTransfersV355Test-1030273810 None] Lock "cinder-8edc21b5-ad52-4584-a0b1-e6bd6facae84-delete_volume" released by "delete_volume" :: held 1.531s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:34:10 devstack sudo[101047]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-08697734-7faf-4079-ab48-bd96b5e9a59a tempest-VolumesListAdminTestJSON-2142137126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-17b38ba8-1ee8-4133-8f36-0a0d5d627b4b" returned: 0 in 0.323s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:10 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-08697734-7faf-4079-ab48-bd96b5e9a59a tempest-VolumesListAdminTestJSON-2142137126 None] Lock "cinder-quobyte-17b38ba8-1ee8-4133-8f36-0a0d5d627b4b" released by "delete_volume" :: held 0.839s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:34:10 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-08697734-7faf-4079-ab48-bd96b5e9a59a tempest-VolumesListAdminTestJSON-2142137126 None] Created reservations ['1c6feae0-5a91-4df9-95ef-68775923b411', '1677986a-47a0-4d80-a1be-fcedcb0c0ba2', '1e33c978-22f4-444e-8c81-cadefc394b61', 'c3131775-dfc0-45bd-9c16-38edd2c94875'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:34:11 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-08697734-7faf-4079-ab48-bd96b5e9a59a tempest-VolumesListAdminTestJSON-2142137126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:34:11 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-08697734-7faf-4079-ab48-bd96b5e9a59a tempest-VolumesListAdminTestJSON-2142137126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:34:11 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-08697734-7faf-4079-ab48-bd96b5e9a59a tempest-VolumesListAdminTestJSON-2142137126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:34:11 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-08697734-7faf-4079-ab48-bd96b5e9a59a tempest-VolumesListAdminTestJSON-2142137126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:34:11 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-08697734-7faf-4079-ab48-bd96b5e9a59a tempest-VolumesListAdminTestJSON-2142137126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:34:11 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-08697734-7faf-4079-ab48-bd96b5e9a59a tempest-VolumesListAdminTestJSON-2142137126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:11 devstack sudo[101051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:34:11 devstack sudo[101051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:11 devstack sudo[101051]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:11 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-08697734-7faf-4079-ab48-bd96b5e9a59a tempest-VolumesListAdminTestJSON-2142137126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.360s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:11 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-08697734-7faf-4079-ab48-bd96b5e9a59a tempest-VolumesListAdminTestJSON-2142137126 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:34:11 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-08697734-7faf-4079-ab48-bd96b5e9a59a tempest-VolumesListAdminTestJSON-2142137126 None] Deleted volume successfully. Sep 28 09:34:11 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-08697734-7faf-4079-ab48-bd96b5e9a59a tempest-VolumesListAdminTestJSON-2142137126 None] Lock "cinder-17b38ba8-1ee8-4133-8f36-0a0d5d627b4b-delete_volume" released by "delete_volume" :: held 1.492s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:34:17 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-e92bd14a-cd25-47b2-a260-479ac9aa88c8 tempest-TestServerVolumeAttachScenarioOldVersion-1558621255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:34:17 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e92bd14a-cd25-47b2-a260-479ac9aa88c8 tempest-TestServerVolumeAttachScenarioOldVersion-1558621255 None] Flow 'volume_create_manager' (4f6ea9f5-3397-4729-9317-f27bfd9539d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:34:17 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e92bd14a-cd25-47b2-a260-479ac9aa88c8 tempest-TestServerVolumeAttachScenarioOldVersion-1558621255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b14d3d7-3423-4bd6-9584-ae88e8664550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:34:17 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e92bd14a-cd25-47b2-a260-479ac9aa88c8 tempest-TestServerVolumeAttachScenarioOldVersion-1558621255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b14d3d7-3423-4bd6-9584-ae88e8664550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:34:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1895652894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a002439f-bac8-4547-88c8-a444d9e8f040,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='055e009e0e904fed9f098d80270c8620',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:34:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:34:17Z,use_quota=True,user_id='b90294ce37c34e45b5cc7dd3c916786b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:34:17 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e92bd14a-cd25-47b2-a260-479ac9aa88c8 tempest-TestServerVolumeAttachScenarioOldVersion-1558621255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dfca46c-14f1-4ba2-bf14-0942db7429e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:34:17 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e92bd14a-cd25-47b2-a260-479ac9aa88c8 tempest-TestServerVolumeAttachScenarioOldVersion-1558621255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dfca46c-14f1-4ba2-bf14-0942db7429e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:34:17 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e92bd14a-cd25-47b2-a260-479ac9aa88c8 tempest-TestServerVolumeAttachScenarioOldVersion-1558621255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a13f21ac-a2c9-4668-af08-e7de8b9fbfc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:34:17 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e92bd14a-cd25-47b2-a260-479ac9aa88c8 tempest-TestServerVolumeAttachScenarioOldVersion-1558621255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a13f21ac-a2c9-4668-af08-e7de8b9fbfc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a002439f-bac8-4547-88c8-a444d9e8f040', 'volume_name': 'volume-a002439f-bac8-4547-88c8-a444d9e8f040', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:34:17 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e92bd14a-cd25-47b2-a260-479ac9aa88c8 tempest-TestServerVolumeAttachScenarioOldVersion-1558621255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b41521a8-71e1-4ac3-8dfd-7ccf68b865d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:34:17 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e92bd14a-cd25-47b2-a260-479ac9aa88c8 tempest-TestServerVolumeAttachScenarioOldVersion-1558621255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b41521a8-71e1-4ac3-8dfd-7ccf68b865d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:34:17 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e92bd14a-cd25-47b2-a260-479ac9aa88c8 tempest-TestServerVolumeAttachScenarioOldVersion-1558621255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a8720d2-54b6-4fd4-a9b9-eafb704cba49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:34:17 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-e92bd14a-cd25-47b2-a260-479ac9aa88c8 tempest-TestServerVolumeAttachScenarioOldVersion-1558621255 None] Volume a002439f-bac8-4547-88c8-a444d9e8f040: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a002439f-bac8-4547-88c8-a444d9e8f040', 'volume_size': 1} Sep 28 09:34:17 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-e92bd14a-cd25-47b2-a260-479ac9aa88c8 tempest-TestServerVolumeAttachScenarioOldVersion-1558621255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:34:17 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-e92bd14a-cd25-47b2-a260-479ac9aa88c8 tempest-TestServerVolumeAttachScenarioOldVersion-1558621255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:34:17 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-e92bd14a-cd25-47b2-a260-479ac9aa88c8 tempest-TestServerVolumeAttachScenarioOldVersion-1558621255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:34:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1895652894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a002439f-bac8-4547-88c8-a444d9e8f040,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='055e009e0e904fed9f098d80270c8620',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:34:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:34:17Z,use_quota=True,user_id='b90294ce37c34e45b5cc7dd3c916786b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:34:17 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-e92bd14a-cd25-47b2-a260-479ac9aa88c8 tempest-TestServerVolumeAttachScenarioOldVersion-1558621255 None] Creating volume a002439f-bac8-4547-88c8-a444d9e8f040 {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:34:17 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-e92bd14a-cd25-47b2-a260-479ac9aa88c8 tempest-TestServerVolumeAttachScenarioOldVersion-1558621255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:34:17 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-e92bd14a-cd25-47b2-a260-479ac9aa88c8 tempest-TestServerVolumeAttachScenarioOldVersion-1558621255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:34:17 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-e92bd14a-cd25-47b2-a260-479ac9aa88c8 tempest-TestServerVolumeAttachScenarioOldVersion-1558621255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:34:17 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-e92bd14a-cd25-47b2-a260-479ac9aa88c8 tempest-TestServerVolumeAttachScenarioOldVersion-1558621255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:34:17 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-e92bd14a-cd25-47b2-a260-479ac9aa88c8 tempest-TestServerVolumeAttachScenarioOldVersion-1558621255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:34:17 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-e92bd14a-cd25-47b2-a260-479ac9aa88c8 tempest-TestServerVolumeAttachScenarioOldVersion-1558621255 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:34:17 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-e92bd14a-cd25-47b2-a260-479ac9aa88c8 tempest-TestServerVolumeAttachScenarioOldVersion-1558621255 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:34:17 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e92bd14a-cd25-47b2-a260-479ac9aa88c8 tempest-TestServerVolumeAttachScenarioOldVersion-1558621255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a002439f-bac8-4547-88c8-a444d9e8f040 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:17 devstack sudo[101058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a002439f-bac8-4547-88c8-a444d9e8f040 1073741824 Sep 28 09:34:17 devstack sudo[101058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:18 devstack sudo[101058]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:18 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e92bd14a-cd25-47b2-a260-479ac9aa88c8 tempest-TestServerVolumeAttachScenarioOldVersion-1558621255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a002439f-bac8-4547-88c8-a444d9e8f040 1073741824" returned: 0 in 0.599s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:18 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e92bd14a-cd25-47b2-a260-479ac9aa88c8 tempest-TestServerVolumeAttachScenarioOldVersion-1558621255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a002439f-bac8-4547-88c8-a444d9e8f040 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:18 devstack sudo[101065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a002439f-bac8-4547-88c8-a444d9e8f040 Sep 28 09:34:18 devstack sudo[101065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:18 devstack sudo[101065]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:18 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e92bd14a-cd25-47b2-a260-479ac9aa88c8 tempest-TestServerVolumeAttachScenarioOldVersion-1558621255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a002439f-bac8-4547-88c8-a444d9e8f040" returned: 0 in 0.271s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:18 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-e92bd14a-cd25-47b2-a260-479ac9aa88c8 tempest-TestServerVolumeAttachScenarioOldVersion-1558621255 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:34:18 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-e92bd14a-cd25-47b2-a260-479ac9aa88c8 tempest-TestServerVolumeAttachScenarioOldVersion-1558621255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:34:18 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e92bd14a-cd25-47b2-a260-479ac9aa88c8 tempest-TestServerVolumeAttachScenarioOldVersion-1558621255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a8720d2-54b6-4fd4-a9b9-eafb704cba49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a002439f-bac8-4547-88c8-a444d9e8f040', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:34:18 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e92bd14a-cd25-47b2-a260-479ac9aa88c8 tempest-TestServerVolumeAttachScenarioOldVersion-1558621255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85df5fd7-d80d-4c5f-86bd-ca203fa1d602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:34:18 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-e92bd14a-cd25-47b2-a260-479ac9aa88c8 tempest-TestServerVolumeAttachScenarioOldVersion-1558621255 None] Volume volume-a002439f-bac8-4547-88c8-a444d9e8f040 (a002439f-bac8-4547-88c8-a444d9e8f040): created successfully Sep 28 09:34:18 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e92bd14a-cd25-47b2-a260-479ac9aa88c8 tempest-TestServerVolumeAttachScenarioOldVersion-1558621255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85df5fd7-d80d-4c5f-86bd-ca203fa1d602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:34:18 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e92bd14a-cd25-47b2-a260-479ac9aa88c8 tempest-TestServerVolumeAttachScenarioOldVersion-1558621255 None] Flow 'volume_create_manager' (4f6ea9f5-3397-4729-9317-f27bfd9539d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:34:18 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-e92bd14a-cd25-47b2-a260-479ac9aa88c8 tempest-TestServerVolumeAttachScenarioOldVersion-1558621255 None] Created volume successfully. Sep 28 09:34:18 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffc5cfae-f620-4f96-9c8f-f5245ba9a4c6 tempest-SnapshotMetadataTestJSON-526597550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:34:18 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ffc5cfae-f620-4f96-9c8f-f5245ba9a4c6 tempest-SnapshotMetadataTestJSON-526597550 None] Flow 'volume_create_manager' (73e3ec27-41ab-43d3-8ec7-203a2323ba2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:34:18 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ffc5cfae-f620-4f96-9c8f-f5245ba9a4c6 tempest-SnapshotMetadataTestJSON-526597550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9012e155-d580-4412-befa-8bfca1520f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:34:18 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ffc5cfae-f620-4f96-9c8f-f5245ba9a4c6 tempest-SnapshotMetadataTestJSON-526597550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9012e155-d580-4412-befa-8bfca1520f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:34:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-246916386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92bd33d2-9311-4e3f-8b72-a4eb02406bdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c9a390763884c44a40510600e2e7d91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:34:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:34:18Z,use_quota=True,user_id='59f0e97de463413eba445f2763034ea9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:34:18 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ffc5cfae-f620-4f96-9c8f-f5245ba9a4c6 tempest-SnapshotMetadataTestJSON-526597550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8aea9eb9-79b5-45fd-b18f-6153e44202a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:34:18 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ffc5cfae-f620-4f96-9c8f-f5245ba9a4c6 tempest-SnapshotMetadataTestJSON-526597550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8aea9eb9-79b5-45fd-b18f-6153e44202a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:34:18 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ffc5cfae-f620-4f96-9c8f-f5245ba9a4c6 tempest-SnapshotMetadataTestJSON-526597550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffad1c20-f40c-4868-a660-95f48dc48f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:34:18 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ffc5cfae-f620-4f96-9c8f-f5245ba9a4c6 tempest-SnapshotMetadataTestJSON-526597550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffad1c20-f40c-4868-a660-95f48dc48f37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92bd33d2-9311-4e3f-8b72-a4eb02406bdd', 'volume_name': 'volume-92bd33d2-9311-4e3f-8b72-a4eb02406bdd', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:34:18 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ffc5cfae-f620-4f96-9c8f-f5245ba9a4c6 tempest-SnapshotMetadataTestJSON-526597550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22df76fe-5890-49d3-8f11-b962ae2998f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:34:18 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ffc5cfae-f620-4f96-9c8f-f5245ba9a4c6 tempest-SnapshotMetadataTestJSON-526597550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22df76fe-5890-49d3-8f11-b962ae2998f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:34:18 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ffc5cfae-f620-4f96-9c8f-f5245ba9a4c6 tempest-SnapshotMetadataTestJSON-526597550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87f6670b-5f8f-456c-8b11-726021ef047a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:34:18 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-ffc5cfae-f620-4f96-9c8f-f5245ba9a4c6 tempest-SnapshotMetadataTestJSON-526597550 None] Volume 92bd33d2-9311-4e3f-8b72-a4eb02406bdd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92bd33d2-9311-4e3f-8b72-a4eb02406bdd', 'volume_size': 1} Sep 28 09:34:18 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ffc5cfae-f620-4f96-9c8f-f5245ba9a4c6 tempest-SnapshotMetadataTestJSON-526597550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:34:18 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ffc5cfae-f620-4f96-9c8f-f5245ba9a4c6 tempest-SnapshotMetadataTestJSON-526597550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:34:18 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ffc5cfae-f620-4f96-9c8f-f5245ba9a4c6 tempest-SnapshotMetadataTestJSON-526597550 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:34:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-246916386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92bd33d2-9311-4e3f-8b72-a4eb02406bdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c9a390763884c44a40510600e2e7d91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:34:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:34:18Z,use_quota=True,user_id='59f0e97de463413eba445f2763034ea9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:34:18 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-ffc5cfae-f620-4f96-9c8f-f5245ba9a4c6 tempest-SnapshotMetadataTestJSON-526597550 None] Creating volume 92bd33d2-9311-4e3f-8b72-a4eb02406bdd {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:34:18 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ffc5cfae-f620-4f96-9c8f-f5245ba9a4c6 tempest-SnapshotMetadataTestJSON-526597550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:34:18 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ffc5cfae-f620-4f96-9c8f-f5245ba9a4c6 tempest-SnapshotMetadataTestJSON-526597550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:34:18 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ffc5cfae-f620-4f96-9c8f-f5245ba9a4c6 tempest-SnapshotMetadataTestJSON-526597550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:34:18 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ffc5cfae-f620-4f96-9c8f-f5245ba9a4c6 tempest-SnapshotMetadataTestJSON-526597550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:34:18 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ffc5cfae-f620-4f96-9c8f-f5245ba9a4c6 tempest-SnapshotMetadataTestJSON-526597550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:34:18 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ffc5cfae-f620-4f96-9c8f-f5245ba9a4c6 tempest-SnapshotMetadataTestJSON-526597550 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:34:18 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-ffc5cfae-f620-4f96-9c8f-f5245ba9a4c6 tempest-SnapshotMetadataTestJSON-526597550 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:34:18 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ffc5cfae-f620-4f96-9c8f-f5245ba9a4c6 tempest-SnapshotMetadataTestJSON-526597550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-92bd33d2-9311-4e3f-8b72-a4eb02406bdd 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:18 devstack sudo[101068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-92bd33d2-9311-4e3f-8b72-a4eb02406bdd 1073741824 Sep 28 09:34:18 devstack sudo[101068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:19 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a2ecf20-9edb-496d-b979-b282d256ac66 tempest-VolumesCloneNegativeTest-1544883907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:34:19 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0a2ecf20-9edb-496d-b979-b282d256ac66 tempest-VolumesCloneNegativeTest-1544883907 None] Flow 'volume_create_manager' (96e65e99-e861-4a4a-bd7c-1d52fd8d3c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:34:19 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0a2ecf20-9edb-496d-b979-b282d256ac66 tempest-VolumesCloneNegativeTest-1544883907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed421937-1477-4a2e-84ce-3c4b48fc2aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:34:19 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0a2ecf20-9edb-496d-b979-b282d256ac66 tempest-VolumesCloneNegativeTest-1544883907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed421937-1477-4a2e-84ce-3c4b48fc2aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:34:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1984258592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9176b42-1085-4f94-bc49-d76d498014a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d39c0a9525544f67a17efa032fab991a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:34:19Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:34:19Z,use_quota=True,user_id='a2a8bfdb21de4081899e703fde244fef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:34:19 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0a2ecf20-9edb-496d-b979-b282d256ac66 tempest-VolumesCloneNegativeTest-1544883907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3e220d5-152c-4297-a4d5-b17bd2165464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:34:19 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0a2ecf20-9edb-496d-b979-b282d256ac66 tempest-VolumesCloneNegativeTest-1544883907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3e220d5-152c-4297-a4d5-b17bd2165464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:34:19 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0a2ecf20-9edb-496d-b979-b282d256ac66 tempest-VolumesCloneNegativeTest-1544883907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b1942cb-8034-474b-b31d-6bcc44fd18c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:34:19 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0a2ecf20-9edb-496d-b979-b282d256ac66 tempest-VolumesCloneNegativeTest-1544883907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b1942cb-8034-474b-b31d-6bcc44fd18c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9176b42-1085-4f94-bc49-d76d498014a2', 'volume_name': 'volume-f9176b42-1085-4f94-bc49-d76d498014a2', 'volume_size': 2}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:34:19 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0a2ecf20-9edb-496d-b979-b282d256ac66 tempest-VolumesCloneNegativeTest-1544883907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b5a2ecc-9bf8-4448-8b52-81bf0d9b2f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:34:19 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0a2ecf20-9edb-496d-b979-b282d256ac66 tempest-VolumesCloneNegativeTest-1544883907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b5a2ecc-9bf8-4448-8b52-81bf0d9b2f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:34:19 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0a2ecf20-9edb-496d-b979-b282d256ac66 tempest-VolumesCloneNegativeTest-1544883907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86878fbc-e74a-4a57-afd5-e6b8aeca25c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:34:19 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-0a2ecf20-9edb-496d-b979-b282d256ac66 tempest-VolumesCloneNegativeTest-1544883907 None] Volume f9176b42-1085-4f94-bc49-d76d498014a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9176b42-1085-4f94-bc49-d76d498014a2', 'volume_size': 2} Sep 28 09:34:19 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-0a2ecf20-9edb-496d-b979-b282d256ac66 tempest-VolumesCloneNegativeTest-1544883907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:34:19 devstack sudo[101068]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:19 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ffc5cfae-f620-4f96-9c8f-f5245ba9a4c6 tempest-SnapshotMetadataTestJSON-526597550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-92bd33d2-9311-4e3f-8b72-a4eb02406bdd 1073741824" returned: 0 in 0.665s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:19 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ffc5cfae-f620-4f96-9c8f-f5245ba9a4c6 tempest-SnapshotMetadataTestJSON-526597550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-92bd33d2-9311-4e3f-8b72-a4eb02406bdd {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:19 devstack sudo[101076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-92bd33d2-9311-4e3f-8b72-a4eb02406bdd Sep 28 09:34:19 devstack sudo[101076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:19 devstack sudo[101076]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:19 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ffc5cfae-f620-4f96-9c8f-f5245ba9a4c6 tempest-SnapshotMetadataTestJSON-526597550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-92bd33d2-9311-4e3f-8b72-a4eb02406bdd" returned: 0 in 0.319s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:19 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ffc5cfae-f620-4f96-9c8f-f5245ba9a4c6 tempest-SnapshotMetadataTestJSON-526597550 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:34:19 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ffc5cfae-f620-4f96-9c8f-f5245ba9a4c6 tempest-SnapshotMetadataTestJSON-526597550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:34:19 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-0a2ecf20-9edb-496d-b979-b282d256ac66 tempest-VolumesCloneNegativeTest-1544883907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.393s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:34:19 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-0a2ecf20-9edb-496d-b979-b282d256ac66 tempest-VolumesCloneNegativeTest-1544883907 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:34:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1984258592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9176b42-1085-4f94-bc49-d76d498014a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d39c0a9525544f67a17efa032fab991a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:34:19Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:34:19Z,use_quota=True,user_id='a2a8bfdb21de4081899e703fde244fef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:34:19 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-0a2ecf20-9edb-496d-b979-b282d256ac66 tempest-VolumesCloneNegativeTest-1544883907 None] Creating volume f9176b42-1085-4f94-bc49-d76d498014a2 {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:34:19 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-0a2ecf20-9edb-496d-b979-b282d256ac66 tempest-VolumesCloneNegativeTest-1544883907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:34:19 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-0a2ecf20-9edb-496d-b979-b282d256ac66 tempest-VolumesCloneNegativeTest-1544883907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:34:19 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-0a2ecf20-9edb-496d-b979-b282d256ac66 tempest-VolumesCloneNegativeTest-1544883907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:34:19 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-0a2ecf20-9edb-496d-b979-b282d256ac66 tempest-VolumesCloneNegativeTest-1544883907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:34:19 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-0a2ecf20-9edb-496d-b979-b282d256ac66 tempest-VolumesCloneNegativeTest-1544883907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:34:19 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-0a2ecf20-9edb-496d-b979-b282d256ac66 tempest-VolumesCloneNegativeTest-1544883907 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:34:19 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-0a2ecf20-9edb-496d-b979-b282d256ac66 tempest-VolumesCloneNegativeTest-1544883907 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:34:19 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0a2ecf20-9edb-496d-b979-b282d256ac66 tempest-VolumesCloneNegativeTest-1544883907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f9176b42-1085-4f94-bc49-d76d498014a2 2147483648 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:19 devstack sudo[101086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f9176b42-1085-4f94-bc49-d76d498014a2 2147483648 Sep 28 09:34:19 devstack sudo[101086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:19 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ffc5cfae-f620-4f96-9c8f-f5245ba9a4c6 tempest-SnapshotMetadataTestJSON-526597550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87f6670b-5f8f-456c-8b11-726021ef047a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92bd33d2-9311-4e3f-8b72-a4eb02406bdd', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:34:19 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ffc5cfae-f620-4f96-9c8f-f5245ba9a4c6 tempest-SnapshotMetadataTestJSON-526597550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0bd6066-e906-4dd1-bd59-c30e5e360865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:34:19 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-ffc5cfae-f620-4f96-9c8f-f5245ba9a4c6 tempest-SnapshotMetadataTestJSON-526597550 None] Volume volume-92bd33d2-9311-4e3f-8b72-a4eb02406bdd (92bd33d2-9311-4e3f-8b72-a4eb02406bdd): created successfully Sep 28 09:34:19 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ffc5cfae-f620-4f96-9c8f-f5245ba9a4c6 tempest-SnapshotMetadataTestJSON-526597550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0bd6066-e906-4dd1-bd59-c30e5e360865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:34:19 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ffc5cfae-f620-4f96-9c8f-f5245ba9a4c6 tempest-SnapshotMetadataTestJSON-526597550 None] Flow 'volume_create_manager' (73e3ec27-41ab-43d3-8ec7-203a2323ba2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:34:19 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-ffc5cfae-f620-4f96-9c8f-f5245ba9a4c6 tempest-SnapshotMetadataTestJSON-526597550 None] Created volume successfully. Sep 28 09:34:20 devstack sudo[101086]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0a2ecf20-9edb-496d-b979-b282d256ac66 tempest-VolumesCloneNegativeTest-1544883907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f9176b42-1085-4f94-bc49-d76d498014a2 2147483648" returned: 0 in 0.943s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0a2ecf20-9edb-496d-b979-b282d256ac66 tempest-VolumesCloneNegativeTest-1544883907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f9176b42-1085-4f94-bc49-d76d498014a2 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:20 devstack sudo[101131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f9176b42-1085-4f94-bc49-d76d498014a2 Sep 28 09:34:20 devstack sudo[101131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ea8fba5e-18c6-4545-b6f6-2f148b5f87e0 tempest-SnapshotMetadataTestJSON-526597550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:34:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-0498cb21-21ba-4703-8162-a0048847926a req-870bb1c2-d82a-417b-ac0e-7c683a53e707 tempest-TestServerVolumeAttachScenarioOldVersion-1558621255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:34:20 devstack sudo[101131]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0a2ecf20-9edb-496d-b979-b282d256ac66 tempest-VolumesCloneNegativeTest-1544883907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f9176b42-1085-4f94-bc49-d76d498014a2" returned: 0 in 0.400s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:20 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-0a2ecf20-9edb-496d-b979-b282d256ac66 tempest-VolumesCloneNegativeTest-1544883907 None] <== create_volume: return (1401ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:34:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-0a2ecf20-9edb-496d-b979-b282d256ac66 tempest-VolumesCloneNegativeTest-1544883907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.405s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:34:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ea8fba5e-18c6-4545-b6f6-2f148b5f87e0 tempest-SnapshotMetadataTestJSON-526597550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.170s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:34:20 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0a2ecf20-9edb-496d-b979-b282d256ac66 tempest-VolumesCloneNegativeTest-1544883907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86878fbc-e74a-4a57-afd5-e6b8aeca25c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9176b42-1085-4f94-bc49-d76d498014a2', 'volume_size': 2}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:34:20 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0a2ecf20-9edb-496d-b979-b282d256ac66 tempest-VolumesCloneNegativeTest-1544883907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (429aba04-6202-4bfc-b318-47e71138a301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:34:21 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-ea8fba5e-18c6-4545-b6f6-2f148b5f87e0 tempest-SnapshotMetadataTestJSON-526597550 None] Creating offline snapshot 911175aa-2afb-4703-86f9-c580bc8197f5 of volume 92bd33d2-9311-4e3f-8b72-a4eb02406bdd {{(pid=86553) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 09:34:21 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-0a2ecf20-9edb-496d-b979-b282d256ac66 tempest-VolumesCloneNegativeTest-1544883907 None] Volume volume-f9176b42-1085-4f94-bc49-d76d498014a2 (f9176b42-1085-4f94-bc49-d76d498014a2): created successfully Sep 28 09:34:21 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0a2ecf20-9edb-496d-b979-b282d256ac66 tempest-VolumesCloneNegativeTest-1544883907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (429aba04-6202-4bfc-b318-47e71138a301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:34:21 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0a2ecf20-9edb-496d-b979-b282d256ac66 tempest-VolumesCloneNegativeTest-1544883907 None] Flow 'volume_create_manager' (96e65e99-e861-4a4a-bd7c-1d52fd8d3c64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:34:21 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b94a22-85f0-4943-93d1-6847276b9ac6]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:34:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ea8fba5e-18c6-4545-b6f6-2f148b5f87e0 tempest-SnapshotMetadataTestJSON-526597550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-92bd33d2-9311-4e3f-8b72-a4eb02406bdd {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:21 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-0a2ecf20-9edb-496d-b979-b282d256ac66 tempest-VolumesCloneNegativeTest-1544883907 None] Created volume successfully. Sep 28 09:34:21 devstack sudo[101142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-92bd33d2-9311-4e3f-8b72-a4eb02406bdd Sep 28 09:34:21 devstack sudo[101142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:21 devstack sudo[101142]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ea8fba5e-18c6-4545-b6f6-2f148b5f87e0 tempest-SnapshotMetadataTestJSON-526597550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-92bd33d2-9311-4e3f-8b72-a4eb02406bdd" returned: 0 in 0.407s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ea8fba5e-18c6-4545-b6f6-2f148b5f87e0 tempest-SnapshotMetadataTestJSON-526597550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-92bd33d2-9311-4e3f-8b72-a4eb02406bdd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-92bd33d2-9311-4e3f-8b72-a4eb02406bdd.911175aa-2afb-4703-86f9-c580bc8197f5 1G {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:21 devstack sudo[101147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-92bd33d2-9311-4e3f-8b72-a4eb02406bdd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-92bd33d2-9311-4e3f-8b72-a4eb02406bdd.911175aa-2afb-4703-86f9-c580bc8197f5 1G Sep 28 09:34:21 devstack sudo[101147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:21 devstack cinder-volume[86553]: DEBUG oslo_service.periodic_task [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86553) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 09:34:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:34:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:34:21 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:34:21 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:34:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:34:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:21 devstack sudo[101149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:34:21 devstack sudo[101149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:21 devstack sudo[101149]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.310s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:21 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:34:21 devstack cinder-volume[86553]: DEBUG oslo_service.periodic_task [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Running periodic task VolumeManager._thread_info {{(pid=86553) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 09:34:21 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] thread count: 28 {{(pid=86553) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 09:34:21 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] thread info: [<_MainThread(MainThread, started 134684877779072)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86553) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 09:34:21 devstack sudo[101147]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ea8fba5e-18c6-4545-b6f6-2f148b5f87e0 tempest-SnapshotMetadataTestJSON-526597550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-92bd33d2-9311-4e3f-8b72-a4eb02406bdd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-92bd33d2-9311-4e3f-8b72-a4eb02406bdd.911175aa-2afb-4703-86f9-c580bc8197f5 1G" returned: 0 in 0.463s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ea8fba5e-18c6-4545-b6f6-2f148b5f87e0 tempest-SnapshotMetadataTestJSON-526597550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92bd33d2-9311-4e3f-8b72-a4eb02406bdd -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-92bd33d2-9311-4e3f-8b72-a4eb02406bdd.911175aa-2afb-4703-86f9-c580bc8197f5 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:21 devstack sudo[101155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92bd33d2-9311-4e3f-8b72-a4eb02406bdd -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-92bd33d2-9311-4e3f-8b72-a4eb02406bdd.911175aa-2afb-4703-86f9-c580bc8197f5 Sep 28 09:34:21 devstack sudo[101155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:22 devstack sudo[101155]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:22 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ea8fba5e-18c6-4545-b6f6-2f148b5f87e0 tempest-SnapshotMetadataTestJSON-526597550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92bd33d2-9311-4e3f-8b72-a4eb02406bdd -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-92bd33d2-9311-4e3f-8b72-a4eb02406bdd.911175aa-2afb-4703-86f9-c580bc8197f5" returned: 0 in 0.360s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:22 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-ea8fba5e-18c6-4545-b6f6-2f148b5f87e0 tempest-SnapshotMetadataTestJSON-526597550 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-92bd33d2-9311-4e3f-8b72-a4eb02406bdd.911175aa-2afb-4703-86f9-c580bc8197f5 is being set with open permissions: ugo+rw Sep 28 09:34:22 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ea8fba5e-18c6-4545-b6f6-2f148b5f87e0 tempest-SnapshotMetadataTestJSON-526597550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-92bd33d2-9311-4e3f-8b72-a4eb02406bdd.911175aa-2afb-4703-86f9-c580bc8197f5 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:22 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-ff77c4b2-0f88-491e-a6f9-8b8933769d6f tempest-VolumesCloneNegativeTest-1544883907 None] Acquiring lock "cinder-f9176b42-1085-4f94-bc49-d76d498014a2-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:34:22 devstack sudo[101160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-92bd33d2-9311-4e3f-8b72-a4eb02406bdd.911175aa-2afb-4703-86f9-c580bc8197f5 Sep 28 09:34:22 devstack sudo[101160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:22 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-ff77c4b2-0f88-491e-a6f9-8b8933769d6f tempest-VolumesCloneNegativeTest-1544883907 None] Lock "cinder-f9176b42-1085-4f94-bc49-d76d498014a2-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:34:22 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-ff77c4b2-0f88-491e-a6f9-8b8933769d6f tempest-VolumesCloneNegativeTest-1544883907 None] Acquiring lock "cinder-quobyte-f9176b42-1085-4f94-bc49-d76d498014a2" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:34:22 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-ff77c4b2-0f88-491e-a6f9-8b8933769d6f tempest-VolumesCloneNegativeTest-1544883907 None] Lock "cinder-quobyte-f9176b42-1085-4f94-bc49-d76d498014a2" acquired by "delete_volume" :: waited 0.018s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:34:22 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[c00fab10-69a5-463c-b843-a1813b001033]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:34:22 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ff77c4b2-0f88-491e-a6f9-8b8933769d6f tempest-VolumesCloneNegativeTest-1544883907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f9176b42-1085-4f94-bc49-d76d498014a2 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:22 devstack sudo[101162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f9176b42-1085-4f94-bc49-d76d498014a2 Sep 28 09:34:22 devstack sudo[101162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:22 devstack sudo[101160]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:22 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ea8fba5e-18c6-4545-b6f6-2f148b5f87e0 tempest-SnapshotMetadataTestJSON-526597550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-92bd33d2-9311-4e3f-8b72-a4eb02406bdd.911175aa-2afb-4703-86f9-c580bc8197f5" returned: 0 in 0.296s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:22 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ea8fba5e-18c6-4545-b6f6-2f148b5f87e0 tempest-SnapshotMetadataTestJSON-526597550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-92bd33d2-9311-4e3f-8b72-a4eb02406bdd.info {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:22 devstack sudo[101165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-92bd33d2-9311-4e3f-8b72-a4eb02406bdd.info Sep 28 09:34:22 devstack sudo[101165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:22 devstack sudo[101162]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:22 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ff77c4b2-0f88-491e-a6f9-8b8933769d6f tempest-VolumesCloneNegativeTest-1544883907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f9176b42-1085-4f94-bc49-d76d498014a2" returned: 0 in 0.410s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:22 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ff77c4b2-0f88-491e-a6f9-8b8933769d6f tempest-VolumesCloneNegativeTest-1544883907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f9176b42-1085-4f94-bc49-d76d498014a2 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:22 devstack sudo[101170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f9176b42-1085-4f94-bc49-d76d498014a2 Sep 28 09:34:22 devstack sudo[101170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:22 devstack sudo[101165]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:22 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ea8fba5e-18c6-4545-b6f6-2f148b5f87e0 tempest-SnapshotMetadataTestJSON-526597550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-92bd33d2-9311-4e3f-8b72-a4eb02406bdd.info" returned: 0 in 0.325s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:22 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-ea8fba5e-18c6-4545-b6f6-2f148b5f87e0 tempest-SnapshotMetadataTestJSON-526597550 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-92bd33d2-9311-4e3f-8b72-a4eb02406bdd.info is being set with open permissions: ugo+rw Sep 28 09:34:22 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ea8fba5e-18c6-4545-b6f6-2f148b5f87e0 tempest-SnapshotMetadataTestJSON-526597550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-92bd33d2-9311-4e3f-8b72-a4eb02406bdd.info {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:22 devstack sudo[101173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-92bd33d2-9311-4e3f-8b72-a4eb02406bdd.info Sep 28 09:34:22 devstack sudo[101173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:23 devstack sudo[101170]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:23 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ff77c4b2-0f88-491e-a6f9-8b8933769d6f tempest-VolumesCloneNegativeTest-1544883907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f9176b42-1085-4f94-bc49-d76d498014a2" returned: 0 in 0.291s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:23 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-ff77c4b2-0f88-491e-a6f9-8b8933769d6f tempest-VolumesCloneNegativeTest-1544883907 None] Lock "cinder-quobyte-f9176b42-1085-4f94-bc49-d76d498014a2" released by "delete_volume" :: held 0.753s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:34:23 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-ff77c4b2-0f88-491e-a6f9-8b8933769d6f tempest-VolumesCloneNegativeTest-1544883907 None] Created reservations ['a061ceda-ad65-4412-8cca-aa4a0219e404', '415928b5-e90b-4cbc-8e5b-e193809fa2bf', '8035294b-197d-48df-846e-20e9a614a7d6', 'f32bcd96-02fc-4e73-ac43-f4960bb48ed7'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:34:23 devstack sudo[101173]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:23 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ea8fba5e-18c6-4545-b6f6-2f148b5f87e0 tempest-SnapshotMetadataTestJSON-526597550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-92bd33d2-9311-4e3f-8b72-a4eb02406bdd.info" returned: 0 in 0.270s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:23 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ea8fba5e-18c6-4545-b6f6-2f148b5f87e0 tempest-SnapshotMetadataTestJSON-526597550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.249s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:34:23 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-0498cb21-21ba-4703-8162-a0048847926a req-870bb1c2-d82a-417b-ac0e-7c683a53e707 tempest-TestServerVolumeAttachScenarioOldVersion-1558621255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.282s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:34:23 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-0498cb21-21ba-4703-8162-a0048847926a req-870bb1c2-d82a-417b-ac0e-7c683a53e707 tempest-TestServerVolumeAttachScenarioOldVersion-1558621255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.037s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:34:23 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-ea8fba5e-18c6-4545-b6f6-2f148b5f87e0 tempest-SnapshotMetadataTestJSON-526597550 None] Create snapshot completed successfully Sep 28 09:34:23 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [req-0498cb21-21ba-4703-8162-a0048847926a req-870bb1c2-d82a-417b-ac0e-7c683a53e707 tempest-TestServerVolumeAttachScenarioOldVersion-1558621255 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d', 'name': 'volume-a002439f-bac8-4547-88c8-a444d9e8f040', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bd82da10-37e4-42b4-badd-b458974312d7', 'enforce_multipath': True} {{(pid=86553) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 09:34:23 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ff77c4b2-0f88-491e-a6f9-8b8933769d6f tempest-VolumesCloneNegativeTest-1544883907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:34:23 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ff77c4b2-0f88-491e-a6f9-8b8933769d6f tempest-VolumesCloneNegativeTest-1544883907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:34:23 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ff77c4b2-0f88-491e-a6f9-8b8933769d6f tempest-VolumesCloneNegativeTest-1544883907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:34:23 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ff77c4b2-0f88-491e-a6f9-8b8933769d6f tempest-VolumesCloneNegativeTest-1544883907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:34:23 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ff77c4b2-0f88-491e-a6f9-8b8933769d6f tempest-VolumesCloneNegativeTest-1544883907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:34:23 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ff77c4b2-0f88-491e-a6f9-8b8933769d6f tempest-VolumesCloneNegativeTest-1544883907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:23 devstack sudo[101177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:34:23 devstack sudo[101177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:23 devstack cinder-volume[86553]: INFO cinder.volume.manager [req-0498cb21-21ba-4703-8162-a0048847926a req-870bb1c2-d82a-417b-ac0e-7c683a53e707 tempest-TestServerVolumeAttachScenarioOldVersion-1558621255 None] attachment_update completed successfully. Sep 28 09:34:23 devstack sudo[101177]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:23 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ff77c4b2-0f88-491e-a6f9-8b8933769d6f tempest-VolumesCloneNegativeTest-1544883907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.345s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:23 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-ff77c4b2-0f88-491e-a6f9-8b8933769d6f tempest-VolumesCloneNegativeTest-1544883907 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:34:23 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-ff77c4b2-0f88-491e-a6f9-8b8933769d6f tempest-VolumesCloneNegativeTest-1544883907 None] Deleted volume successfully. Sep 28 09:34:23 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-ff77c4b2-0f88-491e-a6f9-8b8933769d6f tempest-VolumesCloneNegativeTest-1544883907 None] Lock "cinder-f9176b42-1085-4f94-bc49-d76d498014a2-delete_volume" released by "delete_volume" :: held 1.401s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:34:25 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-a987889a-5f6d-4b5d-a70a-6e49ff3680ce tempest-SnapshotMetadataTestJSON-526597550 None] Acquiring lock "cinder-911175aa-2afb-4703-86f9-c580bc8197f5-delete_snapshot" by "delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:34:25 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-a987889a-5f6d-4b5d-a70a-6e49ff3680ce tempest-SnapshotMetadataTestJSON-526597550 None] Lock "cinder-911175aa-2afb-4703-86f9-c580bc8197f5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:34:25 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-a987889a-5f6d-4b5d-a70a-6e49ff3680ce tempest-SnapshotMetadataTestJSON-526597550 None] Acquiring lock "cinder-quobyte-92bd33d2-9311-4e3f-8b72-a4eb02406bdd" by "delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:34:25 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-a987889a-5f6d-4b5d-a70a-6e49ff3680ce tempest-SnapshotMetadataTestJSON-526597550 None] Lock "cinder-quobyte-92bd33d2-9311-4e3f-8b72-a4eb02406bdd" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:34:25 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-a987889a-5f6d-4b5d-a70a-6e49ff3680ce tempest-SnapshotMetadataTestJSON-526597550 None] Acquiring lock "cinder-quobyte-911175aa-2afb-4703-86f9-c580bc8197f5" by "_delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:34:25 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-a987889a-5f6d-4b5d-a70a-6e49ff3680ce tempest-SnapshotMetadataTestJSON-526597550 None] Lock "cinder-quobyte-911175aa-2afb-4703-86f9-c580bc8197f5" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:34:25 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-a987889a-5f6d-4b5d-a70a-6e49ff3680ce tempest-SnapshotMetadataTestJSON-526597550 None] Deleting offline snapshot 911175aa-2afb-4703-86f9-c580bc8197f5 of volume 92bd33d2-9311-4e3f-8b72-a4eb02406bdd {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 09:34:25 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-a987889a-5f6d-4b5d-a70a-6e49ff3680ce tempest-SnapshotMetadataTestJSON-526597550 None] snapshot_file for this snap is: volume-92bd33d2-9311-4e3f-8b72-a4eb02406bdd.911175aa-2afb-4703-86f9-c580bc8197f5 {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 09:34:25 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2a3d302-308e-4237-8ec3-f0e26b6fe988]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:34:25 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a987889a-5f6d-4b5d-a70a-6e49ff3680ce tempest-SnapshotMetadataTestJSON-526597550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-92bd33d2-9311-4e3f-8b72-a4eb02406bdd.911175aa-2afb-4703-86f9-c580bc8197f5 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:25 devstack sudo[101595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-92bd33d2-9311-4e3f-8b72-a4eb02406bdd.911175aa-2afb-4703-86f9-c580bc8197f5 Sep 28 09:34:25 devstack sudo[101595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:25 devstack sudo[101595]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:25 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a987889a-5f6d-4b5d-a70a-6e49ff3680ce tempest-SnapshotMetadataTestJSON-526597550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-92bd33d2-9311-4e3f-8b72-a4eb02406bdd.911175aa-2afb-4703-86f9-c580bc8197f5" returned: 0 in 0.459s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:25 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-a987889a-5f6d-4b5d-a70a-6e49ff3680ce tempest-SnapshotMetadataTestJSON-526597550 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92bd33d2-9311-4e3f-8b72-a4eb02406bdd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86553) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 09:34:25 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ef2ac3-d9b6-424d-bb48-ba3e2c2dcd33]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:34:25 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a987889a-5f6d-4b5d-a70a-6e49ff3680ce tempest-SnapshotMetadataTestJSON-526597550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-92bd33d2-9311-4e3f-8b72-a4eb02406bdd {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:26 devstack sudo[101600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-92bd33d2-9311-4e3f-8b72-a4eb02406bdd Sep 28 09:34:26 devstack sudo[101600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:26 devstack sudo[101600]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:26 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a987889a-5f6d-4b5d-a70a-6e49ff3680ce tempest-SnapshotMetadataTestJSON-526597550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-92bd33d2-9311-4e3f-8b72-a4eb02406bdd" returned: 0 in 0.540s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:26 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a987889a-5f6d-4b5d-a70a-6e49ff3680ce tempest-SnapshotMetadataTestJSON-526597550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-92bd33d2-9311-4e3f-8b72-a4eb02406bdd.911175aa-2afb-4703-86f9-c580bc8197f5 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:26 devstack sudo[101605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-92bd33d2-9311-4e3f-8b72-a4eb02406bdd.911175aa-2afb-4703-86f9-c580bc8197f5 Sep 28 09:34:26 devstack sudo[101605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:27 devstack sudo[101605]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:27 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a987889a-5f6d-4b5d-a70a-6e49ff3680ce tempest-SnapshotMetadataTestJSON-526597550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-92bd33d2-9311-4e3f-8b72-a4eb02406bdd.911175aa-2afb-4703-86f9-c580bc8197f5" returned: 0 in 0.544s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:27 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a987889a-5f6d-4b5d-a70a-6e49ff3680ce tempest-SnapshotMetadataTestJSON-526597550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-92bd33d2-9311-4e3f-8b72-a4eb02406bdd.911175aa-2afb-4703-86f9-c580bc8197f5 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:27 devstack sudo[101610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-92bd33d2-9311-4e3f-8b72-a4eb02406bdd.911175aa-2afb-4703-86f9-c580bc8197f5 Sep 28 09:34:27 devstack sudo[101610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:27 devstack sudo[101610]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:27 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a987889a-5f6d-4b5d-a70a-6e49ff3680ce tempest-SnapshotMetadataTestJSON-526597550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-92bd33d2-9311-4e3f-8b72-a4eb02406bdd.911175aa-2afb-4703-86f9-c580bc8197f5" returned: 0 in 0.332s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:27 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-a987889a-5f6d-4b5d-a70a-6e49ff3680ce tempest-SnapshotMetadataTestJSON-526597550 None] Lock "cinder-quobyte-911175aa-2afb-4703-86f9-c580bc8197f5" released by "_delete_snapshot" :: held 2.064s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:34:27 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-a987889a-5f6d-4b5d-a70a-6e49ff3680ce tempest-SnapshotMetadataTestJSON-526597550 None] Lock "cinder-quobyte-92bd33d2-9311-4e3f-8b72-a4eb02406bdd" released by "delete_snapshot" :: held 2.113s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:34:27 devstack cinder-volume[86553]: INFO cinder.volume.manager [req-c9cd7f7f-3d5a-477c-9471-16b81762f24b req-c990f072-4cd8-4f2e-8ed8-9017a15eb939 tempest-TestServerVolumeAttachScenarioOldVersion-1558621255 None] Terminate volume connection completed successfully. Sep 28 09:34:27 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [req-c9cd7f7f-3d5a-477c-9471-16b81762f24b req-c990f072-4cd8-4f2e-8ed8-9017a15eb939 tempest-TestServerVolumeAttachScenarioOldVersion-1558621255 None] Deleting attachment bd82da10-37e4-42b4-badd-b458974312d7. {{(pid=86553) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 09:34:27 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-a987889a-5f6d-4b5d-a70a-6e49ff3680ce tempest-SnapshotMetadataTestJSON-526597550 None] Created reservations ['78718b68-23ae-4e57-b50e-59b89f6d9f4d', '822059a5-ea71-40d3-b94b-3c50d258b5c3', '2a7caa0b-c475-48a9-ae99-08959e3c365f', 'c3bff4ae-7069-4af3-a671-2766007e8d32'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:34:27 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-a987889a-5f6d-4b5d-a70a-6e49ff3680ce tempest-SnapshotMetadataTestJSON-526597550 None] Delete snapshot completed successfully. Sep 28 09:34:27 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-a987889a-5f6d-4b5d-a70a-6e49ff3680ce tempest-SnapshotMetadataTestJSON-526597550 None] Lock "cinder-911175aa-2afb-4703-86f9-c580bc8197f5-delete_snapshot" released by "delete_snapshot" :: held 2.336s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:34:28 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-ea6aec89-0180-489b-aa96-47542dd7d465 tempest-TestServerVolumeAttachScenarioOldVersion-1558621255 None] Acquiring lock "cinder-a002439f-bac8-4547-88c8-a444d9e8f040-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:34:28 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-ea6aec89-0180-489b-aa96-47542dd7d465 tempest-TestServerVolumeAttachScenarioOldVersion-1558621255 None] Lock "cinder-a002439f-bac8-4547-88c8-a444d9e8f040-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:34:28 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-ea6aec89-0180-489b-aa96-47542dd7d465 tempest-TestServerVolumeAttachScenarioOldVersion-1558621255 None] Acquiring lock "cinder-quobyte-a002439f-bac8-4547-88c8-a444d9e8f040" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:34:28 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-ea6aec89-0180-489b-aa96-47542dd7d465 tempest-TestServerVolumeAttachScenarioOldVersion-1558621255 None] Lock "cinder-quobyte-a002439f-bac8-4547-88c8-a444d9e8f040" acquired by "delete_volume" :: waited 0.021s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:34:28 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[87112e69-a9a6-44da-848b-4d430cf72c71]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:34:28 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ea6aec89-0180-489b-aa96-47542dd7d465 tempest-TestServerVolumeAttachScenarioOldVersion-1558621255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a002439f-bac8-4547-88c8-a444d9e8f040 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:28 devstack sudo[101645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a002439f-bac8-4547-88c8-a444d9e8f040 Sep 28 09:34:28 devstack sudo[101645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:28 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-0026c37c-ae7b-43f5-a88e-1a1998ae2a46 tempest-SnapshotMetadataTestJSON-526597550 None] Acquiring lock "cinder-92bd33d2-9311-4e3f-8b72-a4eb02406bdd-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:34:28 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-0026c37c-ae7b-43f5-a88e-1a1998ae2a46 tempest-SnapshotMetadataTestJSON-526597550 None] Lock "cinder-92bd33d2-9311-4e3f-8b72-a4eb02406bdd-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:34:28 devstack sudo[101645]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:28 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-0026c37c-ae7b-43f5-a88e-1a1998ae2a46 tempest-SnapshotMetadataTestJSON-526597550 None] Acquiring lock "cinder-quobyte-92bd33d2-9311-4e3f-8b72-a4eb02406bdd" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:34:28 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ea6aec89-0180-489b-aa96-47542dd7d465 tempest-TestServerVolumeAttachScenarioOldVersion-1558621255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a002439f-bac8-4547-88c8-a444d9e8f040" returned: 0 in 0.532s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:28 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ea6aec89-0180-489b-aa96-47542dd7d465 tempest-TestServerVolumeAttachScenarioOldVersion-1558621255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a002439f-bac8-4547-88c8-a444d9e8f040 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:28 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-0026c37c-ae7b-43f5-a88e-1a1998ae2a46 tempest-SnapshotMetadataTestJSON-526597550 None] Lock "cinder-quobyte-92bd33d2-9311-4e3f-8b72-a4eb02406bdd" acquired by "delete_volume" :: waited 0.037s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:34:28 devstack sudo[101650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a002439f-bac8-4547-88c8-a444d9e8f040 Sep 28 09:34:28 devstack sudo[101650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:28 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[e630a493-8167-4701-acb6-f88b3faf9ea2]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:34:28 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0026c37c-ae7b-43f5-a88e-1a1998ae2a46 tempest-SnapshotMetadataTestJSON-526597550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-92bd33d2-9311-4e3f-8b72-a4eb02406bdd {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:29 devstack sudo[101652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-92bd33d2-9311-4e3f-8b72-a4eb02406bdd Sep 28 09:34:29 devstack sudo[101652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:29 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-0769bb11-9653-4cdd-b3af-9618140dd2c3 tempest-VolumesExtendTest-1714634620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:34:29 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0769bb11-9653-4cdd-b3af-9618140dd2c3 tempest-VolumesExtendTest-1714634620 None] Flow 'volume_create_manager' (b007f541-35ff-43fa-af62-7105252f290d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:34:29 devstack sudo[101650]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:29 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0769bb11-9653-4cdd-b3af-9618140dd2c3 tempest-VolumesExtendTest-1714634620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (994d61f9-94e5-48c9-bd7e-2500c2d99dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:34:29 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ea6aec89-0180-489b-aa96-47542dd7d465 tempest-TestServerVolumeAttachScenarioOldVersion-1558621255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a002439f-bac8-4547-88c8-a444d9e8f040" returned: 0 in 0.326s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:29 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0769bb11-9653-4cdd-b3af-9618140dd2c3 tempest-VolumesExtendTest-1714634620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (994d61f9-94e5-48c9-bd7e-2500c2d99dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:34:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1270606962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bad083e3-a14c-4e09-b642-5886553349b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b112b2ab93842ad8efb6252c195e5c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:34:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:34:29Z,use_quota=True,user_id='1b8c827bf2b34d4095b2e9f0df273b4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:34:29 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0769bb11-9653-4cdd-b3af-9618140dd2c3 tempest-VolumesExtendTest-1714634620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4215d9c6-9aae-44df-a69a-2b4115f7877a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:34:29 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0769bb11-9653-4cdd-b3af-9618140dd2c3 tempest-VolumesExtendTest-1714634620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4215d9c6-9aae-44df-a69a-2b4115f7877a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:34:29 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0769bb11-9653-4cdd-b3af-9618140dd2c3 tempest-VolumesExtendTest-1714634620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e68af92-7b30-4687-9419-221d38edb6e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:34:29 devstack cinder-volume[86553]: DEBUG cinder.image.glance [None req-0769bb11-9653-4cdd-b3af-9618140dd2c3 tempest-VolumesExtendTest-1714634620 None] Creating Keystone auth plugin from conf {{(pid=86553) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 09:34:29 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-ea6aec89-0180-489b-aa96-47542dd7d465 tempest-TestServerVolumeAttachScenarioOldVersion-1558621255 None] Lock "cinder-quobyte-a002439f-bac8-4547-88c8-a444d9e8f040" released by "delete_volume" :: held 0.964s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:34:29 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-ea6aec89-0180-489b-aa96-47542dd7d465 tempest-TestServerVolumeAttachScenarioOldVersion-1558621255 None] Created reservations ['40d5c14f-5ea8-4223-aa10-b847c603b2ae', '2d1519c1-d873-4c77-8aa4-eb1b7597f1b6', '19bfa786-4ae9-43a1-8373-2d5889628cef', '96c2214f-b467-4af1-8f08-7e38c2fc5e0f'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:34:29 devstack sudo[101652]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:29 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0026c37c-ae7b-43f5-a88e-1a1998ae2a46 tempest-SnapshotMetadataTestJSON-526597550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-92bd33d2-9311-4e3f-8b72-a4eb02406bdd" returned: 0 in 0.464s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:29 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0026c37c-ae7b-43f5-a88e-1a1998ae2a46 tempest-SnapshotMetadataTestJSON-526597550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-92bd33d2-9311-4e3f-8b72-a4eb02406bdd {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:29 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ea6aec89-0180-489b-aa96-47542dd7d465 tempest-TestServerVolumeAttachScenarioOldVersion-1558621255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:34:29 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ea6aec89-0180-489b-aa96-47542dd7d465 tempest-TestServerVolumeAttachScenarioOldVersion-1558621255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:34:29 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ea6aec89-0180-489b-aa96-47542dd7d465 tempest-TestServerVolumeAttachScenarioOldVersion-1558621255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:34:29 devstack sudo[101658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-92bd33d2-9311-4e3f-8b72-a4eb02406bdd Sep 28 09:34:29 devstack sudo[101658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:29 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ea6aec89-0180-489b-aa96-47542dd7d465 tempest-TestServerVolumeAttachScenarioOldVersion-1558621255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:34:29 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ea6aec89-0180-489b-aa96-47542dd7d465 tempest-TestServerVolumeAttachScenarioOldVersion-1558621255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:34:29 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ea6aec89-0180-489b-aa96-47542dd7d465 tempest-TestServerVolumeAttachScenarioOldVersion-1558621255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:29 devstack sudo[101660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:34:29 devstack sudo[101660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:29 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0769bb11-9653-4cdd-b3af-9618140dd2c3 tempest-VolumesExtendTest-1714634620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e68af92-7b30-4687-9419-221d38edb6e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bad083e3-a14c-4e09-b642-5886553349b2', 'volume_name': 'volume-bad083e3-a14c-4e09-b642-5886553349b2', 'volume_size': 1, 'image_id': '1a11c21d-88b0-4620-aa82-1ded26f580c9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1a11c21d-88b0-4620-aa82-1ded26f580c9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b800784c68dc485682fd42484c46336e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1a11c21d-88b0-4620-aa82-1ded26f580c9', 'created_at': datetime.datetime(2026, 9, 28, 7, 16, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 7, 16, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a11c21d-88b0-4620-aa82-1ded26f580c9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:34:29 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0769bb11-9653-4cdd-b3af-9618140dd2c3 tempest-VolumesExtendTest-1714634620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e2d7662-c7d5-4348-afee-7a93b72de0f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:34:29 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0769bb11-9653-4cdd-b3af-9618140dd2c3 tempest-VolumesExtendTest-1714634620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e2d7662-c7d5-4348-afee-7a93b72de0f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:34:29 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0769bb11-9653-4cdd-b3af-9618140dd2c3 tempest-VolumesExtendTest-1714634620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96a10aee-1abf-47bd-a596-7364d147465a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:34:29 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-0769bb11-9653-4cdd-b3af-9618140dd2c3 tempest-VolumesExtendTest-1714634620 None] Volume bad083e3-a14c-4e09-b642-5886553349b2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bad083e3-a14c-4e09-b642-5886553349b2', 'volume_size': 1, 'image_id': '1a11c21d-88b0-4620-aa82-1ded26f580c9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1a11c21d-88b0-4620-aa82-1ded26f580c9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b800784c68dc485682fd42484c46336e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1a11c21d-88b0-4620-aa82-1ded26f580c9', 'created_at': datetime.datetime(2026, 9, 28, 7, 16, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 7, 16, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a11c21d-88b0-4620-aa82-1ded26f580c9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 09:34:29 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-0769bb11-9653-4cdd-b3af-9618140dd2c3 tempest-VolumesExtendTest-1714634620 None] Trying to clone bad083e3-a14c-4e09-b642-5886553349b2 from image 1a11c21d-88b0-4620-aa82-1ded26f580c9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1a11c21d-88b0-4620-aa82-1ded26f580c9', 'metadata': {}}]). {{(pid=86553) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 09:34:29 devstack sudo[101658]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:29 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0026c37c-ae7b-43f5-a88e-1a1998ae2a46 tempest-SnapshotMetadataTestJSON-526597550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-92bd33d2-9311-4e3f-8b72-a4eb02406bdd" returned: 0 in 0.360s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:29 devstack sudo[101660]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:29 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ea6aec89-0180-489b-aa96-47542dd7d465 tempest-TestServerVolumeAttachScenarioOldVersion-1558621255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.347s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:29 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-ea6aec89-0180-489b-aa96-47542dd7d465 tempest-TestServerVolumeAttachScenarioOldVersion-1558621255 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:34:29 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-0026c37c-ae7b-43f5-a88e-1a1998ae2a46 tempest-SnapshotMetadataTestJSON-526597550 None] Lock "cinder-quobyte-92bd33d2-9311-4e3f-8b72-a4eb02406bdd" released by "delete_volume" :: held 0.940s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:34:29 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-ea6aec89-0180-489b-aa96-47542dd7d465 tempest-TestServerVolumeAttachScenarioOldVersion-1558621255 None] Deleted volume successfully. Sep 28 09:34:29 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-ea6aec89-0180-489b-aa96-47542dd7d465 tempest-TestServerVolumeAttachScenarioOldVersion-1558621255 None] Lock "cinder-a002439f-bac8-4547-88c8-a444d9e8f040-delete_volume" released by "delete_volume" :: held 1.694s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:34:30 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-0026c37c-ae7b-43f5-a88e-1a1998ae2a46 tempest-SnapshotMetadataTestJSON-526597550 None] Created reservations ['3c3eac49-2a31-4b7c-ae59-f68e82a70f99', '349447f4-5d19-46cf-9054-69229e4c66ca', 'a5e96d35-bc90-4eac-870b-792902a205ea', '2102aec7-e7a1-4442-a4cd-70ead80e83c9'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:34:30 devstack cinder-volume[86553]: DEBUG cinder.image.image_utils [None req-0769bb11-9653-4cdd-b3af-9618140dd2c3 tempest-VolumesExtendTest-1714634620 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1a11c21d-88b0-4620-aa82-1ded26f580c9_kg1io42hdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86553) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 09:34:30 devstack cinder-volume[86553]: INFO cinder.image.image_utils [None req-0769bb11-9653-4cdd-b3af-9618140dd2c3 tempest-VolumesExtendTest-1714634620 None] Image download 20.69 MB at 20.69 MB/s Sep 28 09:34:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-0026c37c-ae7b-43f5-a88e-1a1998ae2a46 tempest-SnapshotMetadataTestJSON-526597550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:34:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-0026c37c-ae7b-43f5-a88e-1a1998ae2a46 tempest-SnapshotMetadataTestJSON-526597550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:34:30 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-0026c37c-ae7b-43f5-a88e-1a1998ae2a46 tempest-SnapshotMetadataTestJSON-526597550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:34:30 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-0026c37c-ae7b-43f5-a88e-1a1998ae2a46 tempest-SnapshotMetadataTestJSON-526597550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:34:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-0026c37c-ae7b-43f5-a88e-1a1998ae2a46 tempest-SnapshotMetadataTestJSON-526597550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:34:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0026c37c-ae7b-43f5-a88e-1a1998ae2a46 tempest-SnapshotMetadataTestJSON-526597550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:30 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[facadb4f-2f77-4f8c-9342-059035931689]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:34:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0769bb11-9653-4cdd-b3af-9618140dd2c3 tempest-VolumesExtendTest-1714634620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1a11c21d-88b0-4620-aa82-1ded26f580c9_kg1io42hdevstack@QuobyteHD {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:30 devstack sudo[101666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:34:30 devstack sudo[101666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:30 devstack sudo[101667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1a11c21d-88b0-4620-aa82-1ded26f580c9_kg1io42hdevstack@QuobyteHD Sep 28 09:34:30 devstack sudo[101667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:30 devstack sudo[101667]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0769bb11-9653-4cdd-b3af-9618140dd2c3 tempest-VolumesExtendTest-1714634620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1a11c21d-88b0-4620-aa82-1ded26f580c9_kg1io42hdevstack@QuobyteHD" returned: 0 in 0.429s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:30 devstack cinder-volume[86553]: DEBUG cinder.image.image_utils [None req-0769bb11-9653-4cdd-b3af-9618140dd2c3 tempest-VolumesExtendTest-1714634620 None] Temporary image 1a11c21d-88b0-4620-aa82-1ded26f580c9 is fetched for user 1b8c827bf2b34d4095b2e9f0df273b4e. {{(pid=86553) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 09:34:30 devstack sudo[101666]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0026c37c-ae7b-43f5-a88e-1a1998ae2a46 tempest-SnapshotMetadataTestJSON-526597550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.491s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:30 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-0026c37c-ae7b-43f5-a88e-1a1998ae2a46 tempest-SnapshotMetadataTestJSON-526597550 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:34:30 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-0026c37c-ae7b-43f5-a88e-1a1998ae2a46 tempest-SnapshotMetadataTestJSON-526597550 None] Deleted volume successfully. Sep 28 09:34:30 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-0026c37c-ae7b-43f5-a88e-1a1998ae2a46 tempest-SnapshotMetadataTestJSON-526597550 None] Lock "cinder-92bd33d2-9311-4e3f-8b72-a4eb02406bdd-delete_volume" released by "delete_volume" :: held 1.952s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:34:30 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c39386-205b-40b4-b9b4-bfb5be581618]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:34:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0769bb11-9653-4cdd-b3af-9618140dd2c3 tempest-VolumesExtendTest-1714634620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1a11c21d-88b0-4620-aa82-1ded26f580c9_kg1io42hdevstack@QuobyteHD {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:30 devstack sudo[101676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1a11c21d-88b0-4620-aa82-1ded26f580c9_kg1io42hdevstack@QuobyteHD Sep 28 09:34:30 devstack sudo[101676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:31 devstack sudo[101676]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:31 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0769bb11-9653-4cdd-b3af-9618140dd2c3 tempest-VolumesExtendTest-1714634620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1a11c21d-88b0-4620-aa82-1ded26f580c9_kg1io42hdevstack@QuobyteHD" returned: 0 in 0.529s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:31 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-0769bb11-9653-4cdd-b3af-9618140dd2c3 tempest-VolumesExtendTest-1714634620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:34:31 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-0769bb11-9653-4cdd-b3af-9618140dd2c3 tempest-VolumesExtendTest-1714634620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:34:31 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-0769bb11-9653-4cdd-b3af-9618140dd2c3 tempest-VolumesExtendTest-1714634620 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:34:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1270606962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bad083e3-a14c-4e09-b642-5886553349b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b112b2ab93842ad8efb6252c195e5c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:34:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:34:29Z,use_quota=True,user_id='1b8c827bf2b34d4095b2e9f0df273b4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:34:31 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-0769bb11-9653-4cdd-b3af-9618140dd2c3 tempest-VolumesExtendTest-1714634620 None] Creating volume bad083e3-a14c-4e09-b642-5886553349b2 {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:34:31 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-0769bb11-9653-4cdd-b3af-9618140dd2c3 tempest-VolumesExtendTest-1714634620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:34:31 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-0769bb11-9653-4cdd-b3af-9618140dd2c3 tempest-VolumesExtendTest-1714634620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:34:31 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-0769bb11-9653-4cdd-b3af-9618140dd2c3 tempest-VolumesExtendTest-1714634620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:34:31 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-0769bb11-9653-4cdd-b3af-9618140dd2c3 tempest-VolumesExtendTest-1714634620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:34:31 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-0769bb11-9653-4cdd-b3af-9618140dd2c3 tempest-VolumesExtendTest-1714634620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:34:31 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-0769bb11-9653-4cdd-b3af-9618140dd2c3 tempest-VolumesExtendTest-1714634620 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:34:31 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-0769bb11-9653-4cdd-b3af-9618140dd2c3 tempest-VolumesExtendTest-1714634620 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:34:31 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0769bb11-9653-4cdd-b3af-9618140dd2c3 tempest-VolumesExtendTest-1714634620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bad083e3-a14c-4e09-b642-5886553349b2 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:31 devstack sudo[101700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bad083e3-a14c-4e09-b642-5886553349b2 1073741824 Sep 28 09:34:31 devstack sudo[101700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:31 devstack sudo[101700]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:31 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0769bb11-9653-4cdd-b3af-9618140dd2c3 tempest-VolumesExtendTest-1714634620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bad083e3-a14c-4e09-b642-5886553349b2 1073741824" returned: 0 in 0.611s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0769bb11-9653-4cdd-b3af-9618140dd2c3 tempest-VolumesExtendTest-1714634620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bad083e3-a14c-4e09-b642-5886553349b2 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:32 devstack sudo[101715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bad083e3-a14c-4e09-b642-5886553349b2 Sep 28 09:34:32 devstack sudo[101715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:32 devstack sudo[101715]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0769bb11-9653-4cdd-b3af-9618140dd2c3 tempest-VolumesExtendTest-1714634620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bad083e3-a14c-4e09-b642-5886553349b2" returned: 0 in 0.353s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:32 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-0769bb11-9653-4cdd-b3af-9618140dd2c3 tempest-VolumesExtendTest-1714634620 None] <== create_volume: return (1059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:34:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-0769bb11-9653-4cdd-b3af-9618140dd2c3 tempest-VolumesExtendTest-1714634620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:34:32 devstack cinder-volume[86553]: DEBUG cinder.volume.volume_utils [None req-0769bb11-9653-4cdd-b3af-9618140dd2c3 tempest-VolumesExtendTest-1714634620 None] Attempting download of 1a11c21d-88b0-4620-aa82-1ded26f580c9 ((None, [{'url': 'file:///opt/stack/data/glance/images/1a11c21d-88b0-4620-aa82-1ded26f580c9', 'metadata': {}}])) to volume bad083e3-a14c-4e09-b642-5886553349b2. {{(pid=86553) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 09:34:32 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f5044f-72dd-475a-b0b9-ea21fe9b9e56]: (4, 'raw') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:34:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0769bb11-9653-4cdd-b3af-9618140dd2c3 tempest-VolumesExtendTest-1714634620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1a11c21d-88b0-4620-aa82-1ded26f580c9_l6i1186_ {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:32 devstack sudo[101719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1a11c21d-88b0-4620-aa82-1ded26f580c9_l6i1186_ Sep 28 09:34:32 devstack sudo[101719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:32 devstack sudo[101719]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0769bb11-9653-4cdd-b3af-9618140dd2c3 tempest-VolumesExtendTest-1714634620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1a11c21d-88b0-4620-aa82-1ded26f580c9_l6i1186_" returned: 0 in 0.463s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0769bb11-9653-4cdd-b3af-9618140dd2c3 tempest-VolumesExtendTest-1714634620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1a11c21d-88b0-4620-aa82-1ded26f580c9_l6i1186_ {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:33 devstack sudo[101724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1a11c21d-88b0-4620-aa82-1ded26f580c9_l6i1186_ Sep 28 09:34:33 devstack sudo[101724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:33 devstack sudo[101724]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:33 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0769bb11-9653-4cdd-b3af-9618140dd2c3 tempest-VolumesExtendTest-1714634620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1a11c21d-88b0-4620-aa82-1ded26f580c9_l6i1186_" returned: 1 in 0.422s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:33 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0769bb11-9653-4cdd-b3af-9618140dd2c3 tempest-VolumesExtendTest-1714634620 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1a11c21d-88b0-4620-aa82-1ded26f580c9_l6i1186_' failed. Not Retrying. {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 09:34:33 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[01eecce1-2432-4135-81c6-6c1b8f69f878]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:34:33 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0769bb11-9653-4cdd-b3af-9618140dd2c3 tempest-VolumesExtendTest-1714634620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1a11c21d-88b0-4620-aa82-1ded26f580c9_kg1io42hdevstack@QuobyteHD {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:33 devstack sudo[101728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1a11c21d-88b0-4620-aa82-1ded26f580c9_kg1io42hdevstack@QuobyteHD Sep 28 09:34:33 devstack sudo[101728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:33 devstack sudo[101728]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:33 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0769bb11-9653-4cdd-b3af-9618140dd2c3 tempest-VolumesExtendTest-1714634620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1a11c21d-88b0-4620-aa82-1ded26f580c9_kg1io42hdevstack@QuobyteHD" returned: 0 in 0.393s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:33 devstack cinder-volume[86553]: DEBUG cinder.image.image_utils [None req-0769bb11-9653-4cdd-b3af-9618140dd2c3 tempest-VolumesExtendTest-1714634620 None] 1a11c21d-88b0-4620-aa82-1ded26f580c9 was qcow2, converting to qcow2 {{(pid=86553) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 09:34:33 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0769bb11-9653-4cdd-b3af-9618140dd2c3 tempest-VolumesExtendTest-1714634620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1a11c21d-88b0-4620-aa82-1ded26f580c9_kg1io42hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bad083e3-a14c-4e09-b642-5886553349b2 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:33 devstack sudo[101733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1a11c21d-88b0-4620-aa82-1ded26f580c9_kg1io42hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bad083e3-a14c-4e09-b642-5886553349b2 Sep 28 09:34:33 devstack sudo[101733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:36 devstack sudo[101733]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:36 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0769bb11-9653-4cdd-b3af-9618140dd2c3 tempest-VolumesExtendTest-1714634620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1a11c21d-88b0-4620-aa82-1ded26f580c9_kg1io42hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bad083e3-a14c-4e09-b642-5886553349b2" returned: 0 in 2.759s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:36 devstack cinder-volume[86553]: DEBUG cinder.image.image_utils [None req-0769bb11-9653-4cdd-b3af-9618140dd2c3 tempest-VolumesExtendTest-1714634620 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1a11c21d-88b0-4620-aa82-1ded26f580c9_kg1io42hdevstack@QuobyteHD, size 112.00 MB, duration 2.76 sec, destination /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bad083e3-a14c-4e09-b642-5886553349b2 {{(pid=86553) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 09:34:36 devstack cinder-volume[86553]: INFO cinder.image.image_utils [None req-0769bb11-9653-4cdd-b3af-9618140dd2c3 tempest-VolumesExtendTest-1714634620 None] Converted 112.00 MB image at 40.57 MB/s Sep 28 09:34:36 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0769bb11-9653-4cdd-b3af-9618140dd2c3 tempest-VolumesExtendTest-1714634620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bad083e3-a14c-4e09-b642-5886553349b2 1G {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:36 devstack sudo[101744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bad083e3-a14c-4e09-b642-5886553349b2 1G Sep 28 09:34:36 devstack sudo[101744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:36 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-947881de-8817-4225-ae48-36749becc57b tempest-VolumesMetadataTest-7012551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:34:37 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-947881de-8817-4225-ae48-36749becc57b tempest-VolumesMetadataTest-7012551 None] Flow 'volume_create_manager' (6b508b9c-3714-4d5c-9276-614327ccc1ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:34:37 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-947881de-8817-4225-ae48-36749becc57b tempest-VolumesMetadataTest-7012551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa02b916-03ae-4594-bb60-321b93fd4786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:34:37 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-947881de-8817-4225-ae48-36749becc57b tempest-VolumesMetadataTest-7012551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa02b916-03ae-4594-bb60-321b93fd4786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:34:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-787542434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23a37241-1747-4369-9615-8e803520a17d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2f58c64ab1e447f9dcfe061d8bf646a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:34:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:34:37Z,use_quota=True,user_id='141d0fc5dfe34452b62cc666f59d03c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:34:37 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-947881de-8817-4225-ae48-36749becc57b tempest-VolumesMetadataTest-7012551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b5a0915-fa3a-4bbc-96e7-5026ccbe8294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:34:37 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-947881de-8817-4225-ae48-36749becc57b tempest-VolumesMetadataTest-7012551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b5a0915-fa3a-4bbc-96e7-5026ccbe8294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:34:37 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-947881de-8817-4225-ae48-36749becc57b tempest-VolumesMetadataTest-7012551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7fb73e9-f69d-488d-a68d-afe350cac475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:34:37 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-947881de-8817-4225-ae48-36749becc57b tempest-VolumesMetadataTest-7012551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7fb73e9-f69d-488d-a68d-afe350cac475) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23a37241-1747-4369-9615-8e803520a17d', 'volume_name': 'volume-23a37241-1747-4369-9615-8e803520a17d', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:34:37 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-947881de-8817-4225-ae48-36749becc57b tempest-VolumesMetadataTest-7012551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86f8980e-3777-4d8c-bdfb-9ef75df6c9cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:34:37 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-947881de-8817-4225-ae48-36749becc57b tempest-VolumesMetadataTest-7012551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86f8980e-3777-4d8c-bdfb-9ef75df6c9cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:34:37 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-947881de-8817-4225-ae48-36749becc57b tempest-VolumesMetadataTest-7012551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5db6e91e-9d4f-484e-a1cd-d141b77dcc22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:34:37 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-947881de-8817-4225-ae48-36749becc57b tempest-VolumesMetadataTest-7012551 None] Volume 23a37241-1747-4369-9615-8e803520a17d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23a37241-1747-4369-9615-8e803520a17d', 'volume_size': 1} Sep 28 09:34:37 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-947881de-8817-4225-ae48-36749becc57b tempest-VolumesMetadataTest-7012551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:34:37 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-947881de-8817-4225-ae48-36749becc57b tempest-VolumesMetadataTest-7012551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:34:37 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-947881de-8817-4225-ae48-36749becc57b tempest-VolumesMetadataTest-7012551 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:34:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-787542434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23a37241-1747-4369-9615-8e803520a17d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2f58c64ab1e447f9dcfe061d8bf646a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:34:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:34:37Z,use_quota=True,user_id='141d0fc5dfe34452b62cc666f59d03c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:34:37 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-947881de-8817-4225-ae48-36749becc57b tempest-VolumesMetadataTest-7012551 None] Creating volume 23a37241-1747-4369-9615-8e803520a17d {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:34:37 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-947881de-8817-4225-ae48-36749becc57b tempest-VolumesMetadataTest-7012551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:34:37 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-947881de-8817-4225-ae48-36749becc57b tempest-VolumesMetadataTest-7012551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:34:37 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-947881de-8817-4225-ae48-36749becc57b tempest-VolumesMetadataTest-7012551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:34:37 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-947881de-8817-4225-ae48-36749becc57b tempest-VolumesMetadataTest-7012551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:34:37 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-947881de-8817-4225-ae48-36749becc57b tempest-VolumesMetadataTest-7012551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:34:37 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-947881de-8817-4225-ae48-36749becc57b tempest-VolumesMetadataTest-7012551 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:34:37 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-947881de-8817-4225-ae48-36749becc57b tempest-VolumesMetadataTest-7012551 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:34:37 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-947881de-8817-4225-ae48-36749becc57b tempest-VolumesMetadataTest-7012551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-23a37241-1747-4369-9615-8e803520a17d 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:37 devstack sudo[101749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-23a37241-1747-4369-9615-8e803520a17d 1073741824 Sep 28 09:34:37 devstack sudo[101749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:37 devstack sudo[101744]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:37 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0769bb11-9653-4cdd-b3af-9618140dd2c3 tempest-VolumesExtendTest-1714634620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bad083e3-a14c-4e09-b642-5886553349b2 1G" returned: 0 in 0.668s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:37 devstack cinder-volume[86553]: DEBUG cinder.volume.volume_utils [None req-0769bb11-9653-4cdd-b3af-9618140dd2c3 tempest-VolumesExtendTest-1714634620 None] Downloaded image 1a11c21d-88b0-4620-aa82-1ded26f580c9 ((None, [{'url': 'file:///opt/stack/data/glance/images/1a11c21d-88b0-4620-aa82-1ded26f580c9', 'metadata': {}}])) to volume bad083e3-a14c-4e09-b642-5886553349b2 successfully. {{(pid=86553) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 09:34:37 devstack cinder-volume[86553]: DEBUG cinder.image.image_utils [None req-0769bb11-9653-4cdd-b3af-9618140dd2c3 tempest-VolumesExtendTest-1714634620 None] Temporary image 1a11c21d-88b0-4620-aa82-1ded26f580c9 for user 1b8c827bf2b34d4095b2e9f0df273b4e is deleted. {{(pid=86553) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 09:34:37 devstack cinder-volume[86553]: DEBUG cinder.volume.volume_utils [None req-0769bb11-9653-4cdd-b3af-9618140dd2c3 tempest-VolumesExtendTest-1714634620 None] Marking volume bad083e3-a14c-4e09-b642-5886553349b2 as bootable. {{(pid=86553) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 09:34:37 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-0769bb11-9653-4cdd-b3af-9618140dd2c3 tempest-VolumesExtendTest-1714634620 None] Copying metadata from image 1a11c21d-88b0-4620-aa82-1ded26f580c9 to bad083e3-a14c-4e09-b642-5886553349b2. {{(pid=86553) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 09:34:37 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-0769bb11-9653-4cdd-b3af-9618140dd2c3 tempest-VolumesExtendTest-1714634620 None] Creating volume glance metadata for volume bad083e3-a14c-4e09-b642-5886553349b2 backed by image 1a11c21d-88b0-4620-aa82-1ded26f580c9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '1a11c21d-88b0-4620-aa82-1ded26f580c9', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86553) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 09:34:37 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0769bb11-9653-4cdd-b3af-9618140dd2c3 tempest-VolumesExtendTest-1714634620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96a10aee-1abf-47bd-a596-7364d147465a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bad083e3-a14c-4e09-b642-5886553349b2', 'volume_size': 1, 'image_id': '1a11c21d-88b0-4620-aa82-1ded26f580c9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1a11c21d-88b0-4620-aa82-1ded26f580c9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b800784c68dc485682fd42484c46336e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1a11c21d-88b0-4620-aa82-1ded26f580c9', 'created_at': datetime.datetime(2026, 9, 28, 7, 16, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 7, 16, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a11c21d-88b0-4620-aa82-1ded26f580c9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:34:37 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0769bb11-9653-4cdd-b3af-9618140dd2c3 tempest-VolumesExtendTest-1714634620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (381c3550-205c-4550-8212-63af8c0b8bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:34:37 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-0769bb11-9653-4cdd-b3af-9618140dd2c3 tempest-VolumesExtendTest-1714634620 None] Volume volume-bad083e3-a14c-4e09-b642-5886553349b2 (bad083e3-a14c-4e09-b642-5886553349b2): created successfully Sep 28 09:34:37 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0769bb11-9653-4cdd-b3af-9618140dd2c3 tempest-VolumesExtendTest-1714634620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (381c3550-205c-4550-8212-63af8c0b8bbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:34:37 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0769bb11-9653-4cdd-b3af-9618140dd2c3 tempest-VolumesExtendTest-1714634620 None] Flow 'volume_create_manager' (b007f541-35ff-43fa-af62-7105252f290d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:34:37 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-0769bb11-9653-4cdd-b3af-9618140dd2c3 tempest-VolumesExtendTest-1714634620 None] Created volume successfully. Sep 28 09:34:37 devstack sudo[101749]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:37 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-947881de-8817-4225-ae48-36749becc57b tempest-VolumesMetadataTest-7012551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-23a37241-1747-4369-9615-8e803520a17d 1073741824" returned: 0 in 0.666s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:37 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-947881de-8817-4225-ae48-36749becc57b tempest-VolumesMetadataTest-7012551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-23a37241-1747-4369-9615-8e803520a17d {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:37 devstack sudo[101756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-23a37241-1747-4369-9615-8e803520a17d Sep 28 09:34:37 devstack sudo[101756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:38 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-b6b2ed06-0538-44b6-ade9-93431413467f tempest-VolumesExtendTest-1714634620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:34:38 devstack sudo[101756]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:38 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-947881de-8817-4225-ae48-36749becc57b tempest-VolumesMetadataTest-7012551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-23a37241-1747-4369-9615-8e803520a17d" returned: 0 in 0.362s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:38 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-947881de-8817-4225-ae48-36749becc57b tempest-VolumesMetadataTest-7012551 None] <== create_volume: return (1108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:34:38 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-947881de-8817-4225-ae48-36749becc57b tempest-VolumesMetadataTest-7012551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.110s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:34:38 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-b6b2ed06-0538-44b6-ade9-93431413467f tempest-VolumesExtendTest-1714634620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.093s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:34:38 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-947881de-8817-4225-ae48-36749becc57b tempest-VolumesMetadataTest-7012551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5db6e91e-9d4f-484e-a1cd-d141b77dcc22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23a37241-1747-4369-9615-8e803520a17d', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:34:38 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-947881de-8817-4225-ae48-36749becc57b tempest-VolumesMetadataTest-7012551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ed10ee3-3384-477b-9aaa-beb16327a9b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:34:38 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[e86b2711-d1c3-454a-91ce-082cb3e70181]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:34:38 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b6b2ed06-0538-44b6-ade9-93431413467f tempest-VolumesExtendTest-1714634620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bad083e3-a14c-4e09-b642-5886553349b2 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:38 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-947881de-8817-4225-ae48-36749becc57b tempest-VolumesMetadataTest-7012551 None] Volume volume-23a37241-1747-4369-9615-8e803520a17d (23a37241-1747-4369-9615-8e803520a17d): created successfully Sep 28 09:34:38 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-947881de-8817-4225-ae48-36749becc57b tempest-VolumesMetadataTest-7012551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ed10ee3-3384-477b-9aaa-beb16327a9b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:34:38 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-947881de-8817-4225-ae48-36749becc57b tempest-VolumesMetadataTest-7012551 None] Flow 'volume_create_manager' (6b508b9c-3714-4d5c-9276-614327ccc1ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:34:38 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-947881de-8817-4225-ae48-36749becc57b tempest-VolumesMetadataTest-7012551 None] Created volume successfully. Sep 28 09:34:38 devstack sudo[101759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bad083e3-a14c-4e09-b642-5886553349b2 Sep 28 09:34:38 devstack sudo[101759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:38 devstack sudo[101759]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:38 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b6b2ed06-0538-44b6-ade9-93431413467f tempest-VolumesExtendTest-1714634620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bad083e3-a14c-4e09-b642-5886553349b2" returned: 0 in 0.452s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:38 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b6b2ed06-0538-44b6-ade9-93431413467f tempest-VolumesExtendTest-1714634620 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bad083e3-a14c-4e09-b642-5886553349b2 2G {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:38 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b6b2ed06-0538-44b6-ade9-93431413467f tempest-VolumesExtendTest-1714634620 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bad083e3-a14c-4e09-b642-5886553349b2 2G" returned: 0 in 0.174s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:38 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-b6b2ed06-0538-44b6-ade9-93431413467f tempest-VolumesExtendTest-1714634620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.655s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:34:38 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-b6b2ed06-0538-44b6-ade9-93431413467f tempest-VolumesExtendTest-1714634620 None] Extend volume completed successfully. Sep 28 09:34:39 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-c7149c32-c797-4c77-af60-56e25003d026 tempest-VolumesExtendTest-1714634620 None] Acquiring lock "cinder-bad083e3-a14c-4e09-b642-5886553349b2-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:34:39 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-c7149c32-c797-4c77-af60-56e25003d026 tempest-VolumesExtendTest-1714634620 None] Lock "cinder-bad083e3-a14c-4e09-b642-5886553349b2-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:34:39 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-c7149c32-c797-4c77-af60-56e25003d026 tempest-VolumesExtendTest-1714634620 None] Acquiring lock "cinder-quobyte-bad083e3-a14c-4e09-b642-5886553349b2" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:34:39 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-c7149c32-c797-4c77-af60-56e25003d026 tempest-VolumesExtendTest-1714634620 None] Lock "cinder-quobyte-bad083e3-a14c-4e09-b642-5886553349b2" acquired by "delete_volume" :: waited 0.022s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:34:39 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[7145e8d6-45fd-4aef-8923-fd5f2b18e497]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:34:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c7149c32-c797-4c77-af60-56e25003d026 tempest-VolumesExtendTest-1714634620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bad083e3-a14c-4e09-b642-5886553349b2 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:39 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-f6d5dc45-e88d-415f-95df-a6cbe3f7a686 tempest-VolumesMetadataTest-7012551 None] Acquiring lock "cinder-23a37241-1747-4369-9615-8e803520a17d-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:34:40 devstack sudo[101768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bad083e3-a14c-4e09-b642-5886553349b2 Sep 28 09:34:40 devstack sudo[101768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:40 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-f6d5dc45-e88d-415f-95df-a6cbe3f7a686 tempest-VolumesMetadataTest-7012551 None] Lock "cinder-23a37241-1747-4369-9615-8e803520a17d-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:34:40 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-f6d5dc45-e88d-415f-95df-a6cbe3f7a686 tempest-VolumesMetadataTest-7012551 None] Acquiring lock "cinder-quobyte-23a37241-1747-4369-9615-8e803520a17d" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:34:40 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-f6d5dc45-e88d-415f-95df-a6cbe3f7a686 tempest-VolumesMetadataTest-7012551 None] Lock "cinder-quobyte-23a37241-1747-4369-9615-8e803520a17d" acquired by "delete_volume" :: waited 0.029s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:34:40 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[7878726f-649d-48f9-9818-d742d5fa6da9]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:34:40 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f6d5dc45-e88d-415f-95df-a6cbe3f7a686 tempest-VolumesMetadataTest-7012551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-23a37241-1747-4369-9615-8e803520a17d {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:40 devstack sudo[101770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-23a37241-1747-4369-9615-8e803520a17d Sep 28 09:34:40 devstack sudo[101770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:40 devstack sudo[101768]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:40 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c7149c32-c797-4c77-af60-56e25003d026 tempest-VolumesExtendTest-1714634620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bad083e3-a14c-4e09-b642-5886553349b2" returned: 0 in 0.545s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:40 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c7149c32-c797-4c77-af60-56e25003d026 tempest-VolumesExtendTest-1714634620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bad083e3-a14c-4e09-b642-5886553349b2 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:40 devstack sudo[101775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bad083e3-a14c-4e09-b642-5886553349b2 Sep 28 09:34:40 devstack sudo[101775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:40 devstack sudo[101770]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:40 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f6d5dc45-e88d-415f-95df-a6cbe3f7a686 tempest-VolumesMetadataTest-7012551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-23a37241-1747-4369-9615-8e803520a17d" returned: 0 in 0.534s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:40 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f6d5dc45-e88d-415f-95df-a6cbe3f7a686 tempest-VolumesMetadataTest-7012551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-23a37241-1747-4369-9615-8e803520a17d {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:40 devstack sudo[101780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-23a37241-1747-4369-9615-8e803520a17d Sep 28 09:34:40 devstack sudo[101780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:40 devstack sudo[101775]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:40 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c7149c32-c797-4c77-af60-56e25003d026 tempest-VolumesExtendTest-1714634620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bad083e3-a14c-4e09-b642-5886553349b2" returned: 0 in 0.377s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:40 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-c7149c32-c797-4c77-af60-56e25003d026 tempest-VolumesExtendTest-1714634620 None] Lock "cinder-quobyte-bad083e3-a14c-4e09-b642-5886553349b2" released by "delete_volume" :: held 0.991s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:34:40 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-c7149c32-c797-4c77-af60-56e25003d026 tempest-VolumesExtendTest-1714634620 None] Created reservations ['919be6e5-837c-47a7-82b8-8da6afec2e25', 'f180cf46-4919-47f0-8bc1-6d3b7771000c', '397ca0c8-b4ab-46e9-985c-341107ac563a', '15625f2d-c41c-42ce-b3a1-f89fedfc8c5e'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:34:40 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-c7149c32-c797-4c77-af60-56e25003d026 tempest-VolumesExtendTest-1714634620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:34:40 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-c7149c32-c797-4c77-af60-56e25003d026 tempest-VolumesExtendTest-1714634620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:34:40 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-c7149c32-c797-4c77-af60-56e25003d026 tempest-VolumesExtendTest-1714634620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:34:41 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-c7149c32-c797-4c77-af60-56e25003d026 tempest-VolumesExtendTest-1714634620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:34:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-c7149c32-c797-4c77-af60-56e25003d026 tempest-VolumesExtendTest-1714634620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:34:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c7149c32-c797-4c77-af60-56e25003d026 tempest-VolumesExtendTest-1714634620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:41 devstack sudo[101780]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f6d5dc45-e88d-415f-95df-a6cbe3f7a686 tempest-VolumesMetadataTest-7012551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-23a37241-1747-4369-9615-8e803520a17d" returned: 0 in 0.307s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:41 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-f6d5dc45-e88d-415f-95df-a6cbe3f7a686 tempest-VolumesMetadataTest-7012551 None] Lock "cinder-quobyte-23a37241-1747-4369-9615-8e803520a17d" released by "delete_volume" :: held 0.924s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:34:41 devstack sudo[101784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:34:41 devstack sudo[101784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:41 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-f6d5dc45-e88d-415f-95df-a6cbe3f7a686 tempest-VolumesMetadataTest-7012551 None] Created reservations ['d313669b-8115-4c1b-b036-c581f4097f00', 'cfb97f26-0862-4c10-821c-67b77fcae265', '00d7ba0c-a807-4388-a906-7fbb1f568427', '0046822e-bda4-46b7-b342-f77375340b59'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:34:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-f6d5dc45-e88d-415f-95df-a6cbe3f7a686 tempest-VolumesMetadataTest-7012551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:34:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-f6d5dc45-e88d-415f-95df-a6cbe3f7a686 tempest-VolumesMetadataTest-7012551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:34:41 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-f6d5dc45-e88d-415f-95df-a6cbe3f7a686 tempest-VolumesMetadataTest-7012551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:34:41 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-f6d5dc45-e88d-415f-95df-a6cbe3f7a686 tempest-VolumesMetadataTest-7012551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:34:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-f6d5dc45-e88d-415f-95df-a6cbe3f7a686 tempest-VolumesMetadataTest-7012551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:34:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f6d5dc45-e88d-415f-95df-a6cbe3f7a686 tempest-VolumesMetadataTest-7012551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:41 devstack sudo[101786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:34:41 devstack sudo[101786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:41 devstack sudo[101784]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c7149c32-c797-4c77-af60-56e25003d026 tempest-VolumesExtendTest-1714634620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.318s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:41 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-c7149c32-c797-4c77-af60-56e25003d026 tempest-VolumesExtendTest-1714634620 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:34:41 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-c7149c32-c797-4c77-af60-56e25003d026 tempest-VolumesExtendTest-1714634620 None] Deleted volume successfully. Sep 28 09:34:41 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-c7149c32-c797-4c77-af60-56e25003d026 tempest-VolumesExtendTest-1714634620 None] Lock "cinder-bad083e3-a14c-4e09-b642-5886553349b2-delete_volume" released by "delete_volume" :: held 1.645s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:34:41 devstack sudo[101786]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f6d5dc45-e88d-415f-95df-a6cbe3f7a686 tempest-VolumesMetadataTest-7012551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.345s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:41 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-f6d5dc45-e88d-415f-95df-a6cbe3f7a686 tempest-VolumesMetadataTest-7012551 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:34:41 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-f6d5dc45-e88d-415f-95df-a6cbe3f7a686 tempest-VolumesMetadataTest-7012551 None] Deleted volume successfully. Sep 28 09:34:41 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-f6d5dc45-e88d-415f-95df-a6cbe3f7a686 tempest-VolumesMetadataTest-7012551 None] Lock "cinder-23a37241-1747-4369-9615-8e803520a17d-delete_volume" released by "delete_volume" :: held 1.580s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:34:42 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-128c9f20-83de-4793-88c0-2e0bce66b587 tempest-VolumesExtendTest-1714634620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:34:42 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-128c9f20-83de-4793-88c0-2e0bce66b587 tempest-VolumesExtendTest-1714634620 None] Flow 'volume_create_manager' (eae41a47-1b3c-45fe-bda3-f3a8308ed0f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:34:42 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-128c9f20-83de-4793-88c0-2e0bce66b587 tempest-VolumesExtendTest-1714634620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a568eae-9115-430a-a7c2-5bf6ee419334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:34:42 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-128c9f20-83de-4793-88c0-2e0bce66b587 tempest-VolumesExtendTest-1714634620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a568eae-9115-430a-a7c2-5bf6ee419334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:34:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1470797893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a62616e-b6b3-4b19-a1a2-a2c50a84d38d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b112b2ab93842ad8efb6252c195e5c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:34:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:34:42Z,use_quota=True,user_id='1b8c827bf2b34d4095b2e9f0df273b4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:34:42 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-128c9f20-83de-4793-88c0-2e0bce66b587 tempest-VolumesExtendTest-1714634620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cac15b0-0b49-4be8-9f29-cc5e360bdc3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:34:42 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-128c9f20-83de-4793-88c0-2e0bce66b587 tempest-VolumesExtendTest-1714634620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cac15b0-0b49-4be8-9f29-cc5e360bdc3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:34:42 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-128c9f20-83de-4793-88c0-2e0bce66b587 tempest-VolumesExtendTest-1714634620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90437905-9853-429c-ae5f-e6056c4ef29a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:34:42 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-128c9f20-83de-4793-88c0-2e0bce66b587 tempest-VolumesExtendTest-1714634620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90437905-9853-429c-ae5f-e6056c4ef29a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a62616e-b6b3-4b19-a1a2-a2c50a84d38d', 'volume_name': 'volume-3a62616e-b6b3-4b19-a1a2-a2c50a84d38d', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:34:42 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-128c9f20-83de-4793-88c0-2e0bce66b587 tempest-VolumesExtendTest-1714634620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db81f533-7de7-4da1-8cc6-67547d7cb362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:34:42 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-128c9f20-83de-4793-88c0-2e0bce66b587 tempest-VolumesExtendTest-1714634620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db81f533-7de7-4da1-8cc6-67547d7cb362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:34:42 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-128c9f20-83de-4793-88c0-2e0bce66b587 tempest-VolumesExtendTest-1714634620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (365009f2-12f3-44eb-b59c-d82ba861acdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:34:42 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-128c9f20-83de-4793-88c0-2e0bce66b587 tempest-VolumesExtendTest-1714634620 None] Volume 3a62616e-b6b3-4b19-a1a2-a2c50a84d38d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a62616e-b6b3-4b19-a1a2-a2c50a84d38d', 'volume_size': 1} Sep 28 09:34:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-128c9f20-83de-4793-88c0-2e0bce66b587 tempest-VolumesExtendTest-1714634620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:34:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-128c9f20-83de-4793-88c0-2e0bce66b587 tempest-VolumesExtendTest-1714634620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:34:42 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-128c9f20-83de-4793-88c0-2e0bce66b587 tempest-VolumesExtendTest-1714634620 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:34:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1470797893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a62616e-b6b3-4b19-a1a2-a2c50a84d38d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b112b2ab93842ad8efb6252c195e5c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:34:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:34:42Z,use_quota=True,user_id='1b8c827bf2b34d4095b2e9f0df273b4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:34:42 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-128c9f20-83de-4793-88c0-2e0bce66b587 tempest-VolumesExtendTest-1714634620 None] Creating volume 3a62616e-b6b3-4b19-a1a2-a2c50a84d38d {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:34:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-128c9f20-83de-4793-88c0-2e0bce66b587 tempest-VolumesExtendTest-1714634620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:34:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-128c9f20-83de-4793-88c0-2e0bce66b587 tempest-VolumesExtendTest-1714634620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:34:42 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-128c9f20-83de-4793-88c0-2e0bce66b587 tempest-VolumesExtendTest-1714634620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:34:42 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-128c9f20-83de-4793-88c0-2e0bce66b587 tempest-VolumesExtendTest-1714634620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:34:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-128c9f20-83de-4793-88c0-2e0bce66b587 tempest-VolumesExtendTest-1714634620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:34:42 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-128c9f20-83de-4793-88c0-2e0bce66b587 tempest-VolumesExtendTest-1714634620 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:34:42 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-128c9f20-83de-4793-88c0-2e0bce66b587 tempest-VolumesExtendTest-1714634620 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:34:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-128c9f20-83de-4793-88c0-2e0bce66b587 tempest-VolumesExtendTest-1714634620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3a62616e-b6b3-4b19-a1a2-a2c50a84d38d 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:42 devstack sudo[101790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3a62616e-b6b3-4b19-a1a2-a2c50a84d38d 1073741824 Sep 28 09:34:42 devstack sudo[101790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:43 devstack sudo[101790]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:43 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-128c9f20-83de-4793-88c0-2e0bce66b587 tempest-VolumesExtendTest-1714634620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3a62616e-b6b3-4b19-a1a2-a2c50a84d38d 1073741824" returned: 0 in 0.534s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:43 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-128c9f20-83de-4793-88c0-2e0bce66b587 tempest-VolumesExtendTest-1714634620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3a62616e-b6b3-4b19-a1a2-a2c50a84d38d {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:43 devstack sudo[101795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3a62616e-b6b3-4b19-a1a2-a2c50a84d38d Sep 28 09:34:43 devstack sudo[101795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:43 devstack sudo[101795]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:43 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-128c9f20-83de-4793-88c0-2e0bce66b587 tempest-VolumesExtendTest-1714634620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3a62616e-b6b3-4b19-a1a2-a2c50a84d38d" returned: 0 in 0.324s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:43 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-128c9f20-83de-4793-88c0-2e0bce66b587 tempest-VolumesExtendTest-1714634620 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:34:43 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-128c9f20-83de-4793-88c0-2e0bce66b587 tempest-VolumesExtendTest-1714634620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:34:43 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-128c9f20-83de-4793-88c0-2e0bce66b587 tempest-VolumesExtendTest-1714634620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (365009f2-12f3-44eb-b59c-d82ba861acdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a62616e-b6b3-4b19-a1a2-a2c50a84d38d', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:34:43 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-128c9f20-83de-4793-88c0-2e0bce66b587 tempest-VolumesExtendTest-1714634620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1105e74b-70e9-44f2-9aa8-1ecce0b795fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:34:43 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-128c9f20-83de-4793-88c0-2e0bce66b587 tempest-VolumesExtendTest-1714634620 None] Volume volume-3a62616e-b6b3-4b19-a1a2-a2c50a84d38d (3a62616e-b6b3-4b19-a1a2-a2c50a84d38d): created successfully Sep 28 09:34:43 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-128c9f20-83de-4793-88c0-2e0bce66b587 tempest-VolumesExtendTest-1714634620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1105e74b-70e9-44f2-9aa8-1ecce0b795fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:34:43 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-128c9f20-83de-4793-88c0-2e0bce66b587 tempest-VolumesExtendTest-1714634620 None] Flow 'volume_create_manager' (eae41a47-1b3c-45fe-bda3-f3a8308ed0f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:34:43 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-128c9f20-83de-4793-88c0-2e0bce66b587 tempest-VolumesExtendTest-1714634620 None] Created volume successfully. Sep 28 09:34:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-e6aa4959-5765-43e8-9c4d-239786eb1c3a tempest-VolumesExtendTest-1714634620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:34:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-e6aa4959-5765-43e8-9c4d-239786eb1c3a tempest-VolumesExtendTest-1714634620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:34:45 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-e6aa4959-5765-43e8-9c4d-239786eb1c3a tempest-VolumesExtendTest-1714634620 None] Creating offline snapshot 9d73e40e-df5f-44dc-9809-2627a443d7f2 of volume 3a62616e-b6b3-4b19-a1a2-a2c50a84d38d {{(pid=86553) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 09:34:45 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[838d9011-6c9a-41f0-82df-54eb3d20b379]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:34:45 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e6aa4959-5765-43e8-9c4d-239786eb1c3a tempest-VolumesExtendTest-1714634620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3a62616e-b6b3-4b19-a1a2-a2c50a84d38d {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:45 devstack sudo[101799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3a62616e-b6b3-4b19-a1a2-a2c50a84d38d Sep 28 09:34:45 devstack sudo[101799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:45 devstack sudo[101799]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:45 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e6aa4959-5765-43e8-9c4d-239786eb1c3a tempest-VolumesExtendTest-1714634620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3a62616e-b6b3-4b19-a1a2-a2c50a84d38d" returned: 0 in 0.484s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:45 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e6aa4959-5765-43e8-9c4d-239786eb1c3a tempest-VolumesExtendTest-1714634620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3a62616e-b6b3-4b19-a1a2-a2c50a84d38d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3a62616e-b6b3-4b19-a1a2-a2c50a84d38d.9d73e40e-df5f-44dc-9809-2627a443d7f2 1G {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:45 devstack sudo[101805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3a62616e-b6b3-4b19-a1a2-a2c50a84d38d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3a62616e-b6b3-4b19-a1a2-a2c50a84d38d.9d73e40e-df5f-44dc-9809-2627a443d7f2 1G Sep 28 09:34:45 devstack sudo[101805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:46 devstack sudo[101805]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:46 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e6aa4959-5765-43e8-9c4d-239786eb1c3a tempest-VolumesExtendTest-1714634620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3a62616e-b6b3-4b19-a1a2-a2c50a84d38d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3a62616e-b6b3-4b19-a1a2-a2c50a84d38d.9d73e40e-df5f-44dc-9809-2627a443d7f2 1G" returned: 0 in 0.616s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:46 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e6aa4959-5765-43e8-9c4d-239786eb1c3a tempest-VolumesExtendTest-1714634620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a62616e-b6b3-4b19-a1a2-a2c50a84d38d -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3a62616e-b6b3-4b19-a1a2-a2c50a84d38d.9d73e40e-df5f-44dc-9809-2627a443d7f2 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:46 devstack sudo[101811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a62616e-b6b3-4b19-a1a2-a2c50a84d38d -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3a62616e-b6b3-4b19-a1a2-a2c50a84d38d.9d73e40e-df5f-44dc-9809-2627a443d7f2 Sep 28 09:34:46 devstack sudo[101811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:46 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f044fc7-789a-466e-a561-01c25e1a9c35 tempest-VolumesCloneTest-564216729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:34:46 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7f044fc7-789a-466e-a561-01c25e1a9c35 tempest-VolumesCloneTest-564216729 None] Flow 'volume_create_manager' (a5245443-4dc7-4225-a740-5d4d4c76195d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:34:46 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7f044fc7-789a-466e-a561-01c25e1a9c35 tempest-VolumesCloneTest-564216729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99cc84b9-9647-49b5-92f2-b108f93368b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:34:46 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7f044fc7-789a-466e-a561-01c25e1a9c35 tempest-VolumesCloneTest-564216729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99cc84b9-9647-49b5-92f2-b108f93368b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:34:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1987779352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=382fd989-489c-4a40-bc1b-270f967814cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be9fde1eb3574122b496dd45d7dcdbc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:34:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:34:46Z,use_quota=True,user_id='ec4fa848bac2417aa2a5788b3c19327a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:34:46 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7f044fc7-789a-466e-a561-01c25e1a9c35 tempest-VolumesCloneTest-564216729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f4ce2cb-a3e2-41ca-bf21-6d8cc71837e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:34:46 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7f044fc7-789a-466e-a561-01c25e1a9c35 tempest-VolumesCloneTest-564216729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f4ce2cb-a3e2-41ca-bf21-6d8cc71837e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:34:46 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7f044fc7-789a-466e-a561-01c25e1a9c35 tempest-VolumesCloneTest-564216729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f8c3cc5-3647-41c2-a595-6f7378cda15d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:34:46 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7f044fc7-789a-466e-a561-01c25e1a9c35 tempest-VolumesCloneTest-564216729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f8c3cc5-3647-41c2-a595-6f7378cda15d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '382fd989-489c-4a40-bc1b-270f967814cc', 'volume_name': 'volume-382fd989-489c-4a40-bc1b-270f967814cc', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:34:46 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7f044fc7-789a-466e-a561-01c25e1a9c35 tempest-VolumesCloneTest-564216729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2deb99fd-445d-4b58-b341-90f261c1ed66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:34:46 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7f044fc7-789a-466e-a561-01c25e1a9c35 tempest-VolumesCloneTest-564216729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2deb99fd-445d-4b58-b341-90f261c1ed66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:34:46 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7f044fc7-789a-466e-a561-01c25e1a9c35 tempest-VolumesCloneTest-564216729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efcfcc77-75e5-4441-992e-db2624e8b0fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:34:46 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-7f044fc7-789a-466e-a561-01c25e1a9c35 tempest-VolumesCloneTest-564216729 None] Volume 382fd989-489c-4a40-bc1b-270f967814cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-382fd989-489c-4a40-bc1b-270f967814cc', 'volume_size': 1} Sep 28 09:34:46 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-7f044fc7-789a-466e-a561-01c25e1a9c35 tempest-VolumesCloneTest-564216729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:34:46 devstack sudo[101811]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:46 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e6aa4959-5765-43e8-9c4d-239786eb1c3a tempest-VolumesExtendTest-1714634620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a62616e-b6b3-4b19-a1a2-a2c50a84d38d -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3a62616e-b6b3-4b19-a1a2-a2c50a84d38d.9d73e40e-df5f-44dc-9809-2627a443d7f2" returned: 0 in 0.482s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:46 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-e6aa4959-5765-43e8-9c4d-239786eb1c3a tempest-VolumesExtendTest-1714634620 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3a62616e-b6b3-4b19-a1a2-a2c50a84d38d.9d73e40e-df5f-44dc-9809-2627a443d7f2 is being set with open permissions: ugo+rw Sep 28 09:34:46 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e6aa4959-5765-43e8-9c4d-239786eb1c3a tempest-VolumesExtendTest-1714634620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3a62616e-b6b3-4b19-a1a2-a2c50a84d38d.9d73e40e-df5f-44dc-9809-2627a443d7f2 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:46 devstack sudo[101816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3a62616e-b6b3-4b19-a1a2-a2c50a84d38d.9d73e40e-df5f-44dc-9809-2627a443d7f2 Sep 28 09:34:46 devstack sudo[101816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:46 devstack sudo[101816]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:46 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e6aa4959-5765-43e8-9c4d-239786eb1c3a tempest-VolumesExtendTest-1714634620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3a62616e-b6b3-4b19-a1a2-a2c50a84d38d.9d73e40e-df5f-44dc-9809-2627a443d7f2" returned: 0 in 0.293s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:46 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e6aa4959-5765-43e8-9c4d-239786eb1c3a tempest-VolumesExtendTest-1714634620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3a62616e-b6b3-4b19-a1a2-a2c50a84d38d.info {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:47 devstack sudo[101819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3a62616e-b6b3-4b19-a1a2-a2c50a84d38d.info Sep 28 09:34:47 devstack sudo[101819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:47 devstack sudo[101819]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:47 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e6aa4959-5765-43e8-9c4d-239786eb1c3a tempest-VolumesExtendTest-1714634620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3a62616e-b6b3-4b19-a1a2-a2c50a84d38d.info" returned: 0 in 0.275s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:47 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-e6aa4959-5765-43e8-9c4d-239786eb1c3a tempest-VolumesExtendTest-1714634620 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3a62616e-b6b3-4b19-a1a2-a2c50a84d38d.info is being set with open permissions: ugo+rw Sep 28 09:34:47 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e6aa4959-5765-43e8-9c4d-239786eb1c3a tempest-VolumesExtendTest-1714634620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3a62616e-b6b3-4b19-a1a2-a2c50a84d38d.info {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:47 devstack sudo[101822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3a62616e-b6b3-4b19-a1a2-a2c50a84d38d.info Sep 28 09:34:47 devstack sudo[101822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:47 devstack sudo[101822]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:47 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e6aa4959-5765-43e8-9c4d-239786eb1c3a tempest-VolumesExtendTest-1714634620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3a62616e-b6b3-4b19-a1a2-a2c50a84d38d.info" returned: 0 in 0.251s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:47 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-e6aa4959-5765-43e8-9c4d-239786eb1c3a tempest-VolumesExtendTest-1714634620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.559s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:34:47 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-7f044fc7-789a-466e-a561-01c25e1a9c35 tempest-VolumesCloneTest-564216729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.087s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:34:47 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-7f044fc7-789a-466e-a561-01c25e1a9c35 tempest-VolumesCloneTest-564216729 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:34:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1987779352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=382fd989-489c-4a40-bc1b-270f967814cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be9fde1eb3574122b496dd45d7dcdbc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:34:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:34:46Z,use_quota=True,user_id='ec4fa848bac2417aa2a5788b3c19327a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:34:47 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-7f044fc7-789a-466e-a561-01c25e1a9c35 tempest-VolumesCloneTest-564216729 None] Creating volume 382fd989-489c-4a40-bc1b-270f967814cc {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:34:47 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-7f044fc7-789a-466e-a561-01c25e1a9c35 tempest-VolumesCloneTest-564216729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:34:47 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-7f044fc7-789a-466e-a561-01c25e1a9c35 tempest-VolumesCloneTest-564216729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:34:47 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-7f044fc7-789a-466e-a561-01c25e1a9c35 tempest-VolumesCloneTest-564216729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:34:47 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-7f044fc7-789a-466e-a561-01c25e1a9c35 tempest-VolumesCloneTest-564216729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:34:47 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-7f044fc7-789a-466e-a561-01c25e1a9c35 tempest-VolumesCloneTest-564216729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:34:47 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-7f044fc7-789a-466e-a561-01c25e1a9c35 tempest-VolumesCloneTest-564216729 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:34:47 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-7f044fc7-789a-466e-a561-01c25e1a9c35 tempest-VolumesCloneTest-564216729 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:34:47 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-7f044fc7-789a-466e-a561-01c25e1a9c35 tempest-VolumesCloneTest-564216729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-382fd989-489c-4a40-bc1b-270f967814cc 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:47 devstack sudo[101825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-382fd989-489c-4a40-bc1b-270f967814cc 1073741824 Sep 28 09:34:47 devstack sudo[101825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:47 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-e6aa4959-5765-43e8-9c4d-239786eb1c3a tempest-VolumesExtendTest-1714634620 None] Create snapshot completed successfully Sep 28 09:34:48 devstack sudo[101825]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-7f044fc7-789a-466e-a561-01c25e1a9c35 tempest-VolumesCloneTest-564216729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-382fd989-489c-4a40-bc1b-270f967814cc 1073741824" returned: 0 in 0.591s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-7f044fc7-789a-466e-a561-01c25e1a9c35 tempest-VolumesCloneTest-564216729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-382fd989-489c-4a40-bc1b-270f967814cc {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:48 devstack sudo[101832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-382fd989-489c-4a40-bc1b-270f967814cc Sep 28 09:34:48 devstack sudo[101832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-987b110e-5602-46d4-a407-6ff75fbec5e3 tempest-VolumesExtendTest-1714634620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:34:48 devstack sudo[101832]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-7f044fc7-789a-466e-a561-01c25e1a9c35 tempest-VolumesCloneTest-564216729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-382fd989-489c-4a40-bc1b-270f967814cc" returned: 0 in 0.357s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:48 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-7f044fc7-789a-466e-a561-01c25e1a9c35 tempest-VolumesCloneTest-564216729 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:34:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-7f044fc7-789a-466e-a561-01c25e1a9c35 tempest-VolumesCloneTest-564216729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:34:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-987b110e-5602-46d4-a407-6ff75fbec5e3 tempest-VolumesExtendTest-1714634620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.221s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:34:48 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7f044fc7-789a-466e-a561-01c25e1a9c35 tempest-VolumesCloneTest-564216729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efcfcc77-75e5-4441-992e-db2624e8b0fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-382fd989-489c-4a40-bc1b-270f967814cc', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:34:48 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7f044fc7-789a-466e-a561-01c25e1a9c35 tempest-VolumesCloneTest-564216729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a291160-f940-49cd-aceb-f53dd4703021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:34:48 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfebb5a3-8a58-4aa3-ba2e-cd2a1cdcd58d]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:34:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-987b110e-5602-46d4-a407-6ff75fbec5e3 tempest-VolumesExtendTest-1714634620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3a62616e-b6b3-4b19-a1a2-a2c50a84d38d {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:48 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-7f044fc7-789a-466e-a561-01c25e1a9c35 tempest-VolumesCloneTest-564216729 None] Volume volume-382fd989-489c-4a40-bc1b-270f967814cc (382fd989-489c-4a40-bc1b-270f967814cc): created successfully Sep 28 09:34:48 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7f044fc7-789a-466e-a561-01c25e1a9c35 tempest-VolumesCloneTest-564216729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a291160-f940-49cd-aceb-f53dd4703021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:34:48 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7f044fc7-789a-466e-a561-01c25e1a9c35 tempest-VolumesCloneTest-564216729 None] Flow 'volume_create_manager' (a5245443-4dc7-4225-a740-5d4d4c76195d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:34:48 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-7f044fc7-789a-466e-a561-01c25e1a9c35 tempest-VolumesCloneTest-564216729 None] Created volume successfully. Sep 28 09:34:48 devstack sudo[101835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3a62616e-b6b3-4b19-a1a2-a2c50a84d38d Sep 28 09:34:48 devstack sudo[101835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:49 devstack sudo[101835]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-987b110e-5602-46d4-a407-6ff75fbec5e3 tempest-VolumesExtendTest-1714634620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3a62616e-b6b3-4b19-a1a2-a2c50a84d38d" returned: 0 in 0.511s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-987b110e-5602-46d4-a407-6ff75fbec5e3 tempest-VolumesExtendTest-1714634620 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3a62616e-b6b3-4b19-a1a2-a2c50a84d38d.9d73e40e-df5f-44dc-9809-2627a443d7f2 2G {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-987b110e-5602-46d4-a407-6ff75fbec5e3 tempest-VolumesExtendTest-1714634620 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3a62616e-b6b3-4b19-a1a2-a2c50a84d38d.9d73e40e-df5f-44dc-9809-2627a443d7f2 2G" returned: 0 in 0.177s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-987b110e-5602-46d4-a407-6ff75fbec5e3 tempest-VolumesExtendTest-1714634620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.751s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:34:49 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-987b110e-5602-46d4-a407-6ff75fbec5e3 tempest-VolumesExtendTest-1714634620 None] Extend volume completed successfully. Sep 28 09:34:49 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-26f1999c-0c23-470a-bc1c-6bbb9aaa2735 tempest-VolumesExtendTest-1714634620 None] Acquiring lock "cinder-9d73e40e-df5f-44dc-9809-2627a443d7f2-delete_snapshot" by "delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:34:49 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-26f1999c-0c23-470a-bc1c-6bbb9aaa2735 tempest-VolumesExtendTest-1714634620 None] Lock "cinder-9d73e40e-df5f-44dc-9809-2627a443d7f2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:34:49 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-26f1999c-0c23-470a-bc1c-6bbb9aaa2735 tempest-VolumesExtendTest-1714634620 None] Acquiring lock "cinder-quobyte-3a62616e-b6b3-4b19-a1a2-a2c50a84d38d" by "delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:34:49 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-26f1999c-0c23-470a-bc1c-6bbb9aaa2735 tempest-VolumesExtendTest-1714634620 None] Lock "cinder-quobyte-3a62616e-b6b3-4b19-a1a2-a2c50a84d38d" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:34:49 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-26f1999c-0c23-470a-bc1c-6bbb9aaa2735 tempest-VolumesExtendTest-1714634620 None] Acquiring lock "cinder-quobyte-9d73e40e-df5f-44dc-9809-2627a443d7f2" by "_delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:34:49 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-26f1999c-0c23-470a-bc1c-6bbb9aaa2735 tempest-VolumesExtendTest-1714634620 None] Lock "cinder-quobyte-9d73e40e-df5f-44dc-9809-2627a443d7f2" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:34:49 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-26f1999c-0c23-470a-bc1c-6bbb9aaa2735 tempest-VolumesExtendTest-1714634620 None] Deleting offline snapshot 9d73e40e-df5f-44dc-9809-2627a443d7f2 of volume 3a62616e-b6b3-4b19-a1a2-a2c50a84d38d {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 09:34:49 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-26f1999c-0c23-470a-bc1c-6bbb9aaa2735 tempest-VolumesExtendTest-1714634620 None] snapshot_file for this snap is: volume-3a62616e-b6b3-4b19-a1a2-a2c50a84d38d.9d73e40e-df5f-44dc-9809-2627a443d7f2 {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 09:34:49 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b6e93e-5aa4-4348-b3c9-b2aaee9f9a19]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:34:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-26f1999c-0c23-470a-bc1c-6bbb9aaa2735 tempest-VolumesExtendTest-1714634620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3a62616e-b6b3-4b19-a1a2-a2c50a84d38d.9d73e40e-df5f-44dc-9809-2627a443d7f2 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:49 devstack sudo[101846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3a62616e-b6b3-4b19-a1a2-a2c50a84d38d.9d73e40e-df5f-44dc-9809-2627a443d7f2 Sep 28 09:34:49 devstack sudo[101846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:50 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f104744-bd6d-4e59-b01b-29728a55706d tempest-VolumesCloneTest-564216729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:34:50 devstack sudo[101846]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-26f1999c-0c23-470a-bc1c-6bbb9aaa2735 tempest-VolumesExtendTest-1714634620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3a62616e-b6b3-4b19-a1a2-a2c50a84d38d.9d73e40e-df5f-44dc-9809-2627a443d7f2" returned: 0 in 0.597s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:50 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-26f1999c-0c23-470a-bc1c-6bbb9aaa2735 tempest-VolumesExtendTest-1714634620 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a62616e-b6b3-4b19-a1a2-a2c50a84d38d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86553) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 09:34:50 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7f104744-bd6d-4e59-b01b-29728a55706d tempest-VolumesCloneTest-564216729 None] Flow 'volume_create_manager' (8dae1891-f3dc-4b7a-a95b-b631c582de62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:34:50 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7f104744-bd6d-4e59-b01b-29728a55706d tempest-VolumesCloneTest-564216729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74074c5b-c916-4377-9298-17b69a1b8021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:34:50 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb53ff7-60d8-4b47-8a22-64b4d2a00ca3]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:34:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-26f1999c-0c23-470a-bc1c-6bbb9aaa2735 tempest-VolumesExtendTest-1714634620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3a62616e-b6b3-4b19-a1a2-a2c50a84d38d {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:50 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7f104744-bd6d-4e59-b01b-29728a55706d tempest-VolumesCloneTest-564216729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74074c5b-c916-4377-9298-17b69a1b8021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:34:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-438021570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=343d284c-5566-4990-819b-a01e7227e2e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be9fde1eb3574122b496dd45d7dcdbc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:34:50Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=382fd989-489c-4a40-bc1b-270f967814cc,status='creating',terminated_at=None,updated_at=2026-09-28T07:34:50Z,use_quota=True,user_id='ec4fa848bac2417aa2a5788b3c19327a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:34:50 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7f104744-bd6d-4e59-b01b-29728a55706d tempest-VolumesCloneTest-564216729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bd9c08f-2cfe-4feb-95da-feb1c9b5aa28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:34:50 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7f104744-bd6d-4e59-b01b-29728a55706d tempest-VolumesCloneTest-564216729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bd9c08f-2cfe-4feb-95da-feb1c9b5aa28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:34:50 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7f104744-bd6d-4e59-b01b-29728a55706d tempest-VolumesCloneTest-564216729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae0b171d-ec60-4113-a22c-2c014df76ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:34:50 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7f104744-bd6d-4e59-b01b-29728a55706d tempest-VolumesCloneTest-564216729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae0b171d-ec60-4113-a22c-2c014df76ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '343d284c-5566-4990-819b-a01e7227e2e3', 'volume_name': 'volume-343d284c-5566-4990-819b-a01e7227e2e3', 'volume_size': 2, 'source_volid': '382fd989-489c-4a40-bc1b-270f967814cc', 'source_volstatus': 'available'}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:34:50 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7f104744-bd6d-4e59-b01b-29728a55706d tempest-VolumesCloneTest-564216729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1da2a44c-78c8-4642-a320-e7d890b46648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:34:50 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7f104744-bd6d-4e59-b01b-29728a55706d tempest-VolumesCloneTest-564216729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1da2a44c-78c8-4642-a320-e7d890b46648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:34:50 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7f104744-bd6d-4e59-b01b-29728a55706d tempest-VolumesCloneTest-564216729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3b55880-3ef8-422a-b500-f2951ce17f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:34:50 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-7f104744-bd6d-4e59-b01b-29728a55706d tempest-VolumesCloneTest-564216729 None] Volume 343d284c-5566-4990-819b-a01e7227e2e3: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-343d284c-5566-4990-819b-a01e7227e2e3', 'volume_size': 2, 'source_volid': '382fd989-489c-4a40-bc1b-270f967814cc', 'source_volstatus': 'available'} Sep 28 09:34:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-7f104744-bd6d-4e59-b01b-29728a55706d tempest-VolumesCloneTest-564216729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:34:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-7f104744-bd6d-4e59-b01b-29728a55706d tempest-VolumesCloneTest-564216729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.002s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:34:50 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-7f104744-bd6d-4e59-b01b-29728a55706d tempest-VolumesCloneTest-564216729 None] Cloning volume 382fd989-489c-4a40-bc1b-270f967814cc to volume 343d284c-5566-4990-819b-a01e7227e2e3 Sep 28 09:34:50 devstack sudo[101851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3a62616e-b6b3-4b19-a1a2-a2c50a84d38d Sep 28 09:34:50 devstack sudo[101851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:50 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-7f104744-bd6d-4e59-b01b-29728a55706d tempest-VolumesCloneTest-564216729 None] Creating offline snapshot 2b50c330-aa2d-474f-9f4f-773c4e45f617 of volume 382fd989-489c-4a40-bc1b-270f967814cc {{(pid=86553) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 09:34:50 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef845a75-3dab-48d4-b7aa-822d5767a2dd]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:34:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-7f104744-bd6d-4e59-b01b-29728a55706d tempest-VolumesCloneTest-564216729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-382fd989-489c-4a40-bc1b-270f967814cc {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:50 devstack sudo[101853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-382fd989-489c-4a40-bc1b-270f967814cc Sep 28 09:34:50 devstack sudo[101853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:50 devstack sudo[101851]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-26f1999c-0c23-470a-bc1c-6bbb9aaa2735 tempest-VolumesExtendTest-1714634620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3a62616e-b6b3-4b19-a1a2-a2c50a84d38d" returned: 0 in 0.529s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:51 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-26f1999c-0c23-470a-bc1c-6bbb9aaa2735 tempest-VolumesExtendTest-1714634620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3a62616e-b6b3-4b19-a1a2-a2c50a84d38d.9d73e40e-df5f-44dc-9809-2627a443d7f2 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:51 devstack sudo[101858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3a62616e-b6b3-4b19-a1a2-a2c50a84d38d.9d73e40e-df5f-44dc-9809-2627a443d7f2 Sep 28 09:34:51 devstack sudo[101858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:51 devstack sudo[101853]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:51 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-7f104744-bd6d-4e59-b01b-29728a55706d tempest-VolumesCloneTest-564216729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-382fd989-489c-4a40-bc1b-270f967814cc" returned: 0 in 0.545s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:51 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-7f104744-bd6d-4e59-b01b-29728a55706d tempest-VolumesCloneTest-564216729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-382fd989-489c-4a40-bc1b-270f967814cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-382fd989-489c-4a40-bc1b-270f967814cc.2b50c330-aa2d-474f-9f4f-773c4e45f617 1G {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:51 devstack sudo[101864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-382fd989-489c-4a40-bc1b-270f967814cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-382fd989-489c-4a40-bc1b-270f967814cc.2b50c330-aa2d-474f-9f4f-773c4e45f617 1G Sep 28 09:34:51 devstack sudo[101864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:51 devstack sudo[101858]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:51 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-26f1999c-0c23-470a-bc1c-6bbb9aaa2735 tempest-VolumesExtendTest-1714634620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3a62616e-b6b3-4b19-a1a2-a2c50a84d38d.9d73e40e-df5f-44dc-9809-2627a443d7f2" returned: 0 in 0.598s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:51 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-26f1999c-0c23-470a-bc1c-6bbb9aaa2735 tempest-VolumesExtendTest-1714634620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3a62616e-b6b3-4b19-a1a2-a2c50a84d38d.9d73e40e-df5f-44dc-9809-2627a443d7f2 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:51 devstack sudo[101873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3a62616e-b6b3-4b19-a1a2-a2c50a84d38d.9d73e40e-df5f-44dc-9809-2627a443d7f2 Sep 28 09:34:51 devstack sudo[101873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:51 devstack sudo[101864]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:51 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-7f104744-bd6d-4e59-b01b-29728a55706d tempest-VolumesCloneTest-564216729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-382fd989-489c-4a40-bc1b-270f967814cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-382fd989-489c-4a40-bc1b-270f967814cc.2b50c330-aa2d-474f-9f4f-773c4e45f617 1G" returned: 0 in 0.565s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:51 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-7f104744-bd6d-4e59-b01b-29728a55706d tempest-VolumesCloneTest-564216729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-382fd989-489c-4a40-bc1b-270f967814cc -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-382fd989-489c-4a40-bc1b-270f967814cc.2b50c330-aa2d-474f-9f4f-773c4e45f617 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:51 devstack sudo[101877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-382fd989-489c-4a40-bc1b-270f967814cc -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-382fd989-489c-4a40-bc1b-270f967814cc.2b50c330-aa2d-474f-9f4f-773c4e45f617 Sep 28 09:34:51 devstack sudo[101877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:51 devstack sudo[101873]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:51 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-26f1999c-0c23-470a-bc1c-6bbb9aaa2735 tempest-VolumesExtendTest-1714634620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3a62616e-b6b3-4b19-a1a2-a2c50a84d38d.9d73e40e-df5f-44dc-9809-2627a443d7f2" returned: 0 in 0.317s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:51 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-26f1999c-0c23-470a-bc1c-6bbb9aaa2735 tempest-VolumesExtendTest-1714634620 None] Lock "cinder-quobyte-9d73e40e-df5f-44dc-9809-2627a443d7f2" released by "_delete_snapshot" :: held 2.242s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:34:52 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-26f1999c-0c23-470a-bc1c-6bbb9aaa2735 tempest-VolumesExtendTest-1714634620 None] Lock "cinder-quobyte-3a62616e-b6b3-4b19-a1a2-a2c50a84d38d" released by "delete_snapshot" :: held 2.273s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:34:52 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-26f1999c-0c23-470a-bc1c-6bbb9aaa2735 tempest-VolumesExtendTest-1714634620 None] Created reservations ['8259b84b-1fb2-41ce-9a71-86932a61373d', 'd5ed3951-d721-4924-bdb1-cc16d9cee1d0', '470e8ffa-74b1-4714-b473-c844f8ef3888', 'bc4dffa8-46f7-4203-abf1-0fec46f4440c'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:34:52 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-26f1999c-0c23-470a-bc1c-6bbb9aaa2735 tempest-VolumesExtendTest-1714634620 None] Delete snapshot completed successfully. Sep 28 09:34:52 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-26f1999c-0c23-470a-bc1c-6bbb9aaa2735 tempest-VolumesExtendTest-1714634620 None] Lock "cinder-9d73e40e-df5f-44dc-9809-2627a443d7f2-delete_snapshot" released by "delete_snapshot" :: held 2.513s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:34:52 devstack sudo[101877]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:52 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-7f104744-bd6d-4e59-b01b-29728a55706d tempest-VolumesCloneTest-564216729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-382fd989-489c-4a40-bc1b-270f967814cc -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-382fd989-489c-4a40-bc1b-270f967814cc.2b50c330-aa2d-474f-9f4f-773c4e45f617" returned: 0 in 0.427s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:52 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-7f104744-bd6d-4e59-b01b-29728a55706d tempest-VolumesCloneTest-564216729 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-382fd989-489c-4a40-bc1b-270f967814cc.2b50c330-aa2d-474f-9f4f-773c4e45f617 is being set with open permissions: ugo+rw Sep 28 09:34:52 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-7f104744-bd6d-4e59-b01b-29728a55706d tempest-VolumesCloneTest-564216729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-382fd989-489c-4a40-bc1b-270f967814cc.2b50c330-aa2d-474f-9f4f-773c4e45f617 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:52 devstack sudo[101884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-382fd989-489c-4a40-bc1b-270f967814cc.2b50c330-aa2d-474f-9f4f-773c4e45f617 Sep 28 09:34:52 devstack sudo[101884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:52 devstack sudo[101884]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:52 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-7f104744-bd6d-4e59-b01b-29728a55706d tempest-VolumesCloneTest-564216729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-382fd989-489c-4a40-bc1b-270f967814cc.2b50c330-aa2d-474f-9f4f-773c4e45f617" returned: 0 in 0.303s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:52 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-7f104744-bd6d-4e59-b01b-29728a55706d tempest-VolumesCloneTest-564216729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-382fd989-489c-4a40-bc1b-270f967814cc.info {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:52 devstack sudo[101887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-382fd989-489c-4a40-bc1b-270f967814cc.info Sep 28 09:34:52 devstack sudo[101887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:52 devstack sudo[101887]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:52 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-7f104744-bd6d-4e59-b01b-29728a55706d tempest-VolumesCloneTest-564216729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-382fd989-489c-4a40-bc1b-270f967814cc.info" returned: 0 in 0.311s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:52 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-7f104744-bd6d-4e59-b01b-29728a55706d tempest-VolumesCloneTest-564216729 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-382fd989-489c-4a40-bc1b-270f967814cc.info is being set with open permissions: ugo+rw Sep 28 09:34:52 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-7f104744-bd6d-4e59-b01b-29728a55706d tempest-VolumesCloneTest-564216729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-382fd989-489c-4a40-bc1b-270f967814cc.info {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:52 devstack sudo[101890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-382fd989-489c-4a40-bc1b-270f967814cc.info Sep 28 09:34:52 devstack sudo[101890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:53 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-f1e78662-85f8-4ac2-913f-56e63ff02d32 tempest-VolumesExtendTest-1714634620 None] Acquiring lock "cinder-3a62616e-b6b3-4b19-a1a2-a2c50a84d38d-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:34:53 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-f1e78662-85f8-4ac2-913f-56e63ff02d32 tempest-VolumesExtendTest-1714634620 None] Lock "cinder-3a62616e-b6b3-4b19-a1a2-a2c50a84d38d-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:34:53 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-f1e78662-85f8-4ac2-913f-56e63ff02d32 tempest-VolumesExtendTest-1714634620 None] Acquiring lock "cinder-quobyte-3a62616e-b6b3-4b19-a1a2-a2c50a84d38d" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:34:53 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-f1e78662-85f8-4ac2-913f-56e63ff02d32 tempest-VolumesExtendTest-1714634620 None] Lock "cinder-quobyte-3a62616e-b6b3-4b19-a1a2-a2c50a84d38d" acquired by "delete_volume" :: waited 0.024s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:34:53 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[d42a8a1c-2bc6-4e11-88e9-998535305389]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:34:53 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f1e78662-85f8-4ac2-913f-56e63ff02d32 tempest-VolumesExtendTest-1714634620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3a62616e-b6b3-4b19-a1a2-a2c50a84d38d {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:53 devstack sudo[101890]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:53 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-7f104744-bd6d-4e59-b01b-29728a55706d tempest-VolumesCloneTest-564216729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-382fd989-489c-4a40-bc1b-270f967814cc.info" returned: 0 in 0.633s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:53 devstack sudo[101892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3a62616e-b6b3-4b19-a1a2-a2c50a84d38d Sep 28 09:34:53 devstack sudo[101892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:53 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-7f104744-bd6d-4e59-b01b-29728a55706d tempest-VolumesCloneTest-564216729 None] Acquiring lock "cinder-quobyte-343d284c-5566-4990-819b-a01e7227e2e3" by "_copy_volume_from_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:34:53 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-7f104744-bd6d-4e59-b01b-29728a55706d tempest-VolumesCloneTest-564216729 None] Lock "cinder-quobyte-343d284c-5566-4990-819b-a01e7227e2e3" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:34:53 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-7f104744-bd6d-4e59-b01b-29728a55706d tempest-VolumesCloneTest-564216729 None] snapshot: 2b50c330-aa2d-474f-9f4f-773c4e45f617, volume: 343d284c-5566-4990-819b-a01e7227e2e3, {{(pid=86553) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 09:34:53 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-7f104744-bd6d-4e59-b01b-29728a55706d tempest-VolumesCloneTest-564216729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:34:53 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-7f104744-bd6d-4e59-b01b-29728a55706d tempest-VolumesCloneTest-564216729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:34:53 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-7f104744-bd6d-4e59-b01b-29728a55706d tempest-VolumesCloneTest-564216729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:34:53 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-7f104744-bd6d-4e59-b01b-29728a55706d tempest-VolumesCloneTest-564216729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:34:53 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-7f104744-bd6d-4e59-b01b-29728a55706d tempest-VolumesCloneTest-564216729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:34:53 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aac4604-83d6-494c-8f2d-172354ef170a]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:34:53 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-7f104744-bd6d-4e59-b01b-29728a55706d tempest-VolumesCloneTest-564216729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-382fd989-489c-4a40-bc1b-270f967814cc.2b50c330-aa2d-474f-9f4f-773c4e45f617 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:53 devstack sudo[101895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-382fd989-489c-4a40-bc1b-270f967814cc.2b50c330-aa2d-474f-9f4f-773c4e45f617 Sep 28 09:34:53 devstack sudo[101895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:53 devstack sudo[101892]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:53 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f1e78662-85f8-4ac2-913f-56e63ff02d32 tempest-VolumesExtendTest-1714634620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3a62616e-b6b3-4b19-a1a2-a2c50a84d38d" returned: 0 in 0.643s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:53 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f1e78662-85f8-4ac2-913f-56e63ff02d32 tempest-VolumesExtendTest-1714634620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3a62616e-b6b3-4b19-a1a2-a2c50a84d38d {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:54 devstack sudo[101901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3a62616e-b6b3-4b19-a1a2-a2c50a84d38d Sep 28 09:34:54 devstack sudo[101901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:54 devstack sudo[101895]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:54 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-7f104744-bd6d-4e59-b01b-29728a55706d tempest-VolumesCloneTest-564216729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-382fd989-489c-4a40-bc1b-270f967814cc.2b50c330-aa2d-474f-9f4f-773c4e45f617" returned: 0 in 0.442s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:54 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-7f104744-bd6d-4e59-b01b-29728a55706d tempest-VolumesCloneTest-564216729 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-382fd989-489c-4a40-bc1b-270f967814cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86553) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 09:34:54 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa4b5584-a026-4ec0-9263-7e64995d6d58]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:34:54 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-7f104744-bd6d-4e59-b01b-29728a55706d tempest-VolumesCloneTest-564216729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-382fd989-489c-4a40-bc1b-270f967814cc {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:54 devstack sudo[101905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-382fd989-489c-4a40-bc1b-270f967814cc Sep 28 09:34:54 devstack sudo[101905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:54 devstack sudo[101901]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:54 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f1e78662-85f8-4ac2-913f-56e63ff02d32 tempest-VolumesExtendTest-1714634620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3a62616e-b6b3-4b19-a1a2-a2c50a84d38d" returned: 0 in 0.351s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:54 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-f1e78662-85f8-4ac2-913f-56e63ff02d32 tempest-VolumesExtendTest-1714634620 None] Lock "cinder-quobyte-3a62616e-b6b3-4b19-a1a2-a2c50a84d38d" released by "delete_volume" :: held 1.105s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:34:54 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-f1e78662-85f8-4ac2-913f-56e63ff02d32 tempest-VolumesExtendTest-1714634620 None] Created reservations ['2de0b523-72d0-471c-9418-40f6e74ad45e', '3c954fb6-424a-4cba-b3d7-0ddb5a27f6f9', 'c29d0da5-d19e-452d-b7d5-015bdaae688b', 'f24e75b5-137e-40d0-bf1a-90767e831536'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:34:54 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-f1e78662-85f8-4ac2-913f-56e63ff02d32 tempest-VolumesExtendTest-1714634620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:34:54 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-f1e78662-85f8-4ac2-913f-56e63ff02d32 tempest-VolumesExtendTest-1714634620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:34:54 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-f1e78662-85f8-4ac2-913f-56e63ff02d32 tempest-VolumesExtendTest-1714634620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:34:54 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-f1e78662-85f8-4ac2-913f-56e63ff02d32 tempest-VolumesExtendTest-1714634620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:34:54 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-f1e78662-85f8-4ac2-913f-56e63ff02d32 tempest-VolumesExtendTest-1714634620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:34:54 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f1e78662-85f8-4ac2-913f-56e63ff02d32 tempest-VolumesExtendTest-1714634620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:54 devstack sudo[101908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:34:54 devstack sudo[101908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:54 devstack sudo[101905]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:54 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-7f104744-bd6d-4e59-b01b-29728a55706d tempest-VolumesCloneTest-564216729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-382fd989-489c-4a40-bc1b-270f967814cc" returned: 0 in 0.647s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:54 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-7f104744-bd6d-4e59-b01b-29728a55706d tempest-VolumesCloneTest-564216729 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-382fd989-489c-4a40-bc1b-270f967814cc {{(pid=86553) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 09:34:54 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-7f104744-bd6d-4e59-b01b-29728a55706d tempest-VolumesCloneTest-564216729 None] Creating direct copy from snapshot {{(pid=86553) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 09:34:54 devstack cinder-volume[86553]: DEBUG cinder.utils [None req-7f104744-bd6d-4e59-b01b-29728a55706d tempest-VolumesCloneTest-564216729 None] Path /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-343d284c-5566-4990-819b-a01e7227e2e3 not found in is_blk_device check {{(pid=86553) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 09:34:54 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-7f104744-bd6d-4e59-b01b-29728a55706d tempest-VolumesCloneTest-564216729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-382fd989-489c-4a40-bc1b-270f967814cc /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-343d284c-5566-4990-819b-a01e7227e2e3 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:34:54 devstack sudo[101914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-382fd989-489c-4a40-bc1b-270f967814cc /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-343d284c-5566-4990-819b-a01e7227e2e3 Sep 28 09:34:54 devstack sudo[101914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:34:54 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-683821c3-65e2-4ab1-9c24-87fd3d49133b tempest-TestImageHashVerification-1780440429 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:34:54 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-683821c3-65e2-4ab1-9c24-87fd3d49133b tempest-TestImageHashVerification-1780440429 None] Flow 'volume_create_manager' (72cdc029-7cad-410b-b8e3-5c0d37c1e31c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:34:54 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-683821c3-65e2-4ab1-9c24-87fd3d49133b tempest-TestImageHashVerification-1780440429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d9cf4aa-38e2-47c6-8b3a-c4185a716de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:34:54 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-683821c3-65e2-4ab1-9c24-87fd3d49133b tempest-TestImageHashVerification-1780440429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d9cf4aa-38e2-47c6-8b3a-c4185a716de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:34:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-784727065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47721ef3-5835-4e6f-aba9-7578315f2959,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='599642fb171e41bb9cfed9c5232a2b22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:34:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:34:55Z,use_quota=True,user_id='349a2f8987cd4ae893c5052fc00697ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:34:54 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-683821c3-65e2-4ab1-9c24-87fd3d49133b tempest-TestImageHashVerification-1780440429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af1bc558-1a89-4e85-a69a-b327e95cf545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:34:54 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-683821c3-65e2-4ab1-9c24-87fd3d49133b tempest-TestImageHashVerification-1780440429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af1bc558-1a89-4e85-a69a-b327e95cf545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:34:54 devstack sudo[101908]: pam_unix(sudo:session): session closed for user root Sep 28 09:34:54 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-683821c3-65e2-4ab1-9c24-87fd3d49133b tempest-TestImageHashVerification-1780440429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ec5b596-90be-4d66-9626-2e587eba9ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:34:54 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-683821c3-65e2-4ab1-9c24-87fd3d49133b tempest-TestImageHashVerification-1780440429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ec5b596-90be-4d66-9626-2e587eba9ebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47721ef3-5835-4e6f-aba9-7578315f2959', 'volume_name': 'volume-47721ef3-5835-4e6f-aba9-7578315f2959', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:34:54 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-683821c3-65e2-4ab1-9c24-87fd3d49133b tempest-TestImageHashVerification-1780440429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a8c13cb-80f4-4bad-a808-e51c2d4c7949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:34:54 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-683821c3-65e2-4ab1-9c24-87fd3d49133b tempest-TestImageHashVerification-1780440429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a8c13cb-80f4-4bad-a808-e51c2d4c7949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:34:54 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-683821c3-65e2-4ab1-9c24-87fd3d49133b tempest-TestImageHashVerification-1780440429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ff1acf4-215b-4f16-bf5d-81bd5f6755cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:34:54 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-683821c3-65e2-4ab1-9c24-87fd3d49133b tempest-TestImageHashVerification-1780440429 None] Volume 47721ef3-5835-4e6f-aba9-7578315f2959: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47721ef3-5835-4e6f-aba9-7578315f2959', 'volume_size': 1} Sep 28 09:34:54 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-683821c3-65e2-4ab1-9c24-87fd3d49133b tempest-TestImageHashVerification-1780440429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:34:54 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f1e78662-85f8-4ac2-913f-56e63ff02d32 tempest-VolumesExtendTest-1714634620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.380s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:34:54 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-f1e78662-85f8-4ac2-913f-56e63ff02d32 tempest-VolumesExtendTest-1714634620 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:34:54 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-f1e78662-85f8-4ac2-913f-56e63ff02d32 tempest-VolumesExtendTest-1714634620 None] Deleted volume successfully. Sep 28 09:34:54 devstack cinder-volume[86553]: DEBUG dbcounter [-] [86553] Writing DB stats cinder:SELECT=132,cinder:UPDATE=159,cinder:INSERT=47,cinder:DELETE=17 {{(pid=86553) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 09:34:55 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-f1e78662-85f8-4ac2-913f-56e63ff02d32 tempest-VolumesExtendTest-1714634620 None] Lock "cinder-3a62616e-b6b3-4b19-a1a2-a2c50a84d38d-delete_volume" released by "delete_volume" :: held 1.875s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:35:03 devstack cinder-volume[86553]: DEBUG dbcounter [-] [86553] Writing DB stats cinder:SELECT=136,cinder:UPDATE=174,cinder:DELETE=11,cinder:INSERT=43 {{(pid=86553) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 09:35:03 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2ecc14d-750d-4f33-8ac0-50385e6d356e tempest-VolumesGetTest-1635800146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:35:03 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b2ecc14d-750d-4f33-8ac0-50385e6d356e tempest-VolumesGetTest-1635800146 None] Flow 'volume_create_manager' (0f7b57fd-dd03-460b-9e34-f97a20428148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:35:03 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b2ecc14d-750d-4f33-8ac0-50385e6d356e tempest-VolumesGetTest-1635800146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c83656d-792d-4077-9ec4-6d393c86c792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:35:03 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b2ecc14d-750d-4f33-8ac0-50385e6d356e tempest-VolumesGetTest-1635800146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c83656d-792d-4077-9ec4-6d393c86c792) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:35:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-301772869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87b4b380-ed97-4eac-aa01-e787485d94d2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='be84b080459e458496b0d755a3c89703',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:35:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:35:03Z,use_quota=True,user_id='a7990b3b37d84bc4acd2288b34b11a7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:35:03 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b2ecc14d-750d-4f33-8ac0-50385e6d356e tempest-VolumesGetTest-1635800146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95e70f05-46e8-408e-99a3-b6f8f467b10f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:35:03 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b2ecc14d-750d-4f33-8ac0-50385e6d356e tempest-VolumesGetTest-1635800146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95e70f05-46e8-408e-99a3-b6f8f467b10f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:35:03 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b2ecc14d-750d-4f33-8ac0-50385e6d356e tempest-VolumesGetTest-1635800146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (309c13be-438e-4870-9484-6c73533c49ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:35:03 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b2ecc14d-750d-4f33-8ac0-50385e6d356e tempest-VolumesGetTest-1635800146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (309c13be-438e-4870-9484-6c73533c49ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87b4b380-ed97-4eac-aa01-e787485d94d2', 'volume_name': 'volume-87b4b380-ed97-4eac-aa01-e787485d94d2', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:35:03 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b2ecc14d-750d-4f33-8ac0-50385e6d356e tempest-VolumesGetTest-1635800146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c54d1613-968a-4920-abbf-d68514f5b03b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:35:03 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b2ecc14d-750d-4f33-8ac0-50385e6d356e tempest-VolumesGetTest-1635800146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c54d1613-968a-4920-abbf-d68514f5b03b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:35:03 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b2ecc14d-750d-4f33-8ac0-50385e6d356e tempest-VolumesGetTest-1635800146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be3d417c-7078-4b8c-83ca-f041cf127aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:35:03 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-b2ecc14d-750d-4f33-8ac0-50385e6d356e tempest-VolumesGetTest-1635800146 None] Volume 87b4b380-ed97-4eac-aa01-e787485d94d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87b4b380-ed97-4eac-aa01-e787485d94d2', 'volume_size': 1} Sep 28 09:35:03 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-b2ecc14d-750d-4f33-8ac0-50385e6d356e tempest-VolumesGetTest-1635800146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:35:03 devstack sudo[101914]: pam_unix(sudo:session): session closed for user root Sep 28 09:35:03 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-7f104744-bd6d-4e59-b01b-29728a55706d tempest-VolumesCloneTest-564216729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-382fd989-489c-4a40-bc1b-270f967814cc /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-343d284c-5566-4990-819b-a01e7227e2e3" returned: 0 in 8.554s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:35:03 devstack cinder-volume[86553]: DEBUG cinder.image.image_utils [None req-7f104744-bd6d-4e59-b01b-29728a55706d tempest-VolumesCloneTest-564216729 None] Image conversion details: src /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-382fd989-489c-4a40-bc1b-270f967814cc, size 1024.00 MB, duration 8.56 sec, destination /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-343d284c-5566-4990-819b-a01e7227e2e3 {{(pid=86553) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 09:35:03 devstack cinder-volume[86553]: INFO cinder.image.image_utils [None req-7f104744-bd6d-4e59-b01b-29728a55706d tempest-VolumesCloneTest-564216729 None] Converted 1024.00 MB image at 119.69 MB/s Sep 28 09:35:03 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-7f104744-bd6d-4e59-b01b-29728a55706d tempest-VolumesCloneTest-564216729 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-343d284c-5566-4990-819b-a01e7227e2e3 is being set with open permissions: ugo+rw Sep 28 09:35:03 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-7f104744-bd6d-4e59-b01b-29728a55706d tempest-VolumesCloneTest-564216729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-343d284c-5566-4990-819b-a01e7227e2e3 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:35:03 devstack sudo[101934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-343d284c-5566-4990-819b-a01e7227e2e3 Sep 28 09:35:03 devstack sudo[101934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:35:03 devstack sudo[101934]: pam_unix(sudo:session): session closed for user root Sep 28 09:35:03 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-7f104744-bd6d-4e59-b01b-29728a55706d tempest-VolumesCloneTest-564216729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-343d284c-5566-4990-819b-a01e7227e2e3" returned: 0 in 0.278s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:35:03 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-7f104744-bd6d-4e59-b01b-29728a55706d tempest-VolumesCloneTest-564216729 None] Lock "cinder-quobyte-343d284c-5566-4990-819b-a01e7227e2e3" released by "_copy_volume_from_snapshot" :: held 10.029s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:35:03 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-7f104744-bd6d-4e59-b01b-29728a55706d tempest-VolumesCloneTest-564216729 None] Acquiring lock "cinder-quobyte-2b50c330-aa2d-474f-9f4f-773c4e45f617" by "_delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:35:03 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-7f104744-bd6d-4e59-b01b-29728a55706d tempest-VolumesCloneTest-564216729 None] Lock "cinder-quobyte-2b50c330-aa2d-474f-9f4f-773c4e45f617" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:35:03 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-7f104744-bd6d-4e59-b01b-29728a55706d tempest-VolumesCloneTest-564216729 None] Deleting offline snapshot 2b50c330-aa2d-474f-9f4f-773c4e45f617 of volume 382fd989-489c-4a40-bc1b-270f967814cc {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 09:35:03 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-7f104744-bd6d-4e59-b01b-29728a55706d tempest-VolumesCloneTest-564216729 None] snapshot_file for this snap is: volume-382fd989-489c-4a40-bc1b-270f967814cc.2b50c330-aa2d-474f-9f4f-773c4e45f617 {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 09:35:03 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c54f89-aefc-49e4-a114-83ac024346e1]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:35:03 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-7f104744-bd6d-4e59-b01b-29728a55706d tempest-VolumesCloneTest-564216729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-382fd989-489c-4a40-bc1b-270f967814cc.2b50c330-aa2d-474f-9f4f-773c4e45f617 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:35:03 devstack sudo[101937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-382fd989-489c-4a40-bc1b-270f967814cc.2b50c330-aa2d-474f-9f4f-773c4e45f617 Sep 28 09:35:03 devstack sudo[101937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:35:04 devstack sudo[101937]: pam_unix(sudo:session): session closed for user root Sep 28 09:35:04 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-7f104744-bd6d-4e59-b01b-29728a55706d tempest-VolumesCloneTest-564216729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-382fd989-489c-4a40-bc1b-270f967814cc.2b50c330-aa2d-474f-9f4f-773c4e45f617" returned: 0 in 0.414s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:35:04 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-7f104744-bd6d-4e59-b01b-29728a55706d tempest-VolumesCloneTest-564216729 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-382fd989-489c-4a40-bc1b-270f967814cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86553) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 09:35:04 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[70ab2caf-2645-4e6f-9314-7faa82cc58cd]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:35:04 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-7f104744-bd6d-4e59-b01b-29728a55706d tempest-VolumesCloneTest-564216729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-382fd989-489c-4a40-bc1b-270f967814cc {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:35:04 devstack sudo[101942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-382fd989-489c-4a40-bc1b-270f967814cc Sep 28 09:35:04 devstack sudo[101942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:35:04 devstack sudo[101942]: pam_unix(sudo:session): session closed for user root Sep 28 09:35:04 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-7f104744-bd6d-4e59-b01b-29728a55706d tempest-VolumesCloneTest-564216729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-382fd989-489c-4a40-bc1b-270f967814cc" returned: 0 in 0.619s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:35:04 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-7f104744-bd6d-4e59-b01b-29728a55706d tempest-VolumesCloneTest-564216729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-382fd989-489c-4a40-bc1b-270f967814cc.2b50c330-aa2d-474f-9f4f-773c4e45f617 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:35:04 devstack sudo[101948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-382fd989-489c-4a40-bc1b-270f967814cc.2b50c330-aa2d-474f-9f4f-773c4e45f617 Sep 28 09:35:04 devstack sudo[101948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:35:05 devstack sudo[101948]: pam_unix(sudo:session): session closed for user root Sep 28 09:35:05 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-7f104744-bd6d-4e59-b01b-29728a55706d tempest-VolumesCloneTest-564216729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-382fd989-489c-4a40-bc1b-270f967814cc.2b50c330-aa2d-474f-9f4f-773c4e45f617" returned: 0 in 0.405s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:35:05 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-7f104744-bd6d-4e59-b01b-29728a55706d tempest-VolumesCloneTest-564216729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-382fd989-489c-4a40-bc1b-270f967814cc.2b50c330-aa2d-474f-9f4f-773c4e45f617 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:35:05 devstack sudo[101954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-382fd989-489c-4a40-bc1b-270f967814cc.2b50c330-aa2d-474f-9f4f-773c4e45f617 Sep 28 09:35:05 devstack sudo[101954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:35:05 devstack sudo[101954]: pam_unix(sudo:session): session closed for user root Sep 28 09:35:05 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-7f104744-bd6d-4e59-b01b-29728a55706d tempest-VolumesCloneTest-564216729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-382fd989-489c-4a40-bc1b-270f967814cc.2b50c330-aa2d-474f-9f4f-773c4e45f617" returned: 0 in 0.276s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:35:05 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-7f104744-bd6d-4e59-b01b-29728a55706d tempest-VolumesCloneTest-564216729 None] Lock "cinder-quobyte-2b50c330-aa2d-474f-9f4f-773c4e45f617" released by "_delete_snapshot" :: held 1.840s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:35:05 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-7f104744-bd6d-4e59-b01b-29728a55706d tempest-VolumesCloneTest-564216729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.920s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:35:05 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-683821c3-65e2-4ab1-9c24-87fd3d49133b tempest-TestImageHashVerification-1780440429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.590s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:35:05 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-683821c3-65e2-4ab1-9c24-87fd3d49133b tempest-TestImageHashVerification-1780440429 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:34:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-784727065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47721ef3-5835-4e6f-aba9-7578315f2959,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='599642fb171e41bb9cfed9c5232a2b22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:34:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:34:55Z,use_quota=True,user_id='349a2f8987cd4ae893c5052fc00697ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:35:05 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-683821c3-65e2-4ab1-9c24-87fd3d49133b tempest-TestImageHashVerification-1780440429 None] Creating volume 47721ef3-5835-4e6f-aba9-7578315f2959 {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:35:05 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-683821c3-65e2-4ab1-9c24-87fd3d49133b tempest-TestImageHashVerification-1780440429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:35:05 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-683821c3-65e2-4ab1-9c24-87fd3d49133b tempest-TestImageHashVerification-1780440429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:35:05 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-683821c3-65e2-4ab1-9c24-87fd3d49133b tempest-TestImageHashVerification-1780440429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:35:05 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-683821c3-65e2-4ab1-9c24-87fd3d49133b tempest-TestImageHashVerification-1780440429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:35:05 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-683821c3-65e2-4ab1-9c24-87fd3d49133b tempest-TestImageHashVerification-1780440429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:35:05 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-683821c3-65e2-4ab1-9c24-87fd3d49133b tempest-TestImageHashVerification-1780440429 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:35:05 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-683821c3-65e2-4ab1-9c24-87fd3d49133b tempest-TestImageHashVerification-1780440429 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:35:05 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-683821c3-65e2-4ab1-9c24-87fd3d49133b tempest-TestImageHashVerification-1780440429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-47721ef3-5835-4e6f-aba9-7578315f2959 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:35:05 devstack sudo[101957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-47721ef3-5835-4e6f-aba9-7578315f2959 1073741824 Sep 28 09:35:05 devstack sudo[101957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:35:05 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7f104744-bd6d-4e59-b01b-29728a55706d tempest-VolumesCloneTest-564216729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3b55880-3ef8-422a-b500-f2951ce17f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-343d284c-5566-4990-819b-a01e7227e2e3', 'volume_size': 2, 'source_volid': '382fd989-489c-4a40-bc1b-270f967814cc', 'source_volstatus': 'available'}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:35:05 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7f104744-bd6d-4e59-b01b-29728a55706d tempest-VolumesCloneTest-564216729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8419a597-9c9c-446d-81e2-f0232c616471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:35:05 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-7f104744-bd6d-4e59-b01b-29728a55706d tempest-VolumesCloneTest-564216729 None] Volume volume-343d284c-5566-4990-819b-a01e7227e2e3 (343d284c-5566-4990-819b-a01e7227e2e3): created successfully Sep 28 09:35:05 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7f104744-bd6d-4e59-b01b-29728a55706d tempest-VolumesCloneTest-564216729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8419a597-9c9c-446d-81e2-f0232c616471) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:35:05 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7f104744-bd6d-4e59-b01b-29728a55706d tempest-VolumesCloneTest-564216729 None] Flow 'volume_create_manager' (8dae1891-f3dc-4b7a-a95b-b631c582de62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:35:05 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-7f104744-bd6d-4e59-b01b-29728a55706d tempest-VolumesCloneTest-564216729 None] Created volume successfully. Sep 28 09:35:06 devstack sudo[101957]: pam_unix(sudo:session): session closed for user root Sep 28 09:35:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-683821c3-65e2-4ab1-9c24-87fd3d49133b tempest-TestImageHashVerification-1780440429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-47721ef3-5835-4e6f-aba9-7578315f2959 1073741824" returned: 0 in 0.513s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:35:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-683821c3-65e2-4ab1-9c24-87fd3d49133b tempest-TestImageHashVerification-1780440429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-47721ef3-5835-4e6f-aba9-7578315f2959 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:35:06 devstack sudo[101963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-47721ef3-5835-4e6f-aba9-7578315f2959 Sep 28 09:35:06 devstack sudo[101963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:35:06 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-3875203e-221e-421c-a09b-d6207c51ba66 tempest-VolumesCloneTest-564216729 None] Acquiring lock "cinder-343d284c-5566-4990-819b-a01e7227e2e3-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:35:06 devstack sudo[101963]: pam_unix(sudo:session): session closed for user root Sep 28 09:35:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-683821c3-65e2-4ab1-9c24-87fd3d49133b tempest-TestImageHashVerification-1780440429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-47721ef3-5835-4e6f-aba9-7578315f2959" returned: 0 in 0.307s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:35:06 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-683821c3-65e2-4ab1-9c24-87fd3d49133b tempest-TestImageHashVerification-1780440429 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:35:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-683821c3-65e2-4ab1-9c24-87fd3d49133b tempest-TestImageHashVerification-1780440429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:35:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-b2ecc14d-750d-4f33-8ac0-50385e6d356e tempest-VolumesGetTest-1635800146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.128s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:35:06 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-b2ecc14d-750d-4f33-8ac0-50385e6d356e tempest-VolumesGetTest-1635800146 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:35:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-301772869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87b4b380-ed97-4eac-aa01-e787485d94d2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='be84b080459e458496b0d755a3c89703',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:35:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:35:03Z,use_quota=True,user_id='a7990b3b37d84bc4acd2288b34b11a7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:35:06 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-b2ecc14d-750d-4f33-8ac0-50385e6d356e tempest-VolumesGetTest-1635800146 None] Creating volume 87b4b380-ed97-4eac-aa01-e787485d94d2 {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:35:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-b2ecc14d-750d-4f33-8ac0-50385e6d356e tempest-VolumesGetTest-1635800146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:35:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-b2ecc14d-750d-4f33-8ac0-50385e6d356e tempest-VolumesGetTest-1635800146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:35:06 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-b2ecc14d-750d-4f33-8ac0-50385e6d356e tempest-VolumesGetTest-1635800146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:35:06 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-b2ecc14d-750d-4f33-8ac0-50385e6d356e tempest-VolumesGetTest-1635800146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:35:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-b2ecc14d-750d-4f33-8ac0-50385e6d356e tempest-VolumesGetTest-1635800146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:35:06 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-b2ecc14d-750d-4f33-8ac0-50385e6d356e tempest-VolumesGetTest-1635800146 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:35:06 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-b2ecc14d-750d-4f33-8ac0-50385e6d356e tempest-VolumesGetTest-1635800146 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:35:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b2ecc14d-750d-4f33-8ac0-50385e6d356e tempest-VolumesGetTest-1635800146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-87b4b380-ed97-4eac-aa01-e787485d94d2 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:35:06 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-683821c3-65e2-4ab1-9c24-87fd3d49133b tempest-TestImageHashVerification-1780440429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ff1acf4-215b-4f16-bf5d-81bd5f6755cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47721ef3-5835-4e6f-aba9-7578315f2959', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:35:06 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-683821c3-65e2-4ab1-9c24-87fd3d49133b tempest-TestImageHashVerification-1780440429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3b58954-59e2-4c6a-a694-94d5383a0f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:35:06 devstack sudo[101966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-87b4b380-ed97-4eac-aa01-e787485d94d2 1073741824 Sep 28 09:35:06 devstack sudo[101966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:35:06 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-3875203e-221e-421c-a09b-d6207c51ba66 tempest-VolumesCloneTest-564216729 None] Lock "cinder-343d284c-5566-4990-819b-a01e7227e2e3-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:35:06 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-683821c3-65e2-4ab1-9c24-87fd3d49133b tempest-TestImageHashVerification-1780440429 None] Volume volume-47721ef3-5835-4e6f-aba9-7578315f2959 (47721ef3-5835-4e6f-aba9-7578315f2959): created successfully Sep 28 09:35:06 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-683821c3-65e2-4ab1-9c24-87fd3d49133b tempest-TestImageHashVerification-1780440429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3b58954-59e2-4c6a-a694-94d5383a0f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:35:06 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-683821c3-65e2-4ab1-9c24-87fd3d49133b tempest-TestImageHashVerification-1780440429 None] Flow 'volume_create_manager' (72cdc029-7cad-410b-b8e3-5c0d37c1e31c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:35:06 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-683821c3-65e2-4ab1-9c24-87fd3d49133b tempest-TestImageHashVerification-1780440429 None] Created volume successfully. Sep 28 09:35:06 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-3875203e-221e-421c-a09b-d6207c51ba66 tempest-VolumesCloneTest-564216729 None] Acquiring lock "cinder-quobyte-343d284c-5566-4990-819b-a01e7227e2e3" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:35:06 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-3875203e-221e-421c-a09b-d6207c51ba66 tempest-VolumesCloneTest-564216729 None] Lock "cinder-quobyte-343d284c-5566-4990-819b-a01e7227e2e3" acquired by "delete_volume" :: waited 0.023s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:35:06 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[33539ec5-297b-4643-8406-9deceb25a888]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:35:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3875203e-221e-421c-a09b-d6207c51ba66 tempest-VolumesCloneTest-564216729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-343d284c-5566-4990-819b-a01e7227e2e3 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:35:06 devstack sudo[101968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-343d284c-5566-4990-819b-a01e7227e2e3 Sep 28 09:35:06 devstack sudo[101968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:35:06 devstack sudo[101966]: pam_unix(sudo:session): session closed for user root Sep 28 09:35:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b2ecc14d-750d-4f33-8ac0-50385e6d356e tempest-VolumesGetTest-1635800146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-87b4b380-ed97-4eac-aa01-e787485d94d2 1073741824" returned: 0 in 0.549s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:35:07 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b2ecc14d-750d-4f33-8ac0-50385e6d356e tempest-VolumesGetTest-1635800146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-87b4b380-ed97-4eac-aa01-e787485d94d2 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:35:07 devstack sudo[101968]: pam_unix(sudo:session): session closed for user root Sep 28 09:35:07 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3875203e-221e-421c-a09b-d6207c51ba66 tempest-VolumesCloneTest-564216729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-343d284c-5566-4990-819b-a01e7227e2e3" returned: 0 in 0.451s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:35:07 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3875203e-221e-421c-a09b-d6207c51ba66 tempest-VolumesCloneTest-564216729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-343d284c-5566-4990-819b-a01e7227e2e3 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:35:07 devstack sudo[101977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-87b4b380-ed97-4eac-aa01-e787485d94d2 Sep 28 09:35:07 devstack sudo[101977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:35:07 devstack sudo[101978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-343d284c-5566-4990-819b-a01e7227e2e3 Sep 28 09:35:07 devstack sudo[101978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:35:07 devstack sudo[101977]: pam_unix(sudo:session): session closed for user root Sep 28 09:35:07 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b2ecc14d-750d-4f33-8ac0-50385e6d356e tempest-VolumesGetTest-1635800146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-87b4b380-ed97-4eac-aa01-e787485d94d2" returned: 0 in 0.361s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:35:07 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-b2ecc14d-750d-4f33-8ac0-50385e6d356e tempest-VolumesGetTest-1635800146 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:35:07 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-b2ecc14d-750d-4f33-8ac0-50385e6d356e tempest-VolumesGetTest-1635800146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:35:07 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b2ecc14d-750d-4f33-8ac0-50385e6d356e tempest-VolumesGetTest-1635800146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be3d417c-7078-4b8c-83ca-f041cf127aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87b4b380-ed97-4eac-aa01-e787485d94d2', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:35:07 devstack sudo[101978]: pam_unix(sudo:session): session closed for user root Sep 28 09:35:07 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b2ecc14d-750d-4f33-8ac0-50385e6d356e tempest-VolumesGetTest-1635800146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68fe1039-0161-49f0-bc5e-30a44d49edbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:35:07 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3875203e-221e-421c-a09b-d6207c51ba66 tempest-VolumesCloneTest-564216729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-343d284c-5566-4990-819b-a01e7227e2e3" returned: 0 in 0.384s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:35:07 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-3875203e-221e-421c-a09b-d6207c51ba66 tempest-VolumesCloneTest-564216729 None] Lock "cinder-quobyte-343d284c-5566-4990-819b-a01e7227e2e3" released by "delete_volume" :: held 0.914s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:35:07 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-b2ecc14d-750d-4f33-8ac0-50385e6d356e tempest-VolumesGetTest-1635800146 None] Volume volume-87b4b380-ed97-4eac-aa01-e787485d94d2 (87b4b380-ed97-4eac-aa01-e787485d94d2): created successfully Sep 28 09:35:07 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b2ecc14d-750d-4f33-8ac0-50385e6d356e tempest-VolumesGetTest-1635800146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68fe1039-0161-49f0-bc5e-30a44d49edbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:35:07 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b2ecc14d-750d-4f33-8ac0-50385e6d356e tempest-VolumesGetTest-1635800146 None] Flow 'volume_create_manager' (0f7b57fd-dd03-460b-9e34-f97a20428148) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:35:07 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-b2ecc14d-750d-4f33-8ac0-50385e6d356e tempest-VolumesGetTest-1635800146 None] Created volume successfully. Sep 28 09:35:07 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-3875203e-221e-421c-a09b-d6207c51ba66 tempest-VolumesCloneTest-564216729 None] Created reservations ['84095e30-d919-4a4e-8dd5-a59cd04b6910', 'ccd56d04-ed54-4bed-a818-9dfcecd743ef', '73c33ba0-f136-4a16-a08b-6b3574804498', '6255f808-ac97-4cbe-8825-5c2f26372c0f'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:35:07 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-3875203e-221e-421c-a09b-d6207c51ba66 tempest-VolumesCloneTest-564216729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:35:07 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-3875203e-221e-421c-a09b-d6207c51ba66 tempest-VolumesCloneTest-564216729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:35:07 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-3875203e-221e-421c-a09b-d6207c51ba66 tempest-VolumesCloneTest-564216729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:35:07 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-3875203e-221e-421c-a09b-d6207c51ba66 tempest-VolumesCloneTest-564216729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:35:07 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-3875203e-221e-421c-a09b-d6207c51ba66 tempest-VolumesCloneTest-564216729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:35:07 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3875203e-221e-421c-a09b-d6207c51ba66 tempest-VolumesCloneTest-564216729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:35:07 devstack sudo[101984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:35:07 devstack sudo[101984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:35:08 devstack sudo[101984]: pam_unix(sudo:session): session closed for user root Sep 28 09:35:08 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3875203e-221e-421c-a09b-d6207c51ba66 tempest-VolumesCloneTest-564216729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.294s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:35:08 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-3875203e-221e-421c-a09b-d6207c51ba66 tempest-VolumesCloneTest-564216729 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:35:08 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-3875203e-221e-421c-a09b-d6207c51ba66 tempest-VolumesCloneTest-564216729 None] Deleted volume successfully. Sep 28 09:35:08 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-3875203e-221e-421c-a09b-d6207c51ba66 tempest-VolumesCloneTest-564216729 None] Lock "cinder-343d284c-5566-4990-819b-a01e7227e2e3-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:35:08 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-4020ea1f-5526-4995-b448-c23864cf28a1 tempest-TestImageHashVerification-1780440429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:35:08 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-4020ea1f-5526-4995-b448-c23864cf28a1 tempest-TestImageHashVerification-1780440429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:35:08 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b744f95-f85b-47e0-bd59-c55b77c6d73e]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:35:08 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-4020ea1f-5526-4995-b448-c23864cf28a1 tempest-TestImageHashVerification-1780440429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-47721ef3-5835-4e6f-aba9-7578315f2959 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:35:08 devstack sudo[101987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-47721ef3-5835-4e6f-aba9-7578315f2959 Sep 28 09:35:08 devstack sudo[101987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:35:08 devstack sudo[101987]: pam_unix(sudo:session): session closed for user root Sep 28 09:35:08 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-4020ea1f-5526-4995-b448-c23864cf28a1 tempest-TestImageHashVerification-1780440429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-47721ef3-5835-4e6f-aba9-7578315f2959" returned: 0 in 0.412s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:35:08 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[78923710-6d2c-4fe4-93cf-11402e33b6de]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:35:08 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-4020ea1f-5526-4995-b448-c23864cf28a1 tempest-TestImageHashVerification-1780440429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-47721ef3-5835-4e6f-aba9-7578315f2959 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:35:08 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-f5f85410-1ff9-4621-9700-58a63d247874 tempest-VolumesCloneTest-564216729 None] Acquiring lock "cinder-382fd989-489c-4a40-bc1b-270f967814cc-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:35:08 devstack sudo[101993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-47721ef3-5835-4e6f-aba9-7578315f2959 Sep 28 09:35:08 devstack sudo[101993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:35:08 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-f5f85410-1ff9-4621-9700-58a63d247874 tempest-VolumesCloneTest-564216729 None] Lock "cinder-382fd989-489c-4a40-bc1b-270f967814cc-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:35:08 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-f5f85410-1ff9-4621-9700-58a63d247874 tempest-VolumesCloneTest-564216729 None] Acquiring lock "cinder-quobyte-382fd989-489c-4a40-bc1b-270f967814cc" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:35:08 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-f5f85410-1ff9-4621-9700-58a63d247874 tempest-VolumesCloneTest-564216729 None] Lock "cinder-quobyte-382fd989-489c-4a40-bc1b-270f967814cc" acquired by "delete_volume" :: waited 0.024s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:35:09 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c92aab-a34c-4613-906a-bdb0026ce85e]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:35:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f5f85410-1ff9-4621-9700-58a63d247874 tempest-VolumesCloneTest-564216729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-382fd989-489c-4a40-bc1b-270f967814cc {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:35:09 devstack sudo[101993]: pam_unix(sudo:session): session closed for user root Sep 28 09:35:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-4020ea1f-5526-4995-b448-c23864cf28a1 tempest-TestImageHashVerification-1780440429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-47721ef3-5835-4e6f-aba9-7578315f2959" returned: 0 in 0.491s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:35:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-4020ea1f-5526-4995-b448-c23864cf28a1 tempest-TestImageHashVerification-1780440429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-47721ef3-5835-4e6f-aba9-7578315f2959 /opt/stack/data/cinder/conversion/47721ef3-5835-4e6f-aba9-7578315f2959.temp_image.66e5ffba-d7ff-484b-ba6f-2ffb18f065b2u53kn_kz.img {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:35:09 devstack sudo[101995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-382fd989-489c-4a40-bc1b-270f967814cc Sep 28 09:35:09 devstack sudo[101995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:35:09 devstack sudo[102000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-47721ef3-5835-4e6f-aba9-7578315f2959 /opt/stack/data/cinder/conversion/47721ef3-5835-4e6f-aba9-7578315f2959.temp_image.66e5ffba-d7ff-484b-ba6f-2ffb18f065b2u53kn_kz.img Sep 28 09:35:09 devstack sudo[102000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:35:09 devstack sudo[101995]: pam_unix(sudo:session): session closed for user root Sep 28 09:35:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f5f85410-1ff9-4621-9700-58a63d247874 tempest-VolumesCloneTest-564216729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-382fd989-489c-4a40-bc1b-270f967814cc" returned: 0 in 0.644s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:35:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f5f85410-1ff9-4621-9700-58a63d247874 tempest-VolumesCloneTest-564216729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-382fd989-489c-4a40-bc1b-270f967814cc {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:35:09 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-69b156f9-772a-4e78-94ad-73d561993554 tempest-VolumesGetTest-1635800146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:35:09 devstack sudo[102015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-382fd989-489c-4a40-bc1b-270f967814cc Sep 28 09:35:09 devstack sudo[102015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:35:09 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-69b156f9-772a-4e78-94ad-73d561993554 tempest-VolumesGetTest-1635800146 None] Flow 'volume_create_manager' (9d2f041d-63f2-4b59-bae1-38ad46c5bd15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:35:09 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-69b156f9-772a-4e78-94ad-73d561993554 tempest-VolumesGetTest-1635800146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fff5af8a-d058-4ac7-970e-49b8e0fc3a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:35:09 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-69b156f9-772a-4e78-94ad-73d561993554 tempest-VolumesGetTest-1635800146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fff5af8a-d058-4ac7-970e-49b8e0fc3a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:35:09Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1181348856',display_name='tempest-VolumesGetTest-Volume-539756043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=530a4cba-cf57-43ef-93af-ddce954eecc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be84b080459e458496b0d755a3c89703',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:35:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:35:10Z,use_quota=True,user_id='a7990b3b37d84bc4acd2288b34b11a7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:35:09 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-69b156f9-772a-4e78-94ad-73d561993554 tempest-VolumesGetTest-1635800146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c98555c6-641d-4576-a081-d2b54292e7d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:35:09 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-69b156f9-772a-4e78-94ad-73d561993554 tempest-VolumesGetTest-1635800146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c98555c6-641d-4576-a081-d2b54292e7d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:35:09 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-69b156f9-772a-4e78-94ad-73d561993554 tempest-VolumesGetTest-1635800146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d95a6e8c-9054-4f96-97fe-8976efa509d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:35:09 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-69b156f9-772a-4e78-94ad-73d561993554 tempest-VolumesGetTest-1635800146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d95a6e8c-9054-4f96-97fe-8976efa509d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '530a4cba-cf57-43ef-93af-ddce954eecc3', 'volume_name': 'volume-530a4cba-cf57-43ef-93af-ddce954eecc3', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:35:09 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-69b156f9-772a-4e78-94ad-73d561993554 tempest-VolumesGetTest-1635800146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d4409b3-7368-4dd8-a2f2-861a8e875c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:35:09 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-69b156f9-772a-4e78-94ad-73d561993554 tempest-VolumesGetTest-1635800146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d4409b3-7368-4dd8-a2f2-861a8e875c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:35:09 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-69b156f9-772a-4e78-94ad-73d561993554 tempest-VolumesGetTest-1635800146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33392d85-da1f-4d4a-be6e-544a5c956aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:35:09 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-69b156f9-772a-4e78-94ad-73d561993554 tempest-VolumesGetTest-1635800146 None] Volume 530a4cba-cf57-43ef-93af-ddce954eecc3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-530a4cba-cf57-43ef-93af-ddce954eecc3', 'volume_size': 1} Sep 28 09:35:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-69b156f9-772a-4e78-94ad-73d561993554 tempest-VolumesGetTest-1635800146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:35:10 devstack sudo[102015]: pam_unix(sudo:session): session closed for user root Sep 28 09:35:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f5f85410-1ff9-4621-9700-58a63d247874 tempest-VolumesCloneTest-564216729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-382fd989-489c-4a40-bc1b-270f967814cc" returned: 0 in 0.657s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:35:10 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-f5f85410-1ff9-4621-9700-58a63d247874 tempest-VolumesCloneTest-564216729 None] Lock "cinder-quobyte-382fd989-489c-4a40-bc1b-270f967814cc" released by "delete_volume" :: held 1.439s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:35:10 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-f5f85410-1ff9-4621-9700-58a63d247874 tempest-VolumesCloneTest-564216729 None] Created reservations ['749beb65-8807-4a45-81d1-306292906b82', 'be41770c-db42-4e5a-8eec-cc69a8fd850d', '17622110-5e39-471b-9adf-4c4c85528141', 'd6c84572-0760-4c8a-a792-7d39e62ef106'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:35:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-f5f85410-1ff9-4621-9700-58a63d247874 tempest-VolumesCloneTest-564216729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:35:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-f5f85410-1ff9-4621-9700-58a63d247874 tempest-VolumesCloneTest-564216729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:35:10 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-f5f85410-1ff9-4621-9700-58a63d247874 tempest-VolumesCloneTest-564216729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:35:10 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-f5f85410-1ff9-4621-9700-58a63d247874 tempest-VolumesCloneTest-564216729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:35:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-f5f85410-1ff9-4621-9700-58a63d247874 tempest-VolumesCloneTest-564216729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:35:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f5f85410-1ff9-4621-9700-58a63d247874 tempest-VolumesCloneTest-564216729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:35:10 devstack sudo[102019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:35:10 devstack sudo[102019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:35:10 devstack sudo[102019]: pam_unix(sudo:session): session closed for user root Sep 28 09:35:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f5f85410-1ff9-4621-9700-58a63d247874 tempest-VolumesCloneTest-564216729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.361s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:35:10 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-f5f85410-1ff9-4621-9700-58a63d247874 tempest-VolumesCloneTest-564216729 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:35:10 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-f5f85410-1ff9-4621-9700-58a63d247874 tempest-VolumesCloneTest-564216729 None] Deleted volume successfully. Sep 28 09:35:11 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-f5f85410-1ff9-4621-9700-58a63d247874 tempest-VolumesCloneTest-564216729 None] Lock "cinder-382fd989-489c-4a40-bc1b-270f967814cc-delete_volume" released by "delete_volume" :: held 2.207s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:35:17 devstack sudo[102000]: pam_unix(sudo:session): session closed for user root Sep 28 09:35:17 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-4020ea1f-5526-4995-b448-c23864cf28a1 tempest-TestImageHashVerification-1780440429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-47721ef3-5835-4e6f-aba9-7578315f2959 /opt/stack/data/cinder/conversion/47721ef3-5835-4e6f-aba9-7578315f2959.temp_image.66e5ffba-d7ff-484b-ba6f-2ffb18f065b2u53kn_kz.img" returned: 0 in 8.471s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:35:17 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[719e4887-ef3e-4fe4-88e8-24997ebadb92]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:35:17 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-4020ea1f-5526-4995-b448-c23864cf28a1 tempest-TestImageHashVerification-1780440429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-47721ef3-5835-4e6f-aba9-7578315f2959 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:35:17 devstack sudo[102023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-47721ef3-5835-4e6f-aba9-7578315f2959 Sep 28 09:35:17 devstack sudo[102023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:35:18 devstack sudo[102023]: pam_unix(sudo:session): session closed for user root Sep 28 09:35:18 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-4020ea1f-5526-4995-b448-c23864cf28a1 tempest-TestImageHashVerification-1780440429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-47721ef3-5835-4e6f-aba9-7578315f2959" returned: 0 in 0.585s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:35:18 devstack cinder-volume[86553]: DEBUG cinder.image.image_utils [None req-4020ea1f-5526-4995-b448-c23864cf28a1 tempest-TestImageHashVerification-1780440429 None] Image conversion details: src /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-47721ef3-5835-4e6f-aba9-7578315f2959, size 1024.00 MB, duration 8.47 sec, destination /opt/stack/data/cinder/conversion/47721ef3-5835-4e6f-aba9-7578315f2959.temp_image.66e5ffba-d7ff-484b-ba6f-2ffb18f065b2u53kn_kz.img {{(pid=86553) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 09:35:18 devstack cinder-volume[86553]: INFO cinder.image.image_utils [None req-4020ea1f-5526-4995-b448-c23864cf28a1 tempest-TestImageHashVerification-1780440429 None] Converted 1024.00 MB image at 120.86 MB/s Sep 28 09:35:18 devstack cinder-volume[86553]: DEBUG cinder.image.image_utils [None req-4020ea1f-5526-4995-b448-c23864cf28a1 tempest-TestImageHashVerification-1780440429 None] 66e5ffba-d7ff-484b-ba6f-2ffb18f065b2 was raw, no need to convert to raw {{(pid=86553) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 28 09:35:21 devstack cinder-volume[86553]: DEBUG oslo_service.periodic_task [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86553) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 09:35:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:35:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:35:21 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:35:21 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:35:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:35:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:35:21 devstack sudo[102067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:35:21 devstack sudo[102067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:35:22 devstack sudo[102067]: pam_unix(sudo:session): session closed for user root Sep 28 09:35:22 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.490s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:35:22 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:35:22 devstack cinder-volume[86553]: DEBUG oslo_service.periodic_task [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Running periodic task VolumeManager._thread_info {{(pid=86553) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 09:35:22 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] thread count: 28 {{(pid=86553) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 09:35:22 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] thread info: [<_MainThread(MainThread, started 134684877779072)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86553) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 09:35:24 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-66908ae8-0e81-45ba-8f62-57dbb664828d tempest-VolumesSnapshotNegativeTestJSON-952146700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:35:24 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-66908ae8-0e81-45ba-8f62-57dbb664828d tempest-VolumesSnapshotNegativeTestJSON-952146700 None] Flow 'volume_create_manager' (677052f6-8ec1-4a21-ada9-19183410cfcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:35:24 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-66908ae8-0e81-45ba-8f62-57dbb664828d tempest-VolumesSnapshotNegativeTestJSON-952146700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93867545-d196-4273-8346-9a9971995818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:35:24 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-66908ae8-0e81-45ba-8f62-57dbb664828d tempest-VolumesSnapshotNegativeTestJSON-952146700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93867545-d196-4273-8346-9a9971995818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:35:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1110670517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e06d7033-36af-450b-be83-fb906157f875,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f3eafaed0ce48d794ab2b7e89dda2ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:35:25Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:35:25Z,use_quota=True,user_id='b4f8ffba5faa4e878ffc129e98a49450',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:35:24 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-66908ae8-0e81-45ba-8f62-57dbb664828d tempest-VolumesSnapshotNegativeTestJSON-952146700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc514f48-0967-4159-8d41-21b677766b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:35:24 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-66908ae8-0e81-45ba-8f62-57dbb664828d tempest-VolumesSnapshotNegativeTestJSON-952146700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc514f48-0967-4159-8d41-21b677766b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:35:24 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-66908ae8-0e81-45ba-8f62-57dbb664828d tempest-VolumesSnapshotNegativeTestJSON-952146700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7a43d01-62df-49e5-b760-daeb76c397da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:35:24 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-66908ae8-0e81-45ba-8f62-57dbb664828d tempest-VolumesSnapshotNegativeTestJSON-952146700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7a43d01-62df-49e5-b760-daeb76c397da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e06d7033-36af-450b-be83-fb906157f875', 'volume_name': 'volume-e06d7033-36af-450b-be83-fb906157f875', 'volume_size': 2}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:35:24 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-66908ae8-0e81-45ba-8f62-57dbb664828d tempest-VolumesSnapshotNegativeTestJSON-952146700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b57623f-d63d-4034-8645-e7adcb907b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:35:24 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-66908ae8-0e81-45ba-8f62-57dbb664828d tempest-VolumesSnapshotNegativeTestJSON-952146700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b57623f-d63d-4034-8645-e7adcb907b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:35:24 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-66908ae8-0e81-45ba-8f62-57dbb664828d tempest-VolumesSnapshotNegativeTestJSON-952146700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a260a450-f1bf-4647-8255-00ea8865e508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:35:24 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-66908ae8-0e81-45ba-8f62-57dbb664828d tempest-VolumesSnapshotNegativeTestJSON-952146700 None] Volume e06d7033-36af-450b-be83-fb906157f875: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e06d7033-36af-450b-be83-fb906157f875', 'volume_size': 2} Sep 28 09:35:24 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-66908ae8-0e81-45ba-8f62-57dbb664828d tempest-VolumesSnapshotNegativeTestJSON-952146700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:35:27 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-78c3f96d-51af-4742-a882-cf1637d52f76 tempest-TestShelveInstance-165027966 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:35:27 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-78c3f96d-51af-4742-a882-cf1637d52f76 tempest-TestShelveInstance-165027966 None] Flow 'volume_create_manager' (7186db98-4be1-412a-8925-63ced23ef57f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:35:27 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-78c3f96d-51af-4742-a882-cf1637d52f76 tempest-TestShelveInstance-165027966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b39872ee-f5b1-4dfd-80c1-aa4fa74f5ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:35:27 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-78c3f96d-51af-4742-a882-cf1637d52f76 tempest-TestShelveInstance-165027966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b39872ee-f5b1-4dfd-80c1-aa4fa74f5ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:35:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1531749289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57d3d311-43fc-4c70-b1dd-0cf01f63a115,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1e4453922b74c25adcafee07684e4bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:35:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:35:27Z,use_quota=True,user_id='ac3af7c5557444fdab121bc4c175f5aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:35:27 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-78c3f96d-51af-4742-a882-cf1637d52f76 tempest-TestShelveInstance-165027966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2cc4c26-c8db-44c6-a165-125ae615d493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:35:27 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-78c3f96d-51af-4742-a882-cf1637d52f76 tempest-TestShelveInstance-165027966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2cc4c26-c8db-44c6-a165-125ae615d493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:35:27 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-78c3f96d-51af-4742-a882-cf1637d52f76 tempest-TestShelveInstance-165027966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f850711-315d-4e84-8af6-8a1e979337aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:35:27 devstack cinder-volume[86553]: DEBUG cinder.image.glance [None req-78c3f96d-51af-4742-a882-cf1637d52f76 tempest-TestShelveInstance-165027966 None] Creating Keystone auth plugin from conf {{(pid=86553) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 09:35:27 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-78c3f96d-51af-4742-a882-cf1637d52f76 tempest-TestShelveInstance-165027966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f850711-315d-4e84-8af6-8a1e979337aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '57d3d311-43fc-4c70-b1dd-0cf01f63a115', 'volume_name': 'volume-57d3d311-43fc-4c70-b1dd-0cf01f63a115', 'volume_size': 1, 'image_id': '1a11c21d-88b0-4620-aa82-1ded26f580c9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1a11c21d-88b0-4620-aa82-1ded26f580c9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b800784c68dc485682fd42484c46336e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1a11c21d-88b0-4620-aa82-1ded26f580c9', 'created_at': datetime.datetime(2026, 9, 28, 7, 16, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 7, 16, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a11c21d-88b0-4620-aa82-1ded26f580c9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:35:27 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-78c3f96d-51af-4742-a882-cf1637d52f76 tempest-TestShelveInstance-165027966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdba1797-6394-45d3-aa2b-8c3f480b6b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:35:27 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-78c3f96d-51af-4742-a882-cf1637d52f76 tempest-TestShelveInstance-165027966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdba1797-6394-45d3-aa2b-8c3f480b6b9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:35:27 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-78c3f96d-51af-4742-a882-cf1637d52f76 tempest-TestShelveInstance-165027966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86c2b870-aa65-49db-b0c1-3daf7318eccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:35:27 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-78c3f96d-51af-4742-a882-cf1637d52f76 tempest-TestShelveInstance-165027966 None] Volume 57d3d311-43fc-4c70-b1dd-0cf01f63a115: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-57d3d311-43fc-4c70-b1dd-0cf01f63a115', 'volume_size': 1, 'image_id': '1a11c21d-88b0-4620-aa82-1ded26f580c9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1a11c21d-88b0-4620-aa82-1ded26f580c9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b800784c68dc485682fd42484c46336e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1a11c21d-88b0-4620-aa82-1ded26f580c9', 'created_at': datetime.datetime(2026, 9, 28, 7, 16, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 7, 16, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a11c21d-88b0-4620-aa82-1ded26f580c9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 09:35:27 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-78c3f96d-51af-4742-a882-cf1637d52f76 tempest-TestShelveInstance-165027966 None] Trying to clone 57d3d311-43fc-4c70-b1dd-0cf01f63a115 from image 1a11c21d-88b0-4620-aa82-1ded26f580c9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1a11c21d-88b0-4620-aa82-1ded26f580c9', 'metadata': {}}]). {{(pid=86553) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 09:35:28 devstack cinder-volume[86553]: DEBUG cinder.image.image_utils [None req-78c3f96d-51af-4742-a882-cf1637d52f76 tempest-TestShelveInstance-165027966 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1a11c21d-88b0-4620-aa82-1ded26f580c9_00tb8i0cdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86553) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 09:35:28 devstack cinder-volume[86553]: INFO cinder.image.image_utils [None req-78c3f96d-51af-4742-a882-cf1637d52f76 tempest-TestShelveInstance-165027966 None] Image download 20.69 MB at 20.69 MB/s Sep 28 09:35:28 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b746e4d-af7b-47fa-a2aa-24113548e7de]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:35:28 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-78c3f96d-51af-4742-a882-cf1637d52f76 tempest-TestShelveInstance-165027966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1a11c21d-88b0-4620-aa82-1ded26f580c9_00tb8i0cdevstack@QuobyteHD {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:35:28 devstack sudo[102072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1a11c21d-88b0-4620-aa82-1ded26f580c9_00tb8i0cdevstack@QuobyteHD Sep 28 09:35:28 devstack sudo[102072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:35:28 devstack sudo[102072]: pam_unix(sudo:session): session closed for user root Sep 28 09:35:28 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-78c3f96d-51af-4742-a882-cf1637d52f76 tempest-TestShelveInstance-165027966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1a11c21d-88b0-4620-aa82-1ded26f580c9_00tb8i0cdevstack@QuobyteHD" returned: 0 in 0.371s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:35:28 devstack cinder-volume[86553]: DEBUG cinder.image.image_utils [None req-78c3f96d-51af-4742-a882-cf1637d52f76 tempest-TestShelveInstance-165027966 None] Temporary image 1a11c21d-88b0-4620-aa82-1ded26f580c9 is fetched for user ac3af7c5557444fdab121bc4c175f5aa. {{(pid=86553) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 09:35:28 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce24031-5a8b-40df-ba3e-bc5245279006]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:35:28 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-78c3f96d-51af-4742-a882-cf1637d52f76 tempest-TestShelveInstance-165027966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1a11c21d-88b0-4620-aa82-1ded26f580c9_00tb8i0cdevstack@QuobyteHD {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:35:28 devstack sudo[102077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1a11c21d-88b0-4620-aa82-1ded26f580c9_00tb8i0cdevstack@QuobyteHD Sep 28 09:35:28 devstack sudo[102077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:35:29 devstack sudo[102077]: pam_unix(sudo:session): session closed for user root Sep 28 09:35:29 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-78c3f96d-51af-4742-a882-cf1637d52f76 tempest-TestShelveInstance-165027966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1a11c21d-88b0-4620-aa82-1ded26f580c9_00tb8i0cdevstack@QuobyteHD" returned: 0 in 0.330s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:35:29 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-78c3f96d-51af-4742-a882-cf1637d52f76 tempest-TestShelveInstance-165027966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:35:38 devstack cinder-volume[86553]: DEBUG dbcounter [-] [86553] Writing DB stats cinder:UPDATE=25,cinder:SELECT=19,cinder:INSERT=4,cinder:DELETE=2 {{(pid=86553) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 09:35:38 devstack cinder-volume[86553]: DEBUG dbcounter [-] [86553] Writing DB stats cinder:UPDATE=29,cinder:SELECT=20,cinder:INSERT=8,cinder:DELETE=3 {{(pid=86553) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 09:35:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-4020ea1f-5526-4995-b448-c23864cf28a1 tempest-TestImageHashVerification-1780440429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 30.965s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:35:39 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-4020ea1f-5526-4995-b448-c23864cf28a1 tempest-TestImageHashVerification-1780440429 None] Uploaded volume to glance image-id: 66e5ffba-d7ff-484b-ba6f-2ffb18f065b2. {{(pid=86553) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 28 09:35:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-69b156f9-772a-4e78-94ad-73d561993554 tempest-VolumesGetTest-1635800146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 29.316s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:35:39 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-69b156f9-772a-4e78-94ad-73d561993554 tempest-VolumesGetTest-1635800146 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:35:09Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1181348856',display_name='tempest-VolumesGetTest-Volume-539756043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=530a4cba-cf57-43ef-93af-ddce954eecc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be84b080459e458496b0d755a3c89703',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:35:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:35:10Z,use_quota=True,user_id='a7990b3b37d84bc4acd2288b34b11a7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:35:39 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-69b156f9-772a-4e78-94ad-73d561993554 tempest-VolumesGetTest-1635800146 None] Creating volume 530a4cba-cf57-43ef-93af-ddce954eecc3 {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:35:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-69b156f9-772a-4e78-94ad-73d561993554 tempest-VolumesGetTest-1635800146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:35:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-69b156f9-772a-4e78-94ad-73d561993554 tempest-VolumesGetTest-1635800146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:35:39 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-69b156f9-772a-4e78-94ad-73d561993554 tempest-VolumesGetTest-1635800146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:35:39 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-69b156f9-772a-4e78-94ad-73d561993554 tempest-VolumesGetTest-1635800146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:35:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-69b156f9-772a-4e78-94ad-73d561993554 tempest-VolumesGetTest-1635800146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:35:39 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-69b156f9-772a-4e78-94ad-73d561993554 tempest-VolumesGetTest-1635800146 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:35:39 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-69b156f9-772a-4e78-94ad-73d561993554 tempest-VolumesGetTest-1635800146 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:35:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-69b156f9-772a-4e78-94ad-73d561993554 tempest-VolumesGetTest-1635800146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-530a4cba-cf57-43ef-93af-ddce954eecc3 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:35:39 devstack sudo[102091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-530a4cba-cf57-43ef-93af-ddce954eecc3 1073741824 Sep 28 09:35:39 devstack sudo[102091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:35:39 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-4020ea1f-5526-4995-b448-c23864cf28a1 tempest-TestImageHashVerification-1780440429 None] Copy volume to image completed successfully. Sep 28 09:35:39 devstack sudo[102091]: pam_unix(sudo:session): session closed for user root Sep 28 09:35:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-69b156f9-772a-4e78-94ad-73d561993554 tempest-VolumesGetTest-1635800146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-530a4cba-cf57-43ef-93af-ddce954eecc3 1073741824" returned: 0 in 0.443s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:35:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-69b156f9-772a-4e78-94ad-73d561993554 tempest-VolumesGetTest-1635800146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-530a4cba-cf57-43ef-93af-ddce954eecc3 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:35:39 devstack sudo[102097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-530a4cba-cf57-43ef-93af-ddce954eecc3 Sep 28 09:35:39 devstack sudo[102097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:35:39 devstack sudo[102097]: pam_unix(sudo:session): session closed for user root Sep 28 09:35:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-69b156f9-772a-4e78-94ad-73d561993554 tempest-VolumesGetTest-1635800146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-530a4cba-cf57-43ef-93af-ddce954eecc3" returned: 0 in 0.267s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:35:39 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-69b156f9-772a-4e78-94ad-73d561993554 tempest-VolumesGetTest-1635800146 None] <== create_volume: return (754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:35:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-69b156f9-772a-4e78-94ad-73d561993554 tempest-VolumesGetTest-1635800146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:35:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-66908ae8-0e81-45ba-8f62-57dbb664828d tempest-VolumesSnapshotNegativeTestJSON-952146700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.116s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:35:39 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-66908ae8-0e81-45ba-8f62-57dbb664828d tempest-VolumesSnapshotNegativeTestJSON-952146700 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:35:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1110670517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e06d7033-36af-450b-be83-fb906157f875,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f3eafaed0ce48d794ab2b7e89dda2ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:35:25Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:35:25Z,use_quota=True,user_id='b4f8ffba5faa4e878ffc129e98a49450',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:35:39 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-66908ae8-0e81-45ba-8f62-57dbb664828d tempest-VolumesSnapshotNegativeTestJSON-952146700 None] Creating volume e06d7033-36af-450b-be83-fb906157f875 {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:35:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-66908ae8-0e81-45ba-8f62-57dbb664828d tempest-VolumesSnapshotNegativeTestJSON-952146700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:35:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-66908ae8-0e81-45ba-8f62-57dbb664828d tempest-VolumesSnapshotNegativeTestJSON-952146700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:35:39 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-66908ae8-0e81-45ba-8f62-57dbb664828d tempest-VolumesSnapshotNegativeTestJSON-952146700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:35:39 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-66908ae8-0e81-45ba-8f62-57dbb664828d tempest-VolumesSnapshotNegativeTestJSON-952146700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:35:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-66908ae8-0e81-45ba-8f62-57dbb664828d tempest-VolumesSnapshotNegativeTestJSON-952146700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:35:39 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-66908ae8-0e81-45ba-8f62-57dbb664828d tempest-VolumesSnapshotNegativeTestJSON-952146700 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:35:39 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-66908ae8-0e81-45ba-8f62-57dbb664828d tempest-VolumesSnapshotNegativeTestJSON-952146700 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:35:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-66908ae8-0e81-45ba-8f62-57dbb664828d tempest-VolumesSnapshotNegativeTestJSON-952146700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-e06d7033-36af-450b-be83-fb906157f875 2147483648 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:35:39 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-69b156f9-772a-4e78-94ad-73d561993554 tempest-VolumesGetTest-1635800146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33392d85-da1f-4d4a-be6e-544a5c956aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-530a4cba-cf57-43ef-93af-ddce954eecc3', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:35:39 devstack sudo[102100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-e06d7033-36af-450b-be83-fb906157f875 2147483648 Sep 28 09:35:39 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-69b156f9-772a-4e78-94ad-73d561993554 tempest-VolumesGetTest-1635800146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (241ca8db-b1c6-44f9-bf2b-d4802855dea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:35:39 devstack sudo[102100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:35:39 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-69b156f9-772a-4e78-94ad-73d561993554 tempest-VolumesGetTest-1635800146 None] Volume volume-530a4cba-cf57-43ef-93af-ddce954eecc3 (530a4cba-cf57-43ef-93af-ddce954eecc3): created successfully Sep 28 09:35:40 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-69b156f9-772a-4e78-94ad-73d561993554 tempest-VolumesGetTest-1635800146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (241ca8db-b1c6-44f9-bf2b-d4802855dea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:35:40 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-69b156f9-772a-4e78-94ad-73d561993554 tempest-VolumesGetTest-1635800146 None] Flow 'volume_create_manager' (9d2f041d-63f2-4b59-bae1-38ad46c5bd15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:35:40 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-69b156f9-772a-4e78-94ad-73d561993554 tempest-VolumesGetTest-1635800146 None] Created volume successfully. Sep 28 09:35:40 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-a9ee4956-3c93-433c-b9c6-8d5d2d0f4ad1 tempest-TestImageHashVerification-1780440429 None] Acquiring lock "cinder-47721ef3-5835-4e6f-aba9-7578315f2959-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:35:40 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-a9ee4956-3c93-433c-b9c6-8d5d2d0f4ad1 tempest-TestImageHashVerification-1780440429 None] Lock "cinder-47721ef3-5835-4e6f-aba9-7578315f2959-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:35:40 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-a9ee4956-3c93-433c-b9c6-8d5d2d0f4ad1 tempest-TestImageHashVerification-1780440429 None] Acquiring lock "cinder-quobyte-47721ef3-5835-4e6f-aba9-7578315f2959" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:35:40 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-a9ee4956-3c93-433c-b9c6-8d5d2d0f4ad1 tempest-TestImageHashVerification-1780440429 None] Lock "cinder-quobyte-47721ef3-5835-4e6f-aba9-7578315f2959" acquired by "delete_volume" :: waited 0.018s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:35:40 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[534eeace-e601-4227-99ef-9643c244378a]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:35:40 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a9ee4956-3c93-433c-b9c6-8d5d2d0f4ad1 tempest-TestImageHashVerification-1780440429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-47721ef3-5835-4e6f-aba9-7578315f2959 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:35:40 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-1689a585-aa42-40b4-a408-e370684205f1 tempest-VolumesGetTest-1635800146 None] Acquiring lock "cinder-530a4cba-cf57-43ef-93af-ddce954eecc3-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:35:40 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-1689a585-aa42-40b4-a408-e370684205f1 tempest-VolumesGetTest-1635800146 None] Lock "cinder-530a4cba-cf57-43ef-93af-ddce954eecc3-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:35:40 devstack sudo[102106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-47721ef3-5835-4e6f-aba9-7578315f2959 Sep 28 09:35:40 devstack sudo[102106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:35:40 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-1689a585-aa42-40b4-a408-e370684205f1 tempest-VolumesGetTest-1635800146 None] Acquiring lock "cinder-quobyte-530a4cba-cf57-43ef-93af-ddce954eecc3" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:35:40 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-1689a585-aa42-40b4-a408-e370684205f1 tempest-VolumesGetTest-1635800146 None] Lock "cinder-quobyte-530a4cba-cf57-43ef-93af-ddce954eecc3" acquired by "delete_volume" :: waited 0.018s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:35:40 devstack sudo[102100]: pam_unix(sudo:session): session closed for user root Sep 28 09:35:40 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-66908ae8-0e81-45ba-8f62-57dbb664828d tempest-VolumesSnapshotNegativeTestJSON-952146700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-e06d7033-36af-450b-be83-fb906157f875 2147483648" returned: 0 in 0.691s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:35:40 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdaf28f1-4618-4448-b741-593ea7f6edf7]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:35:40 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1689a585-aa42-40b4-a408-e370684205f1 tempest-VolumesGetTest-1635800146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-530a4cba-cf57-43ef-93af-ddce954eecc3 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:35:40 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-66908ae8-0e81-45ba-8f62-57dbb664828d tempest-VolumesSnapshotNegativeTestJSON-952146700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-e06d7033-36af-450b-be83-fb906157f875 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:35:40 devstack sudo[102109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-e06d7033-36af-450b-be83-fb906157f875 Sep 28 09:35:40 devstack sudo[102109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:35:40 devstack sudo[102108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-530a4cba-cf57-43ef-93af-ddce954eecc3 Sep 28 09:35:40 devstack sudo[102108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:35:40 devstack sudo[102106]: pam_unix(sudo:session): session closed for user root Sep 28 09:35:40 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a9ee4956-3c93-433c-b9c6-8d5d2d0f4ad1 tempest-TestImageHashVerification-1780440429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-47721ef3-5835-4e6f-aba9-7578315f2959" returned: 0 in 0.444s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:35:40 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a9ee4956-3c93-433c-b9c6-8d5d2d0f4ad1 tempest-TestImageHashVerification-1780440429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-47721ef3-5835-4e6f-aba9-7578315f2959 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:35:40 devstack sudo[102115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-47721ef3-5835-4e6f-aba9-7578315f2959 Sep 28 09:35:40 devstack sudo[102115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:35:40 devstack sudo[102109]: pam_unix(sudo:session): session closed for user root Sep 28 09:35:40 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-66908ae8-0e81-45ba-8f62-57dbb664828d tempest-VolumesSnapshotNegativeTestJSON-952146700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-e06d7033-36af-450b-be83-fb906157f875" returned: 0 in 0.278s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:35:40 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-66908ae8-0e81-45ba-8f62-57dbb664828d tempest-VolumesSnapshotNegativeTestJSON-952146700 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:35:40 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-66908ae8-0e81-45ba-8f62-57dbb664828d tempest-VolumesSnapshotNegativeTestJSON-952146700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:35:40 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-78c3f96d-51af-4742-a882-cf1637d52f76 tempest-TestShelveInstance-165027966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.804s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:35:40 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-78c3f96d-51af-4742-a882-cf1637d52f76 tempest-TestShelveInstance-165027966 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:35:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1531749289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57d3d311-43fc-4c70-b1dd-0cf01f63a115,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1e4453922b74c25adcafee07684e4bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:35:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:35:27Z,use_quota=True,user_id='ac3af7c5557444fdab121bc4c175f5aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:35:40 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-78c3f96d-51af-4742-a882-cf1637d52f76 tempest-TestShelveInstance-165027966 None] Creating volume 57d3d311-43fc-4c70-b1dd-0cf01f63a115 {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:35:40 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-78c3f96d-51af-4742-a882-cf1637d52f76 tempest-TestShelveInstance-165027966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:35:40 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-78c3f96d-51af-4742-a882-cf1637d52f76 tempest-TestShelveInstance-165027966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:35:40 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-78c3f96d-51af-4742-a882-cf1637d52f76 tempest-TestShelveInstance-165027966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:35:40 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-78c3f96d-51af-4742-a882-cf1637d52f76 tempest-TestShelveInstance-165027966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:35:40 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-78c3f96d-51af-4742-a882-cf1637d52f76 tempest-TestShelveInstance-165027966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:35:40 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-78c3f96d-51af-4742-a882-cf1637d52f76 tempest-TestShelveInstance-165027966 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:35:40 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-78c3f96d-51af-4742-a882-cf1637d52f76 tempest-TestShelveInstance-165027966 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:35:40 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-78c3f96d-51af-4742-a882-cf1637d52f76 tempest-TestShelveInstance-165027966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-57d3d311-43fc-4c70-b1dd-0cf01f63a115 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:35:41 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-66908ae8-0e81-45ba-8f62-57dbb664828d tempest-VolumesSnapshotNegativeTestJSON-952146700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a260a450-f1bf-4647-8255-00ea8865e508) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e06d7033-36af-450b-be83-fb906157f875', 'volume_size': 2}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:35:41 devstack sudo[102120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-57d3d311-43fc-4c70-b1dd-0cf01f63a115 1073741824 Sep 28 09:35:41 devstack sudo[102120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:35:41 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-66908ae8-0e81-45ba-8f62-57dbb664828d tempest-VolumesSnapshotNegativeTestJSON-952146700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdcfa00e-74ae-4f47-998b-d00ce86ddb4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:35:41 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-66908ae8-0e81-45ba-8f62-57dbb664828d tempest-VolumesSnapshotNegativeTestJSON-952146700 None] Volume volume-e06d7033-36af-450b-be83-fb906157f875 (e06d7033-36af-450b-be83-fb906157f875): created successfully Sep 28 09:35:41 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-66908ae8-0e81-45ba-8f62-57dbb664828d tempest-VolumesSnapshotNegativeTestJSON-952146700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdcfa00e-74ae-4f47-998b-d00ce86ddb4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:35:41 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-66908ae8-0e81-45ba-8f62-57dbb664828d tempest-VolumesSnapshotNegativeTestJSON-952146700 None] Flow 'volume_create_manager' (677052f6-8ec1-4a21-ada9-19183410cfcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:35:41 devstack sudo[102108]: pam_unix(sudo:session): session closed for user root Sep 28 09:35:41 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-66908ae8-0e81-45ba-8f62-57dbb664828d tempest-VolumesSnapshotNegativeTestJSON-952146700 None] Created volume successfully. Sep 28 09:35:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1689a585-aa42-40b4-a408-e370684205f1 tempest-VolumesGetTest-1635800146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-530a4cba-cf57-43ef-93af-ddce954eecc3" returned: 0 in 0.419s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:35:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1689a585-aa42-40b4-a408-e370684205f1 tempest-VolumesGetTest-1635800146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-530a4cba-cf57-43ef-93af-ddce954eecc3 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:35:41 devstack sudo[102123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-530a4cba-cf57-43ef-93af-ddce954eecc3 Sep 28 09:35:41 devstack sudo[102123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:35:41 devstack sudo[102115]: pam_unix(sudo:session): session closed for user root Sep 28 09:35:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a9ee4956-3c93-433c-b9c6-8d5d2d0f4ad1 tempest-TestImageHashVerification-1780440429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-47721ef3-5835-4e6f-aba9-7578315f2959" returned: 0 in 0.264s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:35:41 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-a9ee4956-3c93-433c-b9c6-8d5d2d0f4ad1 tempest-TestImageHashVerification-1780440429 None] Lock "cinder-quobyte-47721ef3-5835-4e6f-aba9-7578315f2959" released by "delete_volume" :: held 0.757s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:35:41 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-a9ee4956-3c93-433c-b9c6-8d5d2d0f4ad1 tempest-TestImageHashVerification-1780440429 None] Created reservations ['a94e38e8-9335-468d-bc1f-8585654fc874', '42991438-9b6e-4c72-89b0-a64d12a4479a', 'a5edccad-935b-44eb-81ad-c76ec2f54ac6', 'a9e536a0-910a-4ae9-af96-16085122e612'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:35:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-a9ee4956-3c93-433c-b9c6-8d5d2d0f4ad1 tempest-TestImageHashVerification-1780440429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:35:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-a9ee4956-3c93-433c-b9c6-8d5d2d0f4ad1 tempest-TestImageHashVerification-1780440429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:35:41 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-a9ee4956-3c93-433c-b9c6-8d5d2d0f4ad1 tempest-TestImageHashVerification-1780440429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:35:41 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-a9ee4956-3c93-433c-b9c6-8d5d2d0f4ad1 tempest-TestImageHashVerification-1780440429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:35:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-a9ee4956-3c93-433c-b9c6-8d5d2d0f4ad1 tempest-TestImageHashVerification-1780440429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:35:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a9ee4956-3c93-433c-b9c6-8d5d2d0f4ad1 tempest-TestImageHashVerification-1780440429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:35:41 devstack sudo[102129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:35:41 devstack sudo[102129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:35:41 devstack sudo[102123]: pam_unix(sudo:session): session closed for user root Sep 28 09:35:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1689a585-aa42-40b4-a408-e370684205f1 tempest-VolumesGetTest-1635800146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-530a4cba-cf57-43ef-93af-ddce954eecc3" returned: 0 in 0.297s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:35:41 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-1689a585-aa42-40b4-a408-e370684205f1 tempest-VolumesGetTest-1635800146 None] Lock "cinder-quobyte-530a4cba-cf57-43ef-93af-ddce954eecc3" released by "delete_volume" :: held 0.771s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:35:41 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-1689a585-aa42-40b4-a408-e370684205f1 tempest-VolumesGetTest-1635800146 None] Created reservations ['ca8d5106-809a-45f4-889f-f9343996693f', '461f3c25-1a4d-4983-9e9e-d711f8a69402', 'b5d15b23-b124-4a5a-9fa3-802f7907bd19', '59789c7c-1b72-49b1-b9d9-47849a4cf5db'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:35:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-1689a585-aa42-40b4-a408-e370684205f1 tempest-VolumesGetTest-1635800146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:35:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-1689a585-aa42-40b4-a408-e370684205f1 tempest-VolumesGetTest-1635800146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:35:41 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-1689a585-aa42-40b4-a408-e370684205f1 tempest-VolumesGetTest-1635800146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:35:41 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-1689a585-aa42-40b4-a408-e370684205f1 tempest-VolumesGetTest-1635800146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:35:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-1689a585-aa42-40b4-a408-e370684205f1 tempest-VolumesGetTest-1635800146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:35:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1689a585-aa42-40b4-a408-e370684205f1 tempest-VolumesGetTest-1635800146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:35:41 devstack sudo[102120]: pam_unix(sudo:session): session closed for user root Sep 28 09:35:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-78c3f96d-51af-4742-a882-cf1637d52f76 tempest-TestShelveInstance-165027966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-57d3d311-43fc-4c70-b1dd-0cf01f63a115 1073741824" returned: 0 in 0.599s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:35:41 devstack sudo[102134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:35:41 devstack sudo[102134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:35:41 devstack sudo[102129]: pam_unix(sudo:session): session closed for user root Sep 28 09:35:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a9ee4956-3c93-433c-b9c6-8d5d2d0f4ad1 tempest-TestImageHashVerification-1780440429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.352s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:35:41 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-a9ee4956-3c93-433c-b9c6-8d5d2d0f4ad1 tempest-TestImageHashVerification-1780440429 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:35:41 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-a9ee4956-3c93-433c-b9c6-8d5d2d0f4ad1 tempest-TestImageHashVerification-1780440429 None] Deleted volume successfully. Sep 28 09:35:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-78c3f96d-51af-4742-a882-cf1637d52f76 tempest-TestShelveInstance-165027966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-57d3d311-43fc-4c70-b1dd-0cf01f63a115 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:35:41 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-a9ee4956-3c93-433c-b9c6-8d5d2d0f4ad1 tempest-TestImageHashVerification-1780440429 None] Lock "cinder-47721ef3-5835-4e6f-aba9-7578315f2959-delete_volume" released by "delete_volume" :: held 1.387s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:35:41 devstack sudo[102136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-57d3d311-43fc-4c70-b1dd-0cf01f63a115 Sep 28 09:35:41 devstack sudo[102136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:35:41 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-47dd2ea8-6767-49a8-80a7-0ef0804f8139 tempest-VolumesGetTest-1635800146 None] Acquiring lock "cinder-87b4b380-ed97-4eac-aa01-e787485d94d2-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:35:41 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-47dd2ea8-6767-49a8-80a7-0ef0804f8139 tempest-VolumesGetTest-1635800146 None] Lock "cinder-87b4b380-ed97-4eac-aa01-e787485d94d2-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:35:42 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-47dd2ea8-6767-49a8-80a7-0ef0804f8139 tempest-VolumesGetTest-1635800146 None] Acquiring lock "cinder-quobyte-87b4b380-ed97-4eac-aa01-e787485d94d2" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:35:42 devstack sudo[102134]: pam_unix(sudo:session): session closed for user root Sep 28 09:35:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1689a585-aa42-40b4-a408-e370684205f1 tempest-VolumesGetTest-1635800146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.447s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:35:42 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-1689a585-aa42-40b4-a408-e370684205f1 tempest-VolumesGetTest-1635800146 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:35:42 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-1689a585-aa42-40b4-a408-e370684205f1 tempest-VolumesGetTest-1635800146 None] Deleted volume successfully. Sep 28 09:35:42 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-47dd2ea8-6767-49a8-80a7-0ef0804f8139 tempest-VolumesGetTest-1635800146 None] Lock "cinder-quobyte-87b4b380-ed97-4eac-aa01-e787485d94d2" acquired by "delete_volume" :: waited 0.030s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:35:42 devstack sudo[102136]: pam_unix(sudo:session): session closed for user root Sep 28 09:35:42 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-1689a585-aa42-40b4-a408-e370684205f1 tempest-VolumesGetTest-1635800146 None] Lock "cinder-530a4cba-cf57-43ef-93af-ddce954eecc3-delete_volume" released by "delete_volume" :: held 1.519s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:35:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-78c3f96d-51af-4742-a882-cf1637d52f76 tempest-TestShelveInstance-165027966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-57d3d311-43fc-4c70-b1dd-0cf01f63a115" returned: 0 in 0.398s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:35:42 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-78c3f96d-51af-4742-a882-cf1637d52f76 tempest-TestShelveInstance-165027966 None] <== create_volume: return (1099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:35:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-78c3f96d-51af-4742-a882-cf1637d52f76 tempest-TestShelveInstance-165027966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.102s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:35:42 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac4b8da-07e9-4c3a-ae05-4cc238d4d577]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:35:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-47dd2ea8-6767-49a8-80a7-0ef0804f8139 tempest-VolumesGetTest-1635800146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-87b4b380-ed97-4eac-aa01-e787485d94d2 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:35:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-81dd6cdd-93c8-4b58-b323-859780d403fa tempest-VolumesSnapshotNegativeTestJSON-952146700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:35:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-81dd6cdd-93c8-4b58-b323-859780d403fa tempest-VolumesSnapshotNegativeTestJSON-952146700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:35:42 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-81dd6cdd-93c8-4b58-b323-859780d403fa tempest-VolumesSnapshotNegativeTestJSON-952146700 None] Creating offline snapshot 5feec05e-a920-4b68-924f-777730375bd7 of volume e06d7033-36af-450b-be83-fb906157f875 {{(pid=86553) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 09:35:42 devstack cinder-volume[86553]: DEBUG cinder.volume.volume_utils [None req-78c3f96d-51af-4742-a882-cf1637d52f76 tempest-TestShelveInstance-165027966 None] Attempting download of 1a11c21d-88b0-4620-aa82-1ded26f580c9 ((None, [{'url': 'file:///opt/stack/data/glance/images/1a11c21d-88b0-4620-aa82-1ded26f580c9', 'metadata': {}}])) to volume 57d3d311-43fc-4c70-b1dd-0cf01f63a115. {{(pid=86553) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 09:35:42 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a05028-55ae-408c-a927-dd142afe1b52]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:35:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-81dd6cdd-93c8-4b58-b323-859780d403fa tempest-VolumesSnapshotNegativeTestJSON-952146700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-e06d7033-36af-450b-be83-fb906157f875 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:35:42 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[c46c0908-5865-4e3f-8577-4147d7df9cc9]: (4, 'raw') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:35:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-78c3f96d-51af-4742-a882-cf1637d52f76 tempest-TestShelveInstance-165027966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1a11c21d-88b0-4620-aa82-1ded26f580c9_zortoou5 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:35:42 devstack sudo[102140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-87b4b380-ed97-4eac-aa01-e787485d94d2 Sep 28 09:35:42 devstack sudo[102140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:35:42 devstack sudo[102141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-e06d7033-36af-450b-be83-fb906157f875 Sep 28 09:35:42 devstack sudo[102141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:35:42 devstack sudo[102142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1a11c21d-88b0-4620-aa82-1ded26f580c9_zortoou5 Sep 28 09:35:42 devstack sudo[102142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:35:42 devstack sudo[102140]: pam_unix(sudo:session): session closed for user root Sep 28 09:35:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-47dd2ea8-6767-49a8-80a7-0ef0804f8139 tempest-VolumesGetTest-1635800146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-87b4b380-ed97-4eac-aa01-e787485d94d2" returned: 0 in 0.508s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:35:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-47dd2ea8-6767-49a8-80a7-0ef0804f8139 tempest-VolumesGetTest-1635800146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-87b4b380-ed97-4eac-aa01-e787485d94d2 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:35:42 devstack sudo[102142]: pam_unix(sudo:session): session closed for user root Sep 28 09:35:42 devstack sudo[102141]: pam_unix(sudo:session): session closed for user root Sep 28 09:35:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-78c3f96d-51af-4742-a882-cf1637d52f76 tempest-TestShelveInstance-165027966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1a11c21d-88b0-4620-aa82-1ded26f580c9_zortoou5" returned: 0 in 0.398s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:35:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-78c3f96d-51af-4742-a882-cf1637d52f76 tempest-TestShelveInstance-165027966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1a11c21d-88b0-4620-aa82-1ded26f580c9_zortoou5 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:35:42 devstack sudo[102155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-87b4b380-ed97-4eac-aa01-e787485d94d2 Sep 28 09:35:42 devstack sudo[102155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:35:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-81dd6cdd-93c8-4b58-b323-859780d403fa tempest-VolumesSnapshotNegativeTestJSON-952146700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-e06d7033-36af-450b-be83-fb906157f875" returned: 0 in 0.483s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:35:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-81dd6cdd-93c8-4b58-b323-859780d403fa tempest-VolumesSnapshotNegativeTestJSON-952146700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-e06d7033-36af-450b-be83-fb906157f875,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-e06d7033-36af-450b-be83-fb906157f875.5feec05e-a920-4b68-924f-777730375bd7 2G {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:35:42 devstack sudo[102158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-e06d7033-36af-450b-be83-fb906157f875,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-e06d7033-36af-450b-be83-fb906157f875.5feec05e-a920-4b68-924f-777730375bd7 2G Sep 28 09:35:42 devstack sudo[102158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:35:42 devstack sudo[102156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1a11c21d-88b0-4620-aa82-1ded26f580c9_zortoou5 Sep 28 09:35:42 devstack sudo[102156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:35:42 devstack sudo[102155]: pam_unix(sudo:session): session closed for user root Sep 28 09:35:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-47dd2ea8-6767-49a8-80a7-0ef0804f8139 tempest-VolumesGetTest-1635800146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-87b4b380-ed97-4eac-aa01-e787485d94d2" returned: 0 in 0.306s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:35:42 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-47dd2ea8-6767-49a8-80a7-0ef0804f8139 tempest-VolumesGetTest-1635800146 None] Lock "cinder-quobyte-87b4b380-ed97-4eac-aa01-e787485d94d2" released by "delete_volume" :: held 0.888s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:35:43 devstack sudo[102156]: pam_unix(sudo:session): session closed for user root Sep 28 09:35:43 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-47dd2ea8-6767-49a8-80a7-0ef0804f8139 tempest-VolumesGetTest-1635800146 None] Created reservations ['cadb1d54-9248-4d5a-ba02-5d41bc02d2bf', '2b3efae8-fc4f-4884-9a7e-b5fee349b901', 'ffd064a4-d892-4c5f-a8ac-377b3e6fc565', '0a7abed4-adaf-4ad4-b739-777b9d5b8ab2'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:35:43 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-78c3f96d-51af-4742-a882-cf1637d52f76 tempest-TestShelveInstance-165027966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1a11c21d-88b0-4620-aa82-1ded26f580c9_zortoou5" returned: 1 in 0.406s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:35:43 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-78c3f96d-51af-4742-a882-cf1637d52f76 tempest-TestShelveInstance-165027966 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1a11c21d-88b0-4620-aa82-1ded26f580c9_zortoou5' failed. Not Retrying. {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 09:35:43 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[e74e4598-39ad-4a00-9d35-8a560fa5567c]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:35:43 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-78c3f96d-51af-4742-a882-cf1637d52f76 tempest-TestShelveInstance-165027966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1a11c21d-88b0-4620-aa82-1ded26f580c9_00tb8i0cdevstack@QuobyteHD {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:35:43 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-47dd2ea8-6767-49a8-80a7-0ef0804f8139 tempest-VolumesGetTest-1635800146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:35:43 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-47dd2ea8-6767-49a8-80a7-0ef0804f8139 tempest-VolumesGetTest-1635800146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:35:43 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-47dd2ea8-6767-49a8-80a7-0ef0804f8139 tempest-VolumesGetTest-1635800146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:35:43 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-47dd2ea8-6767-49a8-80a7-0ef0804f8139 tempest-VolumesGetTest-1635800146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:35:43 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-47dd2ea8-6767-49a8-80a7-0ef0804f8139 tempest-VolumesGetTest-1635800146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:35:43 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-47dd2ea8-6767-49a8-80a7-0ef0804f8139 tempest-VolumesGetTest-1635800146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:35:43 devstack sudo[102168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:35:43 devstack sudo[102168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:35:43 devstack sudo[102167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1a11c21d-88b0-4620-aa82-1ded26f580c9_00tb8i0cdevstack@QuobyteHD Sep 28 09:35:43 devstack sudo[102167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:35:43 devstack sudo[102158]: pam_unix(sudo:session): session closed for user root Sep 28 09:35:43 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-81dd6cdd-93c8-4b58-b323-859780d403fa tempest-VolumesSnapshotNegativeTestJSON-952146700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-e06d7033-36af-450b-be83-fb906157f875,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-e06d7033-36af-450b-be83-fb906157f875.5feec05e-a920-4b68-924f-777730375bd7 2G" returned: 0 in 0.617s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:35:43 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-81dd6cdd-93c8-4b58-b323-859780d403fa tempest-VolumesSnapshotNegativeTestJSON-952146700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e06d7033-36af-450b-be83-fb906157f875 -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-e06d7033-36af-450b-be83-fb906157f875.5feec05e-a920-4b68-924f-777730375bd7 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:35:43 devstack sudo[102171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e06d7033-36af-450b-be83-fb906157f875 -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-e06d7033-36af-450b-be83-fb906157f875.5feec05e-a920-4b68-924f-777730375bd7 Sep 28 09:35:43 devstack sudo[102171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:35:43 devstack sudo[102167]: pam_unix(sudo:session): session closed for user root Sep 28 09:35:43 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-78c3f96d-51af-4742-a882-cf1637d52f76 tempest-TestShelveInstance-165027966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1a11c21d-88b0-4620-aa82-1ded26f580c9_00tb8i0cdevstack@QuobyteHD" returned: 0 in 0.440s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:35:43 devstack cinder-volume[86553]: DEBUG cinder.image.image_utils [None req-78c3f96d-51af-4742-a882-cf1637d52f76 tempest-TestShelveInstance-165027966 None] 1a11c21d-88b0-4620-aa82-1ded26f580c9 was qcow2, converting to qcow2 {{(pid=86553) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 09:35:43 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-78c3f96d-51af-4742-a882-cf1637d52f76 tempest-TestShelveInstance-165027966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1a11c21d-88b0-4620-aa82-1ded26f580c9_00tb8i0cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-57d3d311-43fc-4c70-b1dd-0cf01f63a115 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:35:43 devstack sudo[102168]: pam_unix(sudo:session): session closed for user root Sep 28 09:35:43 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-47dd2ea8-6767-49a8-80a7-0ef0804f8139 tempest-VolumesGetTest-1635800146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.381s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:35:43 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-47dd2ea8-6767-49a8-80a7-0ef0804f8139 tempest-VolumesGetTest-1635800146 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:35:43 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-47dd2ea8-6767-49a8-80a7-0ef0804f8139 tempest-VolumesGetTest-1635800146 None] Deleted volume successfully. Sep 28 09:35:43 devstack sudo[102178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1a11c21d-88b0-4620-aa82-1ded26f580c9_00tb8i0cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-57d3d311-43fc-4c70-b1dd-0cf01f63a115 Sep 28 09:35:43 devstack sudo[102178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:35:43 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-47dd2ea8-6767-49a8-80a7-0ef0804f8139 tempest-VolumesGetTest-1635800146 None] Lock "cinder-87b4b380-ed97-4eac-aa01-e787485d94d2-delete_volume" released by "delete_volume" :: held 1.637s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:35:43 devstack sudo[102171]: pam_unix(sudo:session): session closed for user root Sep 28 09:35:43 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-81dd6cdd-93c8-4b58-b323-859780d403fa tempest-VolumesSnapshotNegativeTestJSON-952146700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e06d7033-36af-450b-be83-fb906157f875 -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-e06d7033-36af-450b-be83-fb906157f875.5feec05e-a920-4b68-924f-777730375bd7" returned: 0 in 0.492s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:35:43 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-81dd6cdd-93c8-4b58-b323-859780d403fa tempest-VolumesSnapshotNegativeTestJSON-952146700 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-e06d7033-36af-450b-be83-fb906157f875.5feec05e-a920-4b68-924f-777730375bd7 is being set with open permissions: ugo+rw Sep 28 09:35:43 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-81dd6cdd-93c8-4b58-b323-859780d403fa tempest-VolumesSnapshotNegativeTestJSON-952146700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-e06d7033-36af-450b-be83-fb906157f875.5feec05e-a920-4b68-924f-777730375bd7 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:35:43 devstack sudo[102184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-e06d7033-36af-450b-be83-fb906157f875.5feec05e-a920-4b68-924f-777730375bd7 Sep 28 09:35:43 devstack sudo[102184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:35:43 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a83a318-670d-4998-bc98-cd26ef4087d5 tempest-VolumesGetTest-1635800146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:35:43 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-5a83a318-670d-4998-bc98-cd26ef4087d5 tempest-VolumesGetTest-1635800146 None] Flow 'volume_create_manager' (c31a1dc3-1028-4b8e-989e-8e6650304801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:35:43 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-5a83a318-670d-4998-bc98-cd26ef4087d5 tempest-VolumesGetTest-1635800146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af589cbe-973d-4af9-a136-f7467c3693fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:35:43 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-5a83a318-670d-4998-bc98-cd26ef4087d5 tempest-VolumesGetTest-1635800146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af589cbe-973d-4af9-a136-f7467c3693fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:35:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2040305353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=384d6c32-e983-4e49-986f-2492761792c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be84b080459e458496b0d755a3c89703',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:35:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:35:44Z,use_quota=True,user_id='a7990b3b37d84bc4acd2288b34b11a7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:35:43 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-5a83a318-670d-4998-bc98-cd26ef4087d5 tempest-VolumesGetTest-1635800146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddd7219a-ae11-4dd4-b028-8f4b96f675f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:35:43 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-5a83a318-670d-4998-bc98-cd26ef4087d5 tempest-VolumesGetTest-1635800146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddd7219a-ae11-4dd4-b028-8f4b96f675f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:35:43 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-5a83a318-670d-4998-bc98-cd26ef4087d5 tempest-VolumesGetTest-1635800146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39fb0576-b3a0-4ee4-85c1-e236077d76ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:35:43 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-5a83a318-670d-4998-bc98-cd26ef4087d5 tempest-VolumesGetTest-1635800146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39fb0576-b3a0-4ee4-85c1-e236077d76ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '384d6c32-e983-4e49-986f-2492761792c0', 'volume_name': 'volume-384d6c32-e983-4e49-986f-2492761792c0', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:35:43 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-5a83a318-670d-4998-bc98-cd26ef4087d5 tempest-VolumesGetTest-1635800146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8272b10a-107d-4fea-a101-1bd0157ad3a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:35:43 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-5a83a318-670d-4998-bc98-cd26ef4087d5 tempest-VolumesGetTest-1635800146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8272b10a-107d-4fea-a101-1bd0157ad3a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:35:43 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-5a83a318-670d-4998-bc98-cd26ef4087d5 tempest-VolumesGetTest-1635800146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18c7f7a9-9aad-47e1-8b62-73fe753c93ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:35:43 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-5a83a318-670d-4998-bc98-cd26ef4087d5 tempest-VolumesGetTest-1635800146 None] Volume 384d6c32-e983-4e49-986f-2492761792c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-384d6c32-e983-4e49-986f-2492761792c0', 'volume_size': 1} Sep 28 09:35:43 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-5a83a318-670d-4998-bc98-cd26ef4087d5 tempest-VolumesGetTest-1635800146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:35:44 devstack sudo[102184]: pam_unix(sudo:session): session closed for user root Sep 28 09:35:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-81dd6cdd-93c8-4b58-b323-859780d403fa tempest-VolumesSnapshotNegativeTestJSON-952146700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-e06d7033-36af-450b-be83-fb906157f875.5feec05e-a920-4b68-924f-777730375bd7" returned: 0 in 0.293s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:35:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-81dd6cdd-93c8-4b58-b323-859780d403fa tempest-VolumesSnapshotNegativeTestJSON-952146700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-e06d7033-36af-450b-be83-fb906157f875.info {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:35:44 devstack sudo[102191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-e06d7033-36af-450b-be83-fb906157f875.info Sep 28 09:35:44 devstack sudo[102191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:35:44 devstack sudo[102191]: pam_unix(sudo:session): session closed for user root Sep 28 09:35:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-81dd6cdd-93c8-4b58-b323-859780d403fa tempest-VolumesSnapshotNegativeTestJSON-952146700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-e06d7033-36af-450b-be83-fb906157f875.info" returned: 0 in 0.317s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:35:44 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-81dd6cdd-93c8-4b58-b323-859780d403fa tempest-VolumesSnapshotNegativeTestJSON-952146700 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-e06d7033-36af-450b-be83-fb906157f875.info is being set with open permissions: ugo+rw Sep 28 09:35:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-81dd6cdd-93c8-4b58-b323-859780d403fa tempest-VolumesSnapshotNegativeTestJSON-952146700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-e06d7033-36af-450b-be83-fb906157f875.info {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:35:44 devstack sudo[102196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-e06d7033-36af-450b-be83-fb906157f875.info Sep 28 09:35:44 devstack sudo[102196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:35:44 devstack sudo[102196]: pam_unix(sudo:session): session closed for user root Sep 28 09:35:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-81dd6cdd-93c8-4b58-b323-859780d403fa tempest-VolumesSnapshotNegativeTestJSON-952146700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-e06d7033-36af-450b-be83-fb906157f875.info" returned: 0 in 0.327s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:35:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-81dd6cdd-93c8-4b58-b323-859780d403fa tempest-VolumesSnapshotNegativeTestJSON-952146700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.650s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:35:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-5a83a318-670d-4998-bc98-cd26ef4087d5 tempest-VolumesGetTest-1635800146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.795s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:35:44 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-5a83a318-670d-4998-bc98-cd26ef4087d5 tempest-VolumesGetTest-1635800146 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:35:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2040305353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=384d6c32-e983-4e49-986f-2492761792c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be84b080459e458496b0d755a3c89703',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:35:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:35:44Z,use_quota=True,user_id='a7990b3b37d84bc4acd2288b34b11a7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:35:44 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-5a83a318-670d-4998-bc98-cd26ef4087d5 tempest-VolumesGetTest-1635800146 None] Creating volume 384d6c32-e983-4e49-986f-2492761792c0 {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:35:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-5a83a318-670d-4998-bc98-cd26ef4087d5 tempest-VolumesGetTest-1635800146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:35:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-5a83a318-670d-4998-bc98-cd26ef4087d5 tempest-VolumesGetTest-1635800146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:35:44 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-5a83a318-670d-4998-bc98-cd26ef4087d5 tempest-VolumesGetTest-1635800146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:35:44 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-5a83a318-670d-4998-bc98-cd26ef4087d5 tempest-VolumesGetTest-1635800146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:35:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-5a83a318-670d-4998-bc98-cd26ef4087d5 tempest-VolumesGetTest-1635800146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:35:44 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-5a83a318-670d-4998-bc98-cd26ef4087d5 tempest-VolumesGetTest-1635800146 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:35:44 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-5a83a318-670d-4998-bc98-cd26ef4087d5 tempest-VolumesGetTest-1635800146 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:35:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-5a83a318-670d-4998-bc98-cd26ef4087d5 tempest-VolumesGetTest-1635800146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-384d6c32-e983-4e49-986f-2492761792c0 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:35:44 devstack sudo[102199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-384d6c32-e983-4e49-986f-2492761792c0 1073741824 Sep 28 09:35:44 devstack sudo[102199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:35:44 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-81dd6cdd-93c8-4b58-b323-859780d403fa tempest-VolumesSnapshotNegativeTestJSON-952146700 None] Create snapshot completed successfully Sep 28 09:35:45 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-44c8f6bd-1d21-489b-89f8-8b47dcc35549 tempest-VolumesSnapshotNegativeTestJSON-952146700 None] Acquiring lock "cinder-5feec05e-a920-4b68-924f-777730375bd7-delete_snapshot" by "delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:35:45 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-44c8f6bd-1d21-489b-89f8-8b47dcc35549 tempest-VolumesSnapshotNegativeTestJSON-952146700 None] Lock "cinder-5feec05e-a920-4b68-924f-777730375bd7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:35:45 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-44c8f6bd-1d21-489b-89f8-8b47dcc35549 tempest-VolumesSnapshotNegativeTestJSON-952146700 None] Acquiring lock "cinder-quobyte-e06d7033-36af-450b-be83-fb906157f875" by "delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:35:45 devstack sudo[102199]: pam_unix(sudo:session): session closed for user root Sep 28 09:35:45 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-44c8f6bd-1d21-489b-89f8-8b47dcc35549 tempest-VolumesSnapshotNegativeTestJSON-952146700 None] Lock "cinder-quobyte-e06d7033-36af-450b-be83-fb906157f875" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:35:45 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-44c8f6bd-1d21-489b-89f8-8b47dcc35549 tempest-VolumesSnapshotNegativeTestJSON-952146700 None] Acquiring lock "cinder-quobyte-5feec05e-a920-4b68-924f-777730375bd7" by "_delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:35:45 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-5a83a318-670d-4998-bc98-cd26ef4087d5 tempest-VolumesGetTest-1635800146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-384d6c32-e983-4e49-986f-2492761792c0 1073741824" returned: 0 in 0.580s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:35:45 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-44c8f6bd-1d21-489b-89f8-8b47dcc35549 tempest-VolumesSnapshotNegativeTestJSON-952146700 None] Lock "cinder-quobyte-5feec05e-a920-4b68-924f-777730375bd7" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:35:45 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-44c8f6bd-1d21-489b-89f8-8b47dcc35549 tempest-VolumesSnapshotNegativeTestJSON-952146700 None] Deleting offline snapshot 5feec05e-a920-4b68-924f-777730375bd7 of volume e06d7033-36af-450b-be83-fb906157f875 {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 09:35:45 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-44c8f6bd-1d21-489b-89f8-8b47dcc35549 tempest-VolumesSnapshotNegativeTestJSON-952146700 None] snapshot_file for this snap is: volume-e06d7033-36af-450b-be83-fb906157f875.5feec05e-a920-4b68-924f-777730375bd7 {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 09:35:45 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffaee53c-e92a-4488-8d04-1bfdb53f7531]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:35:45 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-44c8f6bd-1d21-489b-89f8-8b47dcc35549 tempest-VolumesSnapshotNegativeTestJSON-952146700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-e06d7033-36af-450b-be83-fb906157f875.5feec05e-a920-4b68-924f-777730375bd7 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:35:45 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-5a83a318-670d-4998-bc98-cd26ef4087d5 tempest-VolumesGetTest-1635800146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-384d6c32-e983-4e49-986f-2492761792c0 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:35:45 devstack sudo[102205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-384d6c32-e983-4e49-986f-2492761792c0 Sep 28 09:35:45 devstack sudo[102205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:35:45 devstack sudo[102204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-e06d7033-36af-450b-be83-fb906157f875.5feec05e-a920-4b68-924f-777730375bd7 Sep 28 09:35:45 devstack sudo[102204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:35:45 devstack sudo[102205]: pam_unix(sudo:session): session closed for user root Sep 28 09:35:45 devstack sudo[102178]: pam_unix(sudo:session): session closed for user root Sep 28 09:35:45 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-5a83a318-670d-4998-bc98-cd26ef4087d5 tempest-VolumesGetTest-1635800146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-384d6c32-e983-4e49-986f-2492761792c0" returned: 0 in 0.439s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:35:45 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-78c3f96d-51af-4742-a882-cf1637d52f76 tempest-TestShelveInstance-165027966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1a11c21d-88b0-4620-aa82-1ded26f580c9_00tb8i0cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-57d3d311-43fc-4c70-b1dd-0cf01f63a115" returned: 0 in 2.409s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:35:45 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-5a83a318-670d-4998-bc98-cd26ef4087d5 tempest-VolumesGetTest-1635800146 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:35:45 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-5a83a318-670d-4998-bc98-cd26ef4087d5 tempest-VolumesGetTest-1635800146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.127s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:35:45 devstack cinder-volume[86553]: DEBUG cinder.image.image_utils [None req-78c3f96d-51af-4742-a882-cf1637d52f76 tempest-TestShelveInstance-165027966 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1a11c21d-88b0-4620-aa82-1ded26f580c9_00tb8i0cdevstack@QuobyteHD, size 112.00 MB, duration 2.42 sec, destination /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-57d3d311-43fc-4c70-b1dd-0cf01f63a115 {{(pid=86553) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 09:35:45 devstack cinder-volume[86553]: INFO cinder.image.image_utils [None req-78c3f96d-51af-4742-a882-cf1637d52f76 tempest-TestShelveInstance-165027966 None] Converted 112.00 MB image at 46.30 MB/s Sep 28 09:35:45 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-78c3f96d-51af-4742-a882-cf1637d52f76 tempest-TestShelveInstance-165027966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-57d3d311-43fc-4c70-b1dd-0cf01f63a115 1G {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:35:45 devstack sudo[102212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-57d3d311-43fc-4c70-b1dd-0cf01f63a115 1G Sep 28 09:35:45 devstack sudo[102212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:35:45 devstack sudo[102204]: pam_unix(sudo:session): session closed for user root Sep 28 09:35:45 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-5a83a318-670d-4998-bc98-cd26ef4087d5 tempest-VolumesGetTest-1635800146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18c7f7a9-9aad-47e1-8b62-73fe753c93ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-384d6c32-e983-4e49-986f-2492761792c0', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:35:45 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-5a83a318-670d-4998-bc98-cd26ef4087d5 tempest-VolumesGetTest-1635800146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (262bafed-b6c9-480f-972b-8d46df959f3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:35:45 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-44c8f6bd-1d21-489b-89f8-8b47dcc35549 tempest-VolumesSnapshotNegativeTestJSON-952146700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-e06d7033-36af-450b-be83-fb906157f875.5feec05e-a920-4b68-924f-777730375bd7" returned: 0 in 0.529s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:35:45 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-44c8f6bd-1d21-489b-89f8-8b47dcc35549 tempest-VolumesSnapshotNegativeTestJSON-952146700 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e06d7033-36af-450b-be83-fb906157f875(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86553) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 09:35:46 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-5a83a318-670d-4998-bc98-cd26ef4087d5 tempest-VolumesGetTest-1635800146 None] Volume volume-384d6c32-e983-4e49-986f-2492761792c0 (384d6c32-e983-4e49-986f-2492761792c0): created successfully Sep 28 09:35:46 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-5a83a318-670d-4998-bc98-cd26ef4087d5 tempest-VolumesGetTest-1635800146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (262bafed-b6c9-480f-972b-8d46df959f3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:35:46 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-5a83a318-670d-4998-bc98-cd26ef4087d5 tempest-VolumesGetTest-1635800146 None] Flow 'volume_create_manager' (c31a1dc3-1028-4b8e-989e-8e6650304801) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:35:46 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa5fee1-1490-4a50-8898-ed6d1738521b]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:35:46 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-44c8f6bd-1d21-489b-89f8-8b47dcc35549 tempest-VolumesSnapshotNegativeTestJSON-952146700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-e06d7033-36af-450b-be83-fb906157f875 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:35:46 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-5a83a318-670d-4998-bc98-cd26ef4087d5 tempest-VolumesGetTest-1635800146 None] Created volume successfully. Sep 28 09:35:46 devstack sudo[102214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-e06d7033-36af-450b-be83-fb906157f875 Sep 28 09:35:46 devstack sudo[102214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:35:46 devstack sudo[102212]: pam_unix(sudo:session): session closed for user root Sep 28 09:35:46 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-78c3f96d-51af-4742-a882-cf1637d52f76 tempest-TestShelveInstance-165027966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-57d3d311-43fc-4c70-b1dd-0cf01f63a115 1G" returned: 0 in 0.373s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:35:46 devstack cinder-volume[86553]: DEBUG cinder.volume.volume_utils [None req-78c3f96d-51af-4742-a882-cf1637d52f76 tempest-TestShelveInstance-165027966 None] Downloaded image 1a11c21d-88b0-4620-aa82-1ded26f580c9 ((None, [{'url': 'file:///opt/stack/data/glance/images/1a11c21d-88b0-4620-aa82-1ded26f580c9', 'metadata': {}}])) to volume 57d3d311-43fc-4c70-b1dd-0cf01f63a115 successfully. {{(pid=86553) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 09:35:46 devstack cinder-volume[86553]: DEBUG cinder.image.image_utils [None req-78c3f96d-51af-4742-a882-cf1637d52f76 tempest-TestShelveInstance-165027966 None] Temporary image 1a11c21d-88b0-4620-aa82-1ded26f580c9 for user ac3af7c5557444fdab121bc4c175f5aa is deleted. {{(pid=86553) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 09:35:46 devstack cinder-volume[86553]: DEBUG cinder.volume.volume_utils [None req-78c3f96d-51af-4742-a882-cf1637d52f76 tempest-TestShelveInstance-165027966 None] Marking volume 57d3d311-43fc-4c70-b1dd-0cf01f63a115 as bootable. {{(pid=86553) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 09:35:46 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-78c3f96d-51af-4742-a882-cf1637d52f76 tempest-TestShelveInstance-165027966 None] Copying metadata from image 1a11c21d-88b0-4620-aa82-1ded26f580c9 to 57d3d311-43fc-4c70-b1dd-0cf01f63a115. {{(pid=86553) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 09:35:46 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-78c3f96d-51af-4742-a882-cf1637d52f76 tempest-TestShelveInstance-165027966 None] Creating volume glance metadata for volume 57d3d311-43fc-4c70-b1dd-0cf01f63a115 backed by image 1a11c21d-88b0-4620-aa82-1ded26f580c9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '1a11c21d-88b0-4620-aa82-1ded26f580c9', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86553) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 09:35:46 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-78c3f96d-51af-4742-a882-cf1637d52f76 tempest-TestShelveInstance-165027966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86c2b870-aa65-49db-b0c1-3daf7318eccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57d3d311-43fc-4c70-b1dd-0cf01f63a115', 'volume_size': 1, 'image_id': '1a11c21d-88b0-4620-aa82-1ded26f580c9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1a11c21d-88b0-4620-aa82-1ded26f580c9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b800784c68dc485682fd42484c46336e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1a11c21d-88b0-4620-aa82-1ded26f580c9', 'created_at': datetime.datetime(2026, 9, 28, 7, 16, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 7, 16, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a11c21d-88b0-4620-aa82-1ded26f580c9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:35:46 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-78c3f96d-51af-4742-a882-cf1637d52f76 tempest-TestShelveInstance-165027966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (628d258b-c626-4b75-a302-e53255fedd28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:35:46 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-78c3f96d-51af-4742-a882-cf1637d52f76 tempest-TestShelveInstance-165027966 None] Volume volume-57d3d311-43fc-4c70-b1dd-0cf01f63a115 (57d3d311-43fc-4c70-b1dd-0cf01f63a115): created successfully Sep 28 09:35:46 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-78c3f96d-51af-4742-a882-cf1637d52f76 tempest-TestShelveInstance-165027966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (628d258b-c626-4b75-a302-e53255fedd28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:35:46 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-78c3f96d-51af-4742-a882-cf1637d52f76 tempest-TestShelveInstance-165027966 None] Flow 'volume_create_manager' (7186db98-4be1-412a-8925-63ced23ef57f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:35:46 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-78c3f96d-51af-4742-a882-cf1637d52f76 tempest-TestShelveInstance-165027966 None] Created volume successfully. Sep 28 09:35:46 devstack sudo[102214]: pam_unix(sudo:session): session closed for user root Sep 28 09:35:46 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-44c8f6bd-1d21-489b-89f8-8b47dcc35549 tempest-VolumesSnapshotNegativeTestJSON-952146700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-e06d7033-36af-450b-be83-fb906157f875" returned: 0 in 0.441s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:35:46 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-44c8f6bd-1d21-489b-89f8-8b47dcc35549 tempest-VolumesSnapshotNegativeTestJSON-952146700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-e06d7033-36af-450b-be83-fb906157f875.5feec05e-a920-4b68-924f-777730375bd7 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:35:46 devstack sudo[102222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-e06d7033-36af-450b-be83-fb906157f875.5feec05e-a920-4b68-924f-777730375bd7 Sep 28 09:35:46 devstack sudo[102222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:35:46 devstack sudo[102222]: pam_unix(sudo:session): session closed for user root Sep 28 09:35:46 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-44c8f6bd-1d21-489b-89f8-8b47dcc35549 tempest-VolumesSnapshotNegativeTestJSON-952146700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-e06d7033-36af-450b-be83-fb906157f875.5feec05e-a920-4b68-924f-777730375bd7" returned: 0 in 0.411s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:35:46 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-44c8f6bd-1d21-489b-89f8-8b47dcc35549 tempest-VolumesSnapshotNegativeTestJSON-952146700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-e06d7033-36af-450b-be83-fb906157f875.5feec05e-a920-4b68-924f-777730375bd7 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:35:46 devstack sudo[102228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-e06d7033-36af-450b-be83-fb906157f875.5feec05e-a920-4b68-924f-777730375bd7 Sep 28 09:35:46 devstack sudo[102228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:35:47 devstack sudo[102228]: pam_unix(sudo:session): session closed for user root Sep 28 09:35:47 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-44c8f6bd-1d21-489b-89f8-8b47dcc35549 tempest-VolumesSnapshotNegativeTestJSON-952146700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-e06d7033-36af-450b-be83-fb906157f875.5feec05e-a920-4b68-924f-777730375bd7" returned: 0 in 0.327s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:35:47 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-44c8f6bd-1d21-489b-89f8-8b47dcc35549 tempest-VolumesSnapshotNegativeTestJSON-952146700 None] Lock "cinder-quobyte-5feec05e-a920-4b68-924f-777730375bd7" released by "_delete_snapshot" :: held 1.888s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:35:47 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-44c8f6bd-1d21-489b-89f8-8b47dcc35549 tempest-VolumesSnapshotNegativeTestJSON-952146700 None] Lock "cinder-quobyte-e06d7033-36af-450b-be83-fb906157f875" released by "delete_snapshot" :: held 1.917s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:35:47 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-44c8f6bd-1d21-489b-89f8-8b47dcc35549 tempest-VolumesSnapshotNegativeTestJSON-952146700 None] Created reservations ['66cd14ec-4fcd-4617-87e9-e2a4bd6d6b50', '810d8f7a-c3a9-4d19-a95d-77cff8fb406e', '726fe651-2e09-4baf-8b3c-cafe96a37604', 'e5579906-b277-4e13-83c9-1696d480b7b4'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:35:47 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-44c8f6bd-1d21-489b-89f8-8b47dcc35549 tempest-VolumesSnapshotNegativeTestJSON-952146700 None] Delete snapshot completed successfully. Sep 28 09:35:47 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-44c8f6bd-1d21-489b-89f8-8b47dcc35549 tempest-VolumesSnapshotNegativeTestJSON-952146700 None] Lock "cinder-5feec05e-a920-4b68-924f-777730375bd7-delete_snapshot" released by "delete_snapshot" :: held 2.115s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:35:47 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-f67d4f28-f539-4c2e-a376-0f90b5e42973 tempest-VolumesSnapshotNegativeTestJSON-952146700 None] Acquiring lock "cinder-e06d7033-36af-450b-be83-fb906157f875-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:35:47 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-f67d4f28-f539-4c2e-a376-0f90b5e42973 tempest-VolumesSnapshotNegativeTestJSON-952146700 None] Lock "cinder-e06d7033-36af-450b-be83-fb906157f875-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:35:47 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-f67d4f28-f539-4c2e-a376-0f90b5e42973 tempest-VolumesSnapshotNegativeTestJSON-952146700 None] Acquiring lock "cinder-quobyte-e06d7033-36af-450b-be83-fb906157f875" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:35:47 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-f67d4f28-f539-4c2e-a376-0f90b5e42973 tempest-VolumesSnapshotNegativeTestJSON-952146700 None] Lock "cinder-quobyte-e06d7033-36af-450b-be83-fb906157f875" acquired by "delete_volume" :: waited 0.024s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:35:47 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fcc7cd8-2956-48b5-bc19-96817cdad289 tempest-VolumesGetTest-1635800146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:35:47 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[929b8432-a64a-420b-8066-d24d5433a29a]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:35:47 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f67d4f28-f539-4c2e-a376-0f90b5e42973 tempest-VolumesSnapshotNegativeTestJSON-952146700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-e06d7033-36af-450b-be83-fb906157f875 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:35:47 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-2fcc7cd8-2956-48b5-bc19-96817cdad289 tempest-VolumesGetTest-1635800146 None] Flow 'volume_create_manager' (a5b1ad38-6c63-4d9e-9a11-98f0f31f8704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:35:47 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-2fcc7cd8-2956-48b5-bc19-96817cdad289 tempest-VolumesGetTest-1635800146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a205900d-3660-47a8-8ab9-c0ec4acfbea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:35:47 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-2fcc7cd8-2956-48b5-bc19-96817cdad289 tempest-VolumesGetTest-1635800146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a205900d-3660-47a8-8ab9-c0ec4acfbea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:35:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1728894073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b468a874-966f-45d8-9c80-47909915d9ca,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='be84b080459e458496b0d755a3c89703',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:35:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=384d6c32-e983-4e49-986f-2492761792c0,status='creating',terminated_at=None,updated_at=2026-09-28T07:35:48Z,use_quota=True,user_id='a7990b3b37d84bc4acd2288b34b11a7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:35:47 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-2fcc7cd8-2956-48b5-bc19-96817cdad289 tempest-VolumesGetTest-1635800146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43bf949f-770d-4a48-a8ba-a8688d5248d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:35:47 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-2fcc7cd8-2956-48b5-bc19-96817cdad289 tempest-VolumesGetTest-1635800146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43bf949f-770d-4a48-a8ba-a8688d5248d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:35:47 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-2fcc7cd8-2956-48b5-bc19-96817cdad289 tempest-VolumesGetTest-1635800146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e23b4291-f968-435d-99b5-5dd9a3d86827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:35:47 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-2fcc7cd8-2956-48b5-bc19-96817cdad289 tempest-VolumesGetTest-1635800146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e23b4291-f968-435d-99b5-5dd9a3d86827) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'b468a874-966f-45d8-9c80-47909915d9ca', 'volume_name': 'volume-b468a874-966f-45d8-9c80-47909915d9ca', 'volume_size': 1, 'source_volid': '384d6c32-e983-4e49-986f-2492761792c0', 'source_volstatus': 'available'}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:35:47 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-2fcc7cd8-2956-48b5-bc19-96817cdad289 tempest-VolumesGetTest-1635800146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f1dd809-2c8c-4274-86ce-bde61b1c65c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:35:47 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-2fcc7cd8-2956-48b5-bc19-96817cdad289 tempest-VolumesGetTest-1635800146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f1dd809-2c8c-4274-86ce-bde61b1c65c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:35:48 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-2fcc7cd8-2956-48b5-bc19-96817cdad289 tempest-VolumesGetTest-1635800146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d1f538c-a223-47b1-b4cd-089cd8ccc4e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:35:48 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-2fcc7cd8-2956-48b5-bc19-96817cdad289 tempest-VolumesGetTest-1635800146 None] Volume b468a874-966f-45d8-9c80-47909915d9ca: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-b468a874-966f-45d8-9c80-47909915d9ca', 'volume_size': 1, 'source_volid': '384d6c32-e983-4e49-986f-2492761792c0', 'source_volstatus': 'available'} Sep 28 09:35:48 devstack sudo[102232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-e06d7033-36af-450b-be83-fb906157f875 Sep 28 09:35:48 devstack sudo[102232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:35:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-2fcc7cd8-2956-48b5-bc19-96817cdad289 tempest-VolumesGetTest-1635800146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:35:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-2fcc7cd8-2956-48b5-bc19-96817cdad289 tempest-VolumesGetTest-1635800146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:35:48 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-2fcc7cd8-2956-48b5-bc19-96817cdad289 tempest-VolumesGetTest-1635800146 None] Cloning volume 384d6c32-e983-4e49-986f-2492761792c0 to volume b468a874-966f-45d8-9c80-47909915d9ca Sep 28 09:35:48 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-2fcc7cd8-2956-48b5-bc19-96817cdad289 tempest-VolumesGetTest-1635800146 None] Creating offline snapshot ea41c746-b3a9-4a72-bafc-ac42aabda589 of volume 384d6c32-e983-4e49-986f-2492761792c0 {{(pid=86553) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 09:35:48 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[660c7497-e96d-4815-92ef-142d33b73953]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:35:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2fcc7cd8-2956-48b5-bc19-96817cdad289 tempest-VolumesGetTest-1635800146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-384d6c32-e983-4e49-986f-2492761792c0 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:35:48 devstack sudo[102234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-384d6c32-e983-4e49-986f-2492761792c0 Sep 28 09:35:48 devstack sudo[102234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:35:48 devstack sudo[102232]: pam_unix(sudo:session): session closed for user root Sep 28 09:35:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f67d4f28-f539-4c2e-a376-0f90b5e42973 tempest-VolumesSnapshotNegativeTestJSON-952146700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-e06d7033-36af-450b-be83-fb906157f875" returned: 0 in 0.505s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:35:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f67d4f28-f539-4c2e-a376-0f90b5e42973 tempest-VolumesSnapshotNegativeTestJSON-952146700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-e06d7033-36af-450b-be83-fb906157f875 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:35:48 devstack sudo[102242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-e06d7033-36af-450b-be83-fb906157f875 Sep 28 09:35:48 devstack sudo[102242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:35:48 devstack sudo[102234]: pam_unix(sudo:session): session closed for user root Sep 28 09:35:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2fcc7cd8-2956-48b5-bc19-96817cdad289 tempest-VolumesGetTest-1635800146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-384d6c32-e983-4e49-986f-2492761792c0" returned: 0 in 0.496s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:35:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2fcc7cd8-2956-48b5-bc19-96817cdad289 tempest-VolumesGetTest-1635800146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-384d6c32-e983-4e49-986f-2492761792c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-384d6c32-e983-4e49-986f-2492761792c0.ea41c746-b3a9-4a72-bafc-ac42aabda589 1G {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:35:48 devstack sudo[102248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-384d6c32-e983-4e49-986f-2492761792c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-384d6c32-e983-4e49-986f-2492761792c0.ea41c746-b3a9-4a72-bafc-ac42aabda589 1G Sep 28 09:35:48 devstack sudo[102248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:35:48 devstack sudo[102242]: pam_unix(sudo:session): session closed for user root Sep 28 09:35:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f67d4f28-f539-4c2e-a376-0f90b5e42973 tempest-VolumesSnapshotNegativeTestJSON-952146700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-e06d7033-36af-450b-be83-fb906157f875" returned: 0 in 0.367s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:35:48 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-f67d4f28-f539-4c2e-a376-0f90b5e42973 tempest-VolumesSnapshotNegativeTestJSON-952146700 None] Lock "cinder-quobyte-e06d7033-36af-450b-be83-fb906157f875" released by "delete_volume" :: held 0.971s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:35:48 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-f67d4f28-f539-4c2e-a376-0f90b5e42973 tempest-VolumesSnapshotNegativeTestJSON-952146700 None] Created reservations ['432630a3-ba88-458e-af49-70fdf9f0d51f', '02e4e69e-cbf5-4aeb-ae6f-533170cb898c', '388ecf2d-d924-49e9-81e4-867b6b138e86', '9dbe1134-dbf1-453c-a38a-16ee23af0929'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:35:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-f67d4f28-f539-4c2e-a376-0f90b5e42973 tempest-VolumesSnapshotNegativeTestJSON-952146700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:35:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-f67d4f28-f539-4c2e-a376-0f90b5e42973 tempest-VolumesSnapshotNegativeTestJSON-952146700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:35:48 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-f67d4f28-f539-4c2e-a376-0f90b5e42973 tempest-VolumesSnapshotNegativeTestJSON-952146700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:35:48 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-f67d4f28-f539-4c2e-a376-0f90b5e42973 tempest-VolumesSnapshotNegativeTestJSON-952146700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:35:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-f67d4f28-f539-4c2e-a376-0f90b5e42973 tempest-VolumesSnapshotNegativeTestJSON-952146700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:35:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f67d4f28-f539-4c2e-a376-0f90b5e42973 tempest-VolumesSnapshotNegativeTestJSON-952146700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:35:48 devstack sudo[102252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:35:48 devstack sudo[102252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:35:49 devstack sudo[102248]: pam_unix(sudo:session): session closed for user root Sep 28 09:35:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2fcc7cd8-2956-48b5-bc19-96817cdad289 tempest-VolumesGetTest-1635800146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-384d6c32-e983-4e49-986f-2492761792c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-384d6c32-e983-4e49-986f-2492761792c0.ea41c746-b3a9-4a72-bafc-ac42aabda589 1G" returned: 0 in 0.633s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:35:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2fcc7cd8-2956-48b5-bc19-96817cdad289 tempest-VolumesGetTest-1635800146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-384d6c32-e983-4e49-986f-2492761792c0 -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-384d6c32-e983-4e49-986f-2492761792c0.ea41c746-b3a9-4a72-bafc-ac42aabda589 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:35:49 devstack sudo[102252]: pam_unix(sudo:session): session closed for user root Sep 28 09:35:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f67d4f28-f539-4c2e-a376-0f90b5e42973 tempest-VolumesSnapshotNegativeTestJSON-952146700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.316s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:35:49 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-f67d4f28-f539-4c2e-a376-0f90b5e42973 tempest-VolumesSnapshotNegativeTestJSON-952146700 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:35:49 devstack sudo[102258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-384d6c32-e983-4e49-986f-2492761792c0 -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-384d6c32-e983-4e49-986f-2492761792c0.ea41c746-b3a9-4a72-bafc-ac42aabda589 Sep 28 09:35:49 devstack sudo[102258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:35:49 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-f67d4f28-f539-4c2e-a376-0f90b5e42973 tempest-VolumesSnapshotNegativeTestJSON-952146700 None] Deleted volume successfully. Sep 28 09:35:49 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-f67d4f28-f539-4c2e-a376-0f90b5e42973 tempest-VolumesSnapshotNegativeTestJSON-952146700 None] Lock "cinder-e06d7033-36af-450b-be83-fb906157f875-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:35:49 devstack sudo[102258]: pam_unix(sudo:session): session closed for user root Sep 28 09:35:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2fcc7cd8-2956-48b5-bc19-96817cdad289 tempest-VolumesGetTest-1635800146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-384d6c32-e983-4e49-986f-2492761792c0 -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-384d6c32-e983-4e49-986f-2492761792c0.ea41c746-b3a9-4a72-bafc-ac42aabda589" returned: 0 in 0.409s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:35:49 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-2fcc7cd8-2956-48b5-bc19-96817cdad289 tempest-VolumesGetTest-1635800146 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-384d6c32-e983-4e49-986f-2492761792c0.ea41c746-b3a9-4a72-bafc-ac42aabda589 is being set with open permissions: ugo+rw Sep 28 09:35:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2fcc7cd8-2956-48b5-bc19-96817cdad289 tempest-VolumesGetTest-1635800146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-384d6c32-e983-4e49-986f-2492761792c0.ea41c746-b3a9-4a72-bafc-ac42aabda589 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:35:49 devstack sudo[102263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-384d6c32-e983-4e49-986f-2492761792c0.ea41c746-b3a9-4a72-bafc-ac42aabda589 Sep 28 09:35:49 devstack sudo[102263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:35:49 devstack sudo[102263]: pam_unix(sudo:session): session closed for user root Sep 28 09:35:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2fcc7cd8-2956-48b5-bc19-96817cdad289 tempest-VolumesGetTest-1635800146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-384d6c32-e983-4e49-986f-2492761792c0.ea41c746-b3a9-4a72-bafc-ac42aabda589" returned: 0 in 0.324s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:35:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2fcc7cd8-2956-48b5-bc19-96817cdad289 tempest-VolumesGetTest-1635800146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-384d6c32-e983-4e49-986f-2492761792c0.info {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:35:50 devstack sudo[102266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-384d6c32-e983-4e49-986f-2492761792c0.info Sep 28 09:35:50 devstack sudo[102266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:35:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-3c42a43a-354c-49a9-8d74-dcbb3020dbe3 req-66a01ba4-3ed8-4e4b-be85-e0c578c2c987 tempest-TestShelveInstance-165027966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:35:50 devstack sudo[102266]: pam_unix(sudo:session): session closed for user root Sep 28 09:35:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2fcc7cd8-2956-48b5-bc19-96817cdad289 tempest-VolumesGetTest-1635800146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-384d6c32-e983-4e49-986f-2492761792c0.info" returned: 0 in 0.461s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:35:50 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-2fcc7cd8-2956-48b5-bc19-96817cdad289 tempest-VolumesGetTest-1635800146 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-384d6c32-e983-4e49-986f-2492761792c0.info is being set with open permissions: ugo+rw Sep 28 09:35:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2fcc7cd8-2956-48b5-bc19-96817cdad289 tempest-VolumesGetTest-1635800146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-384d6c32-e983-4e49-986f-2492761792c0.info {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:35:50 devstack sudo[102277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-384d6c32-e983-4e49-986f-2492761792c0.info Sep 28 09:35:50 devstack sudo[102277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:35:50 devstack sudo[102277]: pam_unix(sudo:session): session closed for user root Sep 28 09:35:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2fcc7cd8-2956-48b5-bc19-96817cdad289 tempest-VolumesGetTest-1635800146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-384d6c32-e983-4e49-986f-2492761792c0.info" returned: 0 in 0.373s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:35:50 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-2fcc7cd8-2956-48b5-bc19-96817cdad289 tempest-VolumesGetTest-1635800146 None] Acquiring lock "cinder-quobyte-b468a874-966f-45d8-9c80-47909915d9ca" by "_copy_volume_from_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:35:50 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-2fcc7cd8-2956-48b5-bc19-96817cdad289 tempest-VolumesGetTest-1635800146 None] Lock "cinder-quobyte-b468a874-966f-45d8-9c80-47909915d9ca" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:35:50 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-2fcc7cd8-2956-48b5-bc19-96817cdad289 tempest-VolumesGetTest-1635800146 None] snapshot: ea41c746-b3a9-4a72-bafc-ac42aabda589, volume: b468a874-966f-45d8-9c80-47909915d9ca, {{(pid=86553) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 09:35:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-2fcc7cd8-2956-48b5-bc19-96817cdad289 tempest-VolumesGetTest-1635800146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:35:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-2fcc7cd8-2956-48b5-bc19-96817cdad289 tempest-VolumesGetTest-1635800146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:35:50 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-2fcc7cd8-2956-48b5-bc19-96817cdad289 tempest-VolumesGetTest-1635800146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:35:50 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-2fcc7cd8-2956-48b5-bc19-96817cdad289 tempest-VolumesGetTest-1635800146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:35:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-2fcc7cd8-2956-48b5-bc19-96817cdad289 tempest-VolumesGetTest-1635800146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:35:50 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f2b03b9-1a04-4584-9704-95a1a53009e6]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:35:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2fcc7cd8-2956-48b5-bc19-96817cdad289 tempest-VolumesGetTest-1635800146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-384d6c32-e983-4e49-986f-2492761792c0.ea41c746-b3a9-4a72-bafc-ac42aabda589 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:35:51 devstack sudo[102280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-384d6c32-e983-4e49-986f-2492761792c0.ea41c746-b3a9-4a72-bafc-ac42aabda589 Sep 28 09:35:51 devstack sudo[102280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:35:51 devstack sudo[102280]: pam_unix(sudo:session): session closed for user root Sep 28 09:35:51 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2fcc7cd8-2956-48b5-bc19-96817cdad289 tempest-VolumesGetTest-1635800146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-384d6c32-e983-4e49-986f-2492761792c0.ea41c746-b3a9-4a72-bafc-ac42aabda589" returned: 0 in 0.450s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:35:51 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-2fcc7cd8-2956-48b5-bc19-96817cdad289 tempest-VolumesGetTest-1635800146 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-384d6c32-e983-4e49-986f-2492761792c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86553) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 09:35:51 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae92574-61db-428f-ac00-39474f24805b]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:35:51 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2fcc7cd8-2956-48b5-bc19-96817cdad289 tempest-VolumesGetTest-1635800146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-384d6c32-e983-4e49-986f-2492761792c0 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:35:51 devstack sudo[102285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-384d6c32-e983-4e49-986f-2492761792c0 Sep 28 09:35:51 devstack sudo[102285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:35:51 devstack sudo[102285]: pam_unix(sudo:session): session closed for user root Sep 28 09:35:51 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2fcc7cd8-2956-48b5-bc19-96817cdad289 tempest-VolumesGetTest-1635800146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-384d6c32-e983-4e49-986f-2492761792c0" returned: 0 in 0.388s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:35:51 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-2fcc7cd8-2956-48b5-bc19-96817cdad289 tempest-VolumesGetTest-1635800146 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-384d6c32-e983-4e49-986f-2492761792c0 {{(pid=86553) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 09:35:51 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-2fcc7cd8-2956-48b5-bc19-96817cdad289 tempest-VolumesGetTest-1635800146 None] Creating direct copy from snapshot {{(pid=86553) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 09:35:51 devstack cinder-volume[86553]: DEBUG cinder.utils [None req-2fcc7cd8-2956-48b5-bc19-96817cdad289 tempest-VolumesGetTest-1635800146 None] Path /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b468a874-966f-45d8-9c80-47909915d9ca not found in is_blk_device check {{(pid=86553) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 09:35:51 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2fcc7cd8-2956-48b5-bc19-96817cdad289 tempest-VolumesGetTest-1635800146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-384d6c32-e983-4e49-986f-2492761792c0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b468a874-966f-45d8-9c80-47909915d9ca {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:35:51 devstack sudo[102290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-384d6c32-e983-4e49-986f-2492761792c0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b468a874-966f-45d8-9c80-47909915d9ca Sep 28 09:35:51 devstack sudo[102290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:35:59 devstack cinder-volume[86553]: DEBUG dbcounter [-] [86553] Writing DB stats cinder:UPDATE=52,cinder:INSERT=21,cinder:DELETE=3,cinder:SELECT=48 {{(pid=86553) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 09:36:00 devstack cinder-volume[86553]: DEBUG dbcounter [-] [86553] Writing DB stats cinder:SELECT=44,cinder:UPDATE=53,cinder:INSERT=18,cinder:DELETE=6 {{(pid=86553) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 09:36:00 devstack sudo[102290]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:00 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2fcc7cd8-2956-48b5-bc19-96817cdad289 tempest-VolumesGetTest-1635800146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-384d6c32-e983-4e49-986f-2492761792c0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b468a874-966f-45d8-9c80-47909915d9ca" returned: 0 in 9.190s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:00 devstack cinder-volume[86553]: DEBUG cinder.image.image_utils [None req-2fcc7cd8-2956-48b5-bc19-96817cdad289 tempest-VolumesGetTest-1635800146 None] Image conversion details: src /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-384d6c32-e983-4e49-986f-2492761792c0, size 1024.00 MB, duration 9.19 sec, destination /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b468a874-966f-45d8-9c80-47909915d9ca {{(pid=86553) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 09:36:00 devstack cinder-volume[86553]: INFO cinder.image.image_utils [None req-2fcc7cd8-2956-48b5-bc19-96817cdad289 tempest-VolumesGetTest-1635800146 None] Converted 1024.00 MB image at 111.41 MB/s Sep 28 09:36:00 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-2fcc7cd8-2956-48b5-bc19-96817cdad289 tempest-VolumesGetTest-1635800146 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b468a874-966f-45d8-9c80-47909915d9ca is being set with open permissions: ugo+rw Sep 28 09:36:00 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2fcc7cd8-2956-48b5-bc19-96817cdad289 tempest-VolumesGetTest-1635800146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b468a874-966f-45d8-9c80-47909915d9ca {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:01 devstack sudo[102307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b468a874-966f-45d8-9c80-47909915d9ca Sep 28 09:36:01 devstack sudo[102307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:01 devstack sudo[102307]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:01 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2fcc7cd8-2956-48b5-bc19-96817cdad289 tempest-VolumesGetTest-1635800146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b468a874-966f-45d8-9c80-47909915d9ca" returned: 0 in 0.267s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:01 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-2fcc7cd8-2956-48b5-bc19-96817cdad289 tempest-VolumesGetTest-1635800146 None] Lock "cinder-quobyte-b468a874-966f-45d8-9c80-47909915d9ca" released by "_copy_volume_from_snapshot" :: held 10.370s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:36:01 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-2fcc7cd8-2956-48b5-bc19-96817cdad289 tempest-VolumesGetTest-1635800146 None] Acquiring lock "cinder-quobyte-ea41c746-b3a9-4a72-bafc-ac42aabda589" by "_delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:36:01 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-2fcc7cd8-2956-48b5-bc19-96817cdad289 tempest-VolumesGetTest-1635800146 None] Lock "cinder-quobyte-ea41c746-b3a9-4a72-bafc-ac42aabda589" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:36:01 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-2fcc7cd8-2956-48b5-bc19-96817cdad289 tempest-VolumesGetTest-1635800146 None] Deleting offline snapshot ea41c746-b3a9-4a72-bafc-ac42aabda589 of volume 384d6c32-e983-4e49-986f-2492761792c0 {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 09:36:01 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-2fcc7cd8-2956-48b5-bc19-96817cdad289 tempest-VolumesGetTest-1635800146 None] snapshot_file for this snap is: volume-384d6c32-e983-4e49-986f-2492761792c0.ea41c746-b3a9-4a72-bafc-ac42aabda589 {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 09:36:01 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf5ff16-e471-4415-8c46-fab61c7e588e]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:36:01 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2fcc7cd8-2956-48b5-bc19-96817cdad289 tempest-VolumesGetTest-1635800146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-384d6c32-e983-4e49-986f-2492761792c0.ea41c746-b3a9-4a72-bafc-ac42aabda589 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:01 devstack sudo[102312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-384d6c32-e983-4e49-986f-2492761792c0.ea41c746-b3a9-4a72-bafc-ac42aabda589 Sep 28 09:36:01 devstack sudo[102312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:01 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef783cf9-c2f2-4776-9f02-90071bee7e79 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:36:01 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ef783cf9-c2f2-4776-9f02-90071bee7e79 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Flow 'volume_create_manager' (d458fd6c-bda6-46cf-a7be-8b8a89d5e0fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:36:01 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ef783cf9-c2f2-4776-9f02-90071bee7e79 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39b1ed8f-8cf7-4e1e-94f7-b09989b2ba11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:36:01 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ef783cf9-c2f2-4776-9f02-90071bee7e79 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39b1ed8f-8cf7-4e1e-94f7-b09989b2ba11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:36:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2021545502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9333397-e5e6-4da5-9e73-1da4b9b904eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e359d0925eb44f2a7e561320a744426',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:36:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:36:02Z,use_quota=True,user_id='e74b62425230402993f1838c109fbc44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:36:01 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ef783cf9-c2f2-4776-9f02-90071bee7e79 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6af7a633-2f64-4ee3-b8b9-95d7b1f80ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:36:01 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ef783cf9-c2f2-4776-9f02-90071bee7e79 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6af7a633-2f64-4ee3-b8b9-95d7b1f80ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:36:01 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ef783cf9-c2f2-4776-9f02-90071bee7e79 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f58401e-7ce3-40aa-b64d-440f2c6842e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:36:01 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ef783cf9-c2f2-4776-9f02-90071bee7e79 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f58401e-7ce3-40aa-b64d-440f2c6842e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9333397-e5e6-4da5-9e73-1da4b9b904eb', 'volume_name': 'volume-a9333397-e5e6-4da5-9e73-1da4b9b904eb', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:36:01 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ef783cf9-c2f2-4776-9f02-90071bee7e79 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e420d101-1b8c-414c-9466-190d842a9c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:36:01 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ef783cf9-c2f2-4776-9f02-90071bee7e79 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e420d101-1b8c-414c-9466-190d842a9c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:36:01 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ef783cf9-c2f2-4776-9f02-90071bee7e79 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93af648b-e65b-4c9f-8aea-2c60d3221e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:36:01 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-ef783cf9-c2f2-4776-9f02-90071bee7e79 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Volume a9333397-e5e6-4da5-9e73-1da4b9b904eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9333397-e5e6-4da5-9e73-1da4b9b904eb', 'volume_size': 1} Sep 28 09:36:01 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ef783cf9-c2f2-4776-9f02-90071bee7e79 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:36:01 devstack sudo[102312]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:01 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2fcc7cd8-2956-48b5-bc19-96817cdad289 tempest-VolumesGetTest-1635800146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-384d6c32-e983-4e49-986f-2492761792c0.ea41c746-b3a9-4a72-bafc-ac42aabda589" returned: 0 in 0.426s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:01 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-2fcc7cd8-2956-48b5-bc19-96817cdad289 tempest-VolumesGetTest-1635800146 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-384d6c32-e983-4e49-986f-2492761792c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86553) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 09:36:01 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[4838e083-21b5-4465-8370-12742d7fb7f1]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:36:01 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2fcc7cd8-2956-48b5-bc19-96817cdad289 tempest-VolumesGetTest-1635800146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-384d6c32-e983-4e49-986f-2492761792c0 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:01 devstack sudo[102317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-384d6c32-e983-4e49-986f-2492761792c0 Sep 28 09:36:01 devstack sudo[102317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:02 devstack sudo[102317]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:02 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2fcc7cd8-2956-48b5-bc19-96817cdad289 tempest-VolumesGetTest-1635800146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-384d6c32-e983-4e49-986f-2492761792c0" returned: 0 in 0.604s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:02 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2fcc7cd8-2956-48b5-bc19-96817cdad289 tempest-VolumesGetTest-1635800146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-384d6c32-e983-4e49-986f-2492761792c0.ea41c746-b3a9-4a72-bafc-ac42aabda589 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:02 devstack sudo[102322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-384d6c32-e983-4e49-986f-2492761792c0.ea41c746-b3a9-4a72-bafc-ac42aabda589 Sep 28 09:36:02 devstack sudo[102322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:02 devstack sudo[102322]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:02 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2fcc7cd8-2956-48b5-bc19-96817cdad289 tempest-VolumesGetTest-1635800146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-384d6c32-e983-4e49-986f-2492761792c0.ea41c746-b3a9-4a72-bafc-ac42aabda589" returned: 0 in 0.341s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:02 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2fcc7cd8-2956-48b5-bc19-96817cdad289 tempest-VolumesGetTest-1635800146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-384d6c32-e983-4e49-986f-2492761792c0.ea41c746-b3a9-4a72-bafc-ac42aabda589 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:02 devstack sudo[102327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-384d6c32-e983-4e49-986f-2492761792c0.ea41c746-b3a9-4a72-bafc-ac42aabda589 Sep 28 09:36:02 devstack sudo[102327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:03 devstack sudo[102327]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:03 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2fcc7cd8-2956-48b5-bc19-96817cdad289 tempest-VolumesGetTest-1635800146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-384d6c32-e983-4e49-986f-2492761792c0.ea41c746-b3a9-4a72-bafc-ac42aabda589" returned: 0 in 0.275s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:03 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-2fcc7cd8-2956-48b5-bc19-96817cdad289 tempest-VolumesGetTest-1635800146 None] Lock "cinder-quobyte-ea41c746-b3a9-4a72-bafc-ac42aabda589" released by "_delete_snapshot" :: held 1.824s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:36:03 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-2fcc7cd8-2956-48b5-bc19-96817cdad289 tempest-VolumesGetTest-1635800146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.138s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:36:03 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-3c42a43a-354c-49a9-8d74-dcbb3020dbe3 req-66a01ba4-3ed8-4e4b-be85-e0c578c2c987 tempest-TestShelveInstance-165027966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 12.751s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:36:03 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-3c42a43a-354c-49a9-8d74-dcbb3020dbe3 req-66a01ba4-3ed8-4e4b-be85-e0c578c2c987 tempest-TestShelveInstance-165027966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:36:03 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ef783cf9-c2f2-4776-9f02-90071bee7e79 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.469s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:36:03 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ef783cf9-c2f2-4776-9f02-90071bee7e79 tempest-CreateVolumesFromSnapshotTest-1951497831 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:36:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2021545502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9333397-e5e6-4da5-9e73-1da4b9b904eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e359d0925eb44f2a7e561320a744426',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:36:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:36:02Z,use_quota=True,user_id='e74b62425230402993f1838c109fbc44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:36:03 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-ef783cf9-c2f2-4776-9f02-90071bee7e79 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Creating volume a9333397-e5e6-4da5-9e73-1da4b9b904eb {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:36:03 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ef783cf9-c2f2-4776-9f02-90071bee7e79 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:36:03 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ef783cf9-c2f2-4776-9f02-90071bee7e79 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:36:03 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ef783cf9-c2f2-4776-9f02-90071bee7e79 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:36:03 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ef783cf9-c2f2-4776-9f02-90071bee7e79 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:36:03 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ef783cf9-c2f2-4776-9f02-90071bee7e79 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:36:03 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ef783cf9-c2f2-4776-9f02-90071bee7e79 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:36:03 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-ef783cf9-c2f2-4776-9f02-90071bee7e79 tempest-CreateVolumesFromSnapshotTest-1951497831 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:36:03 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ef783cf9-c2f2-4776-9f02-90071bee7e79 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a9333397-e5e6-4da5-9e73-1da4b9b904eb 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:03 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-2fcc7cd8-2956-48b5-bc19-96817cdad289 tempest-VolumesGetTest-1635800146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d1f538c-a223-47b1-b4cd-089cd8ccc4e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b468a874-966f-45d8-9c80-47909915d9ca', 'volume_size': 1, 'source_volid': '384d6c32-e983-4e49-986f-2492761792c0', 'source_volstatus': 'available'}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:36:03 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-2fcc7cd8-2956-48b5-bc19-96817cdad289 tempest-VolumesGetTest-1635800146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc95e4b5-5260-4f05-800b-3f8f5dcb2320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:36:03 devstack sudo[102330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a9333397-e5e6-4da5-9e73-1da4b9b904eb 1073741824 Sep 28 09:36:03 devstack sudo[102330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:03 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-2fcc7cd8-2956-48b5-bc19-96817cdad289 tempest-VolumesGetTest-1635800146 None] Volume volume-b468a874-966f-45d8-9c80-47909915d9ca (b468a874-966f-45d8-9c80-47909915d9ca): created successfully Sep 28 09:36:03 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-2fcc7cd8-2956-48b5-bc19-96817cdad289 tempest-VolumesGetTest-1635800146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc95e4b5-5260-4f05-800b-3f8f5dcb2320) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:36:03 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-2fcc7cd8-2956-48b5-bc19-96817cdad289 tempest-VolumesGetTest-1635800146 None] Flow 'volume_create_manager' (a5b1ad38-6c63-4d9e-9a11-98f0f31f8704) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:36:03 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [req-3c42a43a-354c-49a9-8d74-dcbb3020dbe3 req-66a01ba4-3ed8-4e4b-be85-e0c578c2c987 tempest-TestShelveInstance-165027966 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d', 'name': 'volume-57d3d311-43fc-4c70-b1dd-0cf01f63a115', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd706afb6-9158-46fe-8ae7-d7f0ca6f5634', 'enforce_multipath': True} {{(pid=86553) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 09:36:03 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-2fcc7cd8-2956-48b5-bc19-96817cdad289 tempest-VolumesGetTest-1635800146 None] Created volume successfully. Sep 28 09:36:03 devstack cinder-volume[86553]: INFO cinder.volume.manager [req-3c42a43a-354c-49a9-8d74-dcbb3020dbe3 req-66a01ba4-3ed8-4e4b-be85-e0c578c2c987 tempest-TestShelveInstance-165027966 None] attachment_update completed successfully. Sep 28 09:36:03 devstack sudo[102330]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:03 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ef783cf9-c2f2-4776-9f02-90071bee7e79 tempest-CreateVolumesFromSnapshotTest-1951497831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a9333397-e5e6-4da5-9e73-1da4b9b904eb 1073741824" returned: 0 in 0.732s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:03 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ef783cf9-c2f2-4776-9f02-90071bee7e79 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a9333397-e5e6-4da5-9e73-1da4b9b904eb {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:04 devstack sudo[102360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a9333397-e5e6-4da5-9e73-1da4b9b904eb Sep 28 09:36:04 devstack sudo[102360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:04 devstack sudo[102360]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:04 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ef783cf9-c2f2-4776-9f02-90071bee7e79 tempest-CreateVolumesFromSnapshotTest-1951497831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a9333397-e5e6-4da5-9e73-1da4b9b904eb" returned: 0 in 0.538s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:04 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ef783cf9-c2f2-4776-9f02-90071bee7e79 tempest-CreateVolumesFromSnapshotTest-1951497831 None] <== create_volume: return (1342ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:36:04 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ef783cf9-c2f2-4776-9f02-90071bee7e79 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.345s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:36:04 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ef783cf9-c2f2-4776-9f02-90071bee7e79 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93af648b-e65b-4c9f-8aea-2c60d3221e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9333397-e5e6-4da5-9e73-1da4b9b904eb', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:36:04 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ef783cf9-c2f2-4776-9f02-90071bee7e79 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3b2aab6-0012-4445-b241-98707075c701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:36:04 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-ef783cf9-c2f2-4776-9f02-90071bee7e79 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Volume volume-a9333397-e5e6-4da5-9e73-1da4b9b904eb (a9333397-e5e6-4da5-9e73-1da4b9b904eb): created successfully Sep 28 09:36:04 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ef783cf9-c2f2-4776-9f02-90071bee7e79 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3b2aab6-0012-4445-b241-98707075c701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:36:04 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ef783cf9-c2f2-4776-9f02-90071bee7e79 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Flow 'volume_create_manager' (d458fd6c-bda6-46cf-a7be-8b8a89d5e0fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:36:04 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-ef783cf9-c2f2-4776-9f02-90071bee7e79 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Created volume successfully. Sep 28 09:36:05 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bd83ec8-3d0c-461b-b340-220d1a65c9d5 tempest-VolumesGetTest-1635800146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:36:05 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-8bd83ec8-3d0c-461b-b340-220d1a65c9d5 tempest-VolumesGetTest-1635800146 None] Flow 'volume_create_manager' (03b7749a-3fa9-444e-81c2-8e41ea5d66b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:36:05 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-8bd83ec8-3d0c-461b-b340-220d1a65c9d5 tempest-VolumesGetTest-1635800146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (863c350d-234c-448f-8bb8-b5c507bc38a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:36:05 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-8bd83ec8-3d0c-461b-b340-220d1a65c9d5 tempest-VolumesGetTest-1635800146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (863c350d-234c-448f-8bb8-b5c507bc38a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:36:04Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-604719312',display_name='tempest-VolumesGetTest-Volume-1406705671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f294a086-a3e7-4f68-8fb5-dfebe9a43f27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be84b080459e458496b0d755a3c89703',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:36:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:36:05Z,use_quota=True,user_id='a7990b3b37d84bc4acd2288b34b11a7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:36:05 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-8bd83ec8-3d0c-461b-b340-220d1a65c9d5 tempest-VolumesGetTest-1635800146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93c71582-0f98-4b7d-87ab-2b41f05d7964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:36:05 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-8bd83ec8-3d0c-461b-b340-220d1a65c9d5 tempest-VolumesGetTest-1635800146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93c71582-0f98-4b7d-87ab-2b41f05d7964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:36:05 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-8bd83ec8-3d0c-461b-b340-220d1a65c9d5 tempest-VolumesGetTest-1635800146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66d1f2a9-4001-42a8-bf8e-8da551c16d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:36:05 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-8bd83ec8-3d0c-461b-b340-220d1a65c9d5 tempest-VolumesGetTest-1635800146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66d1f2a9-4001-42a8-bf8e-8da551c16d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f294a086-a3e7-4f68-8fb5-dfebe9a43f27', 'volume_name': 'volume-f294a086-a3e7-4f68-8fb5-dfebe9a43f27', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:36:05 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-8bd83ec8-3d0c-461b-b340-220d1a65c9d5 tempest-VolumesGetTest-1635800146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (169114de-5f3e-42bc-8a9a-5ab189cc281e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:36:05 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-8bd83ec8-3d0c-461b-b340-220d1a65c9d5 tempest-VolumesGetTest-1635800146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (169114de-5f3e-42bc-8a9a-5ab189cc281e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:36:05 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-8bd83ec8-3d0c-461b-b340-220d1a65c9d5 tempest-VolumesGetTest-1635800146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6df7a278-6f76-49c3-a13e-dda8c145afa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:36:05 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-8bd83ec8-3d0c-461b-b340-220d1a65c9d5 tempest-VolumesGetTest-1635800146 None] Volume f294a086-a3e7-4f68-8fb5-dfebe9a43f27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f294a086-a3e7-4f68-8fb5-dfebe9a43f27', 'volume_size': 1} Sep 28 09:36:05 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-8bd83ec8-3d0c-461b-b340-220d1a65c9d5 tempest-VolumesGetTest-1635800146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:36:05 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-8bd83ec8-3d0c-461b-b340-220d1a65c9d5 tempest-VolumesGetTest-1635800146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:36:05 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-8bd83ec8-3d0c-461b-b340-220d1a65c9d5 tempest-VolumesGetTest-1635800146 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:36:04Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-604719312',display_name='tempest-VolumesGetTest-Volume-1406705671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f294a086-a3e7-4f68-8fb5-dfebe9a43f27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be84b080459e458496b0d755a3c89703',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:36:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:36:05Z,use_quota=True,user_id='a7990b3b37d84bc4acd2288b34b11a7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:36:05 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-8bd83ec8-3d0c-461b-b340-220d1a65c9d5 tempest-VolumesGetTest-1635800146 None] Creating volume f294a086-a3e7-4f68-8fb5-dfebe9a43f27 {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:36:05 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-8bd83ec8-3d0c-461b-b340-220d1a65c9d5 tempest-VolumesGetTest-1635800146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:36:05 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-8bd83ec8-3d0c-461b-b340-220d1a65c9d5 tempest-VolumesGetTest-1635800146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:36:05 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-8bd83ec8-3d0c-461b-b340-220d1a65c9d5 tempest-VolumesGetTest-1635800146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:36:05 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-8bd83ec8-3d0c-461b-b340-220d1a65c9d5 tempest-VolumesGetTest-1635800146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:36:05 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-8bd83ec8-3d0c-461b-b340-220d1a65c9d5 tempest-VolumesGetTest-1635800146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:36:05 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-8bd83ec8-3d0c-461b-b340-220d1a65c9d5 tempest-VolumesGetTest-1635800146 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:36:05 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-8bd83ec8-3d0c-461b-b340-220d1a65c9d5 tempest-VolumesGetTest-1635800146 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:36:05 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-8bd83ec8-3d0c-461b-b340-220d1a65c9d5 tempest-VolumesGetTest-1635800146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f294a086-a3e7-4f68-8fb5-dfebe9a43f27 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:05 devstack sudo[102795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f294a086-a3e7-4f68-8fb5-dfebe9a43f27 1073741824 Sep 28 09:36:05 devstack sudo[102795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:05 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-2e5a914f-c3ac-468b-9e5e-257a171273de tempest-CreateVolumesFromSnapshotTest-1951497831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:36:06 devstack sudo[102795]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-8bd83ec8-3d0c-461b-b340-220d1a65c9d5 tempest-VolumesGetTest-1635800146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f294a086-a3e7-4f68-8fb5-dfebe9a43f27 1073741824" returned: 0 in 0.753s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-8bd83ec8-3d0c-461b-b340-220d1a65c9d5 tempest-VolumesGetTest-1635800146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f294a086-a3e7-4f68-8fb5-dfebe9a43f27 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:06 devstack sudo[102819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f294a086-a3e7-4f68-8fb5-dfebe9a43f27 Sep 28 09:36:06 devstack sudo[102819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:06 devstack sudo[102819]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-8bd83ec8-3d0c-461b-b340-220d1a65c9d5 tempest-VolumesGetTest-1635800146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f294a086-a3e7-4f68-8fb5-dfebe9a43f27" returned: 0 in 0.373s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:06 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-8bd83ec8-3d0c-461b-b340-220d1a65c9d5 tempest-VolumesGetTest-1635800146 None] <== create_volume: return (1189ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:36:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-8bd83ec8-3d0c-461b-b340-220d1a65c9d5 tempest-VolumesGetTest-1635800146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.193s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:36:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-2e5a914f-c3ac-468b-9e5e-257a171273de tempest-CreateVolumesFromSnapshotTest-1951497831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.087s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:36:06 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-8bd83ec8-3d0c-461b-b340-220d1a65c9d5 tempest-VolumesGetTest-1635800146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6df7a278-6f76-49c3-a13e-dda8c145afa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f294a086-a3e7-4f68-8fb5-dfebe9a43f27', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:36:06 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-8bd83ec8-3d0c-461b-b340-220d1a65c9d5 tempest-VolumesGetTest-1635800146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85f55381-ad2d-44b2-a613-bdf69da54604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:36:06 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-2e5a914f-c3ac-468b-9e5e-257a171273de tempest-CreateVolumesFromSnapshotTest-1951497831 None] Creating offline snapshot cc1fb8a1-52b9-43ea-8f63-cae5a94c4d35 of volume a9333397-e5e6-4da5-9e73-1da4b9b904eb {{(pid=86553) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 09:36:06 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-8bd83ec8-3d0c-461b-b340-220d1a65c9d5 tempest-VolumesGetTest-1635800146 None] Volume volume-f294a086-a3e7-4f68-8fb5-dfebe9a43f27 (f294a086-a3e7-4f68-8fb5-dfebe9a43f27): created successfully Sep 28 09:36:06 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-8bd83ec8-3d0c-461b-b340-220d1a65c9d5 tempest-VolumesGetTest-1635800146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85f55381-ad2d-44b2-a613-bdf69da54604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:36:06 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-8bd83ec8-3d0c-461b-b340-220d1a65c9d5 tempest-VolumesGetTest-1635800146 None] Flow 'volume_create_manager' (03b7749a-3fa9-444e-81c2-8e41ea5d66b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:36:06 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d1cb77a-4121-4ef6-8285-699adc0423a8]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:36:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2e5a914f-c3ac-468b-9e5e-257a171273de tempest-CreateVolumesFromSnapshotTest-1951497831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a9333397-e5e6-4da5-9e73-1da4b9b904eb {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:06 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-8bd83ec8-3d0c-461b-b340-220d1a65c9d5 tempest-VolumesGetTest-1635800146 None] Created volume successfully. Sep 28 09:36:06 devstack sudo[102836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a9333397-e5e6-4da5-9e73-1da4b9b904eb Sep 28 09:36:06 devstack sudo[102836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:07 devstack sudo[102836]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:07 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2e5a914f-c3ac-468b-9e5e-257a171273de tempest-CreateVolumesFromSnapshotTest-1951497831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a9333397-e5e6-4da5-9e73-1da4b9b904eb" returned: 0 in 0.585s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:07 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2e5a914f-c3ac-468b-9e5e-257a171273de tempest-CreateVolumesFromSnapshotTest-1951497831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a9333397-e5e6-4da5-9e73-1da4b9b904eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a9333397-e5e6-4da5-9e73-1da4b9b904eb.cc1fb8a1-52b9-43ea-8f63-cae5a94c4d35 1G {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:07 devstack sudo[102842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a9333397-e5e6-4da5-9e73-1da4b9b904eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a9333397-e5e6-4da5-9e73-1da4b9b904eb.cc1fb8a1-52b9-43ea-8f63-cae5a94c4d35 1G Sep 28 09:36:07 devstack sudo[102842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:07 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-ee8b0b77-edec-4d2a-aba5-79c6521d5248 tempest-VolumesGetTest-1635800146 None] Acquiring lock "cinder-f294a086-a3e7-4f68-8fb5-dfebe9a43f27-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:36:07 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-ee8b0b77-edec-4d2a-aba5-79c6521d5248 tempest-VolumesGetTest-1635800146 None] Lock "cinder-f294a086-a3e7-4f68-8fb5-dfebe9a43f27-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:36:07 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-ee8b0b77-edec-4d2a-aba5-79c6521d5248 tempest-VolumesGetTest-1635800146 None] Acquiring lock "cinder-quobyte-f294a086-a3e7-4f68-8fb5-dfebe9a43f27" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:36:07 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-ee8b0b77-edec-4d2a-aba5-79c6521d5248 tempest-VolumesGetTest-1635800146 None] Lock "cinder-quobyte-f294a086-a3e7-4f68-8fb5-dfebe9a43f27" acquired by "delete_volume" :: waited 0.022s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:36:07 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[661754ba-0342-4634-9cfd-568420c0d81d]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:36:07 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ee8b0b77-edec-4d2a-aba5-79c6521d5248 tempest-VolumesGetTest-1635800146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f294a086-a3e7-4f68-8fb5-dfebe9a43f27 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:07 devstack sudo[102844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f294a086-a3e7-4f68-8fb5-dfebe9a43f27 Sep 28 09:36:07 devstack sudo[102844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:08 devstack sudo[102844]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:08 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ee8b0b77-edec-4d2a-aba5-79c6521d5248 tempest-VolumesGetTest-1635800146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f294a086-a3e7-4f68-8fb5-dfebe9a43f27" returned: 0 in 0.644s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:08 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ee8b0b77-edec-4d2a-aba5-79c6521d5248 tempest-VolumesGetTest-1635800146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f294a086-a3e7-4f68-8fb5-dfebe9a43f27 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:08 devstack sudo[102856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f294a086-a3e7-4f68-8fb5-dfebe9a43f27 Sep 28 09:36:08 devstack sudo[102856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:08 devstack sudo[102842]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:08 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2e5a914f-c3ac-468b-9e5e-257a171273de tempest-CreateVolumesFromSnapshotTest-1951497831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a9333397-e5e6-4da5-9e73-1da4b9b904eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a9333397-e5e6-4da5-9e73-1da4b9b904eb.cc1fb8a1-52b9-43ea-8f63-cae5a94c4d35 1G" returned: 0 in 1.215s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:08 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2e5a914f-c3ac-468b-9e5e-257a171273de tempest-CreateVolumesFromSnapshotTest-1951497831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9333397-e5e6-4da5-9e73-1da4b9b904eb -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a9333397-e5e6-4da5-9e73-1da4b9b904eb.cc1fb8a1-52b9-43ea-8f63-cae5a94c4d35 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:08 devstack sudo[102858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9333397-e5e6-4da5-9e73-1da4b9b904eb -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a9333397-e5e6-4da5-9e73-1da4b9b904eb.cc1fb8a1-52b9-43ea-8f63-cae5a94c4d35 Sep 28 09:36:08 devstack sudo[102858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:08 devstack sudo[102856]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:08 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ee8b0b77-edec-4d2a-aba5-79c6521d5248 tempest-VolumesGetTest-1635800146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f294a086-a3e7-4f68-8fb5-dfebe9a43f27" returned: 0 in 0.451s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:08 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-ee8b0b77-edec-4d2a-aba5-79c6521d5248 tempest-VolumesGetTest-1635800146 None] Lock "cinder-quobyte-f294a086-a3e7-4f68-8fb5-dfebe9a43f27" released by "delete_volume" :: held 1.210s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:36:08 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-ee8b0b77-edec-4d2a-aba5-79c6521d5248 tempest-VolumesGetTest-1635800146 None] Created reservations ['beaca117-7ad9-4773-9869-9d3276bbdba2', '950e246a-cb91-4b69-a89b-c84792b24a80', '06ad2e8f-1acb-450a-996f-db094f52592e', '0bb19d8c-4c5e-4837-b3a3-d2d3aebd4ff1'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:36:08 devstack sudo[102858]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:08 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2e5a914f-c3ac-468b-9e5e-257a171273de tempest-CreateVolumesFromSnapshotTest-1951497831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9333397-e5e6-4da5-9e73-1da4b9b904eb -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a9333397-e5e6-4da5-9e73-1da4b9b904eb.cc1fb8a1-52b9-43ea-8f63-cae5a94c4d35" returned: 0 in 0.587s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:08 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-2e5a914f-c3ac-468b-9e5e-257a171273de tempest-CreateVolumesFromSnapshotTest-1951497831 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a9333397-e5e6-4da5-9e73-1da4b9b904eb.cc1fb8a1-52b9-43ea-8f63-cae5a94c4d35 is being set with open permissions: ugo+rw Sep 28 09:36:08 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2e5a914f-c3ac-468b-9e5e-257a171273de tempest-CreateVolumesFromSnapshotTest-1951497831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a9333397-e5e6-4da5-9e73-1da4b9b904eb.cc1fb8a1-52b9-43ea-8f63-cae5a94c4d35 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:09 devstack sudo[102865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a9333397-e5e6-4da5-9e73-1da4b9b904eb.cc1fb8a1-52b9-43ea-8f63-cae5a94c4d35 Sep 28 09:36:09 devstack sudo[102865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ee8b0b77-edec-4d2a-aba5-79c6521d5248 tempest-VolumesGetTest-1635800146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:36:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ee8b0b77-edec-4d2a-aba5-79c6521d5248 tempest-VolumesGetTest-1635800146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:36:09 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ee8b0b77-edec-4d2a-aba5-79c6521d5248 tempest-VolumesGetTest-1635800146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:36:09 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ee8b0b77-edec-4d2a-aba5-79c6521d5248 tempest-VolumesGetTest-1635800146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:36:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ee8b0b77-edec-4d2a-aba5-79c6521d5248 tempest-VolumesGetTest-1635800146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:36:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ee8b0b77-edec-4d2a-aba5-79c6521d5248 tempest-VolumesGetTest-1635800146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:09 devstack sudo[102867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:36:09 devstack sudo[102867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:09 devstack sudo[102865]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2e5a914f-c3ac-468b-9e5e-257a171273de tempest-CreateVolumesFromSnapshotTest-1951497831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a9333397-e5e6-4da5-9e73-1da4b9b904eb.cc1fb8a1-52b9-43ea-8f63-cae5a94c4d35" returned: 0 in 0.509s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:09 devstack sudo[102867]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2e5a914f-c3ac-468b-9e5e-257a171273de tempest-CreateVolumesFromSnapshotTest-1951497831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a9333397-e5e6-4da5-9e73-1da4b9b904eb.info {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ee8b0b77-edec-4d2a-aba5-79c6521d5248 tempest-VolumesGetTest-1635800146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.491s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:09 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-ee8b0b77-edec-4d2a-aba5-79c6521d5248 tempest-VolumesGetTest-1635800146 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:36:09 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-ee8b0b77-edec-4d2a-aba5-79c6521d5248 tempest-VolumesGetTest-1635800146 None] Deleted volume successfully. Sep 28 09:36:09 devstack sudo[102871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a9333397-e5e6-4da5-9e73-1da4b9b904eb.info Sep 28 09:36:09 devstack sudo[102871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:09 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-ee8b0b77-edec-4d2a-aba5-79c6521d5248 tempest-VolumesGetTest-1635800146 None] Lock "cinder-f294a086-a3e7-4f68-8fb5-dfebe9a43f27-delete_volume" released by "delete_volume" :: held 2.201s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:36:09 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-05f40522-3cd6-4e42-a4dc-00efd133b44e tempest-VolumesGetTest-1635800146 None] Acquiring lock "cinder-b468a874-966f-45d8-9c80-47909915d9ca-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:36:10 devstack sudo[102871]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:10 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-05f40522-3cd6-4e42-a4dc-00efd133b44e tempest-VolumesGetTest-1635800146 None] Lock "cinder-b468a874-966f-45d8-9c80-47909915d9ca-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:36:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2e5a914f-c3ac-468b-9e5e-257a171273de tempest-CreateVolumesFromSnapshotTest-1951497831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a9333397-e5e6-4da5-9e73-1da4b9b904eb.info" returned: 0 in 0.537s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:10 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-2e5a914f-c3ac-468b-9e5e-257a171273de tempest-CreateVolumesFromSnapshotTest-1951497831 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a9333397-e5e6-4da5-9e73-1da4b9b904eb.info is being set with open permissions: ugo+rw Sep 28 09:36:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2e5a914f-c3ac-468b-9e5e-257a171273de tempest-CreateVolumesFromSnapshotTest-1951497831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a9333397-e5e6-4da5-9e73-1da4b9b904eb.info {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:10 devstack sudo[102874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a9333397-e5e6-4da5-9e73-1da4b9b904eb.info Sep 28 09:36:10 devstack sudo[102874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:10 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-05f40522-3cd6-4e42-a4dc-00efd133b44e tempest-VolumesGetTest-1635800146 None] Acquiring lock "cinder-quobyte-b468a874-966f-45d8-9c80-47909915d9ca" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:36:10 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-05f40522-3cd6-4e42-a4dc-00efd133b44e tempest-VolumesGetTest-1635800146 None] Lock "cinder-quobyte-b468a874-966f-45d8-9c80-47909915d9ca" acquired by "delete_volume" :: waited 0.025s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:36:10 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[defd796e-b338-4965-a9e7-4dcdaf65a3f2]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:36:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-05f40522-3cd6-4e42-a4dc-00efd133b44e tempest-VolumesGetTest-1635800146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b468a874-966f-45d8-9c80-47909915d9ca {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:10 devstack sudo[102876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b468a874-966f-45d8-9c80-47909915d9ca Sep 28 09:36:10 devstack sudo[102876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:10 devstack sudo[102874]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2e5a914f-c3ac-468b-9e5e-257a171273de tempest-CreateVolumesFromSnapshotTest-1951497831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a9333397-e5e6-4da5-9e73-1da4b9b904eb.info" returned: 0 in 0.750s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-2e5a914f-c3ac-468b-9e5e-257a171273de tempest-CreateVolumesFromSnapshotTest-1951497831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.387s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:36:10 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-2e5a914f-c3ac-468b-9e5e-257a171273de tempest-CreateVolumesFromSnapshotTest-1951497831 None] Create snapshot completed successfully Sep 28 09:36:11 devstack sudo[102876]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:11 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-05f40522-3cd6-4e42-a4dc-00efd133b44e tempest-VolumesGetTest-1635800146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b468a874-966f-45d8-9c80-47909915d9ca" returned: 0 in 0.817s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:11 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-05f40522-3cd6-4e42-a4dc-00efd133b44e tempest-VolumesGetTest-1635800146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b468a874-966f-45d8-9c80-47909915d9ca {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:11 devstack sudo[102883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b468a874-966f-45d8-9c80-47909915d9ca Sep 28 09:36:11 devstack sudo[102883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:11 devstack sudo[102883]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:11 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-05f40522-3cd6-4e42-a4dc-00efd133b44e tempest-VolumesGetTest-1635800146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b468a874-966f-45d8-9c80-47909915d9ca" returned: 0 in 0.533s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:11 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-05f40522-3cd6-4e42-a4dc-00efd133b44e tempest-VolumesGetTest-1635800146 None] Lock "cinder-quobyte-b468a874-966f-45d8-9c80-47909915d9ca" released by "delete_volume" :: held 1.437s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:36:11 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-05f40522-3cd6-4e42-a4dc-00efd133b44e tempest-VolumesGetTest-1635800146 None] Created reservations ['bbcf08dc-c31d-4d37-b6ca-e65392a02253', '3cd3c2fb-6f9a-427f-bea8-e0a9e20651d8', '95103dbb-5207-4577-a00f-ab5c2b3c9373', 'e388a644-6a4d-45f4-9a4f-50eef63efa10'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:36:11 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-05f40522-3cd6-4e42-a4dc-00efd133b44e tempest-VolumesGetTest-1635800146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:36:11 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-05f40522-3cd6-4e42-a4dc-00efd133b44e tempest-VolumesGetTest-1635800146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:36:11 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-05f40522-3cd6-4e42-a4dc-00efd133b44e tempest-VolumesGetTest-1635800146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:36:11 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-05f40522-3cd6-4e42-a4dc-00efd133b44e tempest-VolumesGetTest-1635800146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:36:11 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-05f40522-3cd6-4e42-a4dc-00efd133b44e tempest-VolumesGetTest-1635800146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:36:11 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-05f40522-3cd6-4e42-a4dc-00efd133b44e tempest-VolumesGetTest-1635800146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:11 devstack sudo[102886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:36:11 devstack sudo[102886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:12 devstack sudo[102886]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:12 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-05f40522-3cd6-4e42-a4dc-00efd133b44e tempest-VolumesGetTest-1635800146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.429s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:12 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-05f40522-3cd6-4e42-a4dc-00efd133b44e tempest-VolumesGetTest-1635800146 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:36:12 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-05f40522-3cd6-4e42-a4dc-00efd133b44e tempest-VolumesGetTest-1635800146 None] Deleted volume successfully. Sep 28 09:36:12 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-05f40522-3cd6-4e42-a4dc-00efd133b44e tempest-VolumesGetTest-1635800146 None] Lock "cinder-b468a874-966f-45d8-9c80-47909915d9ca-delete_volume" released by "delete_volume" :: held 2.375s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:36:12 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c44c793-1e89-458d-b434-688c2eb1a8cb tempest-CreateVolumesFromSnapshotTest-1951497831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:36:12 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-2c44c793-1e89-458d-b434-688c2eb1a8cb tempest-CreateVolumesFromSnapshotTest-1951497831 None] Flow 'volume_create_manager' (fc938f28-a3bc-4621-a587-bbda9ed5f39b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:36:12 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-2c44c793-1e89-458d-b434-688c2eb1a8cb tempest-CreateVolumesFromSnapshotTest-1951497831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f51328a-5ae1-4bac-8dbe-34563257735b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:36:12 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-2c44c793-1e89-458d-b434-688c2eb1a8cb tempest-CreateVolumesFromSnapshotTest-1951497831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f51328a-5ae1-4bac-8dbe-34563257735b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:36:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1026772346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55470911-773e-489a-9a2c-588bae208ad1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e359d0925eb44f2a7e561320a744426',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:36:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:36:12Z,use_quota=True,user_id='e74b62425230402993f1838c109fbc44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:36:12 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-2c44c793-1e89-458d-b434-688c2eb1a8cb tempest-CreateVolumesFromSnapshotTest-1951497831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f224fa7-d418-44dc-8564-2d77344e0040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:36:12 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-2c44c793-1e89-458d-b434-688c2eb1a8cb tempest-CreateVolumesFromSnapshotTest-1951497831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f224fa7-d418-44dc-8564-2d77344e0040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:36:12 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-2c44c793-1e89-458d-b434-688c2eb1a8cb tempest-CreateVolumesFromSnapshotTest-1951497831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9dd3357-0335-4603-98b2-df32cd58c196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:36:12 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-2c44c793-1e89-458d-b434-688c2eb1a8cb tempest-CreateVolumesFromSnapshotTest-1951497831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9dd3357-0335-4603-98b2-df32cd58c196) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55470911-773e-489a-9a2c-588bae208ad1', 'volume_name': 'volume-55470911-773e-489a-9a2c-588bae208ad1', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:36:12 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-2c44c793-1e89-458d-b434-688c2eb1a8cb tempest-CreateVolumesFromSnapshotTest-1951497831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72df043e-6b3b-470a-9187-a160fd425687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:36:12 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-2c44c793-1e89-458d-b434-688c2eb1a8cb tempest-CreateVolumesFromSnapshotTest-1951497831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72df043e-6b3b-470a-9187-a160fd425687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:36:12 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-2c44c793-1e89-458d-b434-688c2eb1a8cb tempest-CreateVolumesFromSnapshotTest-1951497831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (185025b5-abe4-4a7f-952c-3ef7649b2bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:36:12 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-2c44c793-1e89-458d-b434-688c2eb1a8cb tempest-CreateVolumesFromSnapshotTest-1951497831 None] Volume 55470911-773e-489a-9a2c-588bae208ad1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55470911-773e-489a-9a2c-588bae208ad1', 'volume_size': 1} Sep 28 09:36:12 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-2c44c793-1e89-458d-b434-688c2eb1a8cb tempest-CreateVolumesFromSnapshotTest-1951497831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:36:12 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-2c44c793-1e89-458d-b434-688c2eb1a8cb tempest-CreateVolumesFromSnapshotTest-1951497831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:36:12 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-2c44c793-1e89-458d-b434-688c2eb1a8cb tempest-CreateVolumesFromSnapshotTest-1951497831 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:36:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1026772346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55470911-773e-489a-9a2c-588bae208ad1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e359d0925eb44f2a7e561320a744426',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:36:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:36:12Z,use_quota=True,user_id='e74b62425230402993f1838c109fbc44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:36:12 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-2c44c793-1e89-458d-b434-688c2eb1a8cb tempest-CreateVolumesFromSnapshotTest-1951497831 None] Creating volume 55470911-773e-489a-9a2c-588bae208ad1 {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:36:12 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-2c44c793-1e89-458d-b434-688c2eb1a8cb tempest-CreateVolumesFromSnapshotTest-1951497831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:36:12 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-2c44c793-1e89-458d-b434-688c2eb1a8cb tempest-CreateVolumesFromSnapshotTest-1951497831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:36:12 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-2c44c793-1e89-458d-b434-688c2eb1a8cb tempest-CreateVolumesFromSnapshotTest-1951497831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:36:12 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-2c44c793-1e89-458d-b434-688c2eb1a8cb tempest-CreateVolumesFromSnapshotTest-1951497831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:36:12 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-2c44c793-1e89-458d-b434-688c2eb1a8cb tempest-CreateVolumesFromSnapshotTest-1951497831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:36:12 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-2c44c793-1e89-458d-b434-688c2eb1a8cb tempest-CreateVolumesFromSnapshotTest-1951497831 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:36:12 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-2c44c793-1e89-458d-b434-688c2eb1a8cb tempest-CreateVolumesFromSnapshotTest-1951497831 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:36:12 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2c44c793-1e89-458d-b434-688c2eb1a8cb tempest-CreateVolumesFromSnapshotTest-1951497831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-55470911-773e-489a-9a2c-588bae208ad1 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:12 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-83a72d59-2c81-4ae4-98c3-af7f26291049 tempest-VolumesGetTest-1635800146 None] Acquiring lock "cinder-384d6c32-e983-4e49-986f-2492761792c0-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:36:12 devstack sudo[102889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-55470911-773e-489a-9a2c-588bae208ad1 1073741824 Sep 28 09:36:12 devstack sudo[102889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:12 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-83a72d59-2c81-4ae4-98c3-af7f26291049 tempest-VolumesGetTest-1635800146 None] Lock "cinder-384d6c32-e983-4e49-986f-2492761792c0-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:36:12 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-83a72d59-2c81-4ae4-98c3-af7f26291049 tempest-VolumesGetTest-1635800146 None] Acquiring lock "cinder-quobyte-384d6c32-e983-4e49-986f-2492761792c0" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:36:12 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-83a72d59-2c81-4ae4-98c3-af7f26291049 tempest-VolumesGetTest-1635800146 None] Lock "cinder-quobyte-384d6c32-e983-4e49-986f-2492761792c0" acquired by "delete_volume" :: waited 0.051s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:36:13 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef8dda3d-ce67-490a-b68d-9098ecf545b7]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:36:13 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-83a72d59-2c81-4ae4-98c3-af7f26291049 tempest-VolumesGetTest-1635800146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-384d6c32-e983-4e49-986f-2492761792c0 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:13 devstack sudo[102891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-384d6c32-e983-4e49-986f-2492761792c0 Sep 28 09:36:13 devstack sudo[102891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:13 devstack sudo[102889]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:13 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2c44c793-1e89-458d-b434-688c2eb1a8cb tempest-CreateVolumesFromSnapshotTest-1951497831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-55470911-773e-489a-9a2c-588bae208ad1 1073741824" returned: 0 in 1.208s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:14 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-be0ce4b3-404b-49b6-84e8-04cbec348e6a tempest-CreateVolumesFromSnapshotTest-1951497831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:36:14 devstack sudo[102891]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:14 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-be0ce4b3-404b-49b6-84e8-04cbec348e6a tempest-CreateVolumesFromSnapshotTest-1951497831 None] Flow 'volume_create_manager' (9a60216a-27a2-4eae-b875-0a7fd0f6bd15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:36:14 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-be0ce4b3-404b-49b6-84e8-04cbec348e6a tempest-CreateVolumesFromSnapshotTest-1951497831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d73414fa-81ab-4eae-b26c-51f809642bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:36:14 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-83a72d59-2c81-4ae4-98c3-af7f26291049 tempest-VolumesGetTest-1635800146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-384d6c32-e983-4e49-986f-2492761792c0" returned: 0 in 0.972s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:14 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-83a72d59-2c81-4ae4-98c3-af7f26291049 tempest-VolumesGetTest-1635800146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-384d6c32-e983-4e49-986f-2492761792c0 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:14 devstack sudo[102900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-384d6c32-e983-4e49-986f-2492761792c0 Sep 28 09:36:14 devstack sudo[102900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:14 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-be0ce4b3-404b-49b6-84e8-04cbec348e6a tempest-CreateVolumesFromSnapshotTest-1951497831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d73414fa-81ab-4eae-b26c-51f809642bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:36:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1640257066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e070e431-73a7-4dab-af78-28d3d04b25c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e359d0925eb44f2a7e561320a744426',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:36:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:36:14Z,use_quota=True,user_id='e74b62425230402993f1838c109fbc44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:36:14 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-be0ce4b3-404b-49b6-84e8-04cbec348e6a tempest-CreateVolumesFromSnapshotTest-1951497831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (350c0db0-6706-48ed-8b0a-15076e2ce51b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:36:14 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-be0ce4b3-404b-49b6-84e8-04cbec348e6a tempest-CreateVolumesFromSnapshotTest-1951497831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (350c0db0-6706-48ed-8b0a-15076e2ce51b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:36:14 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-be0ce4b3-404b-49b6-84e8-04cbec348e6a tempest-CreateVolumesFromSnapshotTest-1951497831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (094473fa-8c32-4520-b220-a24fefa5e6a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:36:14 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-be0ce4b3-404b-49b6-84e8-04cbec348e6a tempest-CreateVolumesFromSnapshotTest-1951497831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (094473fa-8c32-4520-b220-a24fefa5e6a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e070e431-73a7-4dab-af78-28d3d04b25c2', 'volume_name': 'volume-e070e431-73a7-4dab-af78-28d3d04b25c2', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:36:14 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-be0ce4b3-404b-49b6-84e8-04cbec348e6a tempest-CreateVolumesFromSnapshotTest-1951497831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1ce9488-f818-4250-890b-06f8d551fc18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:36:14 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-be0ce4b3-404b-49b6-84e8-04cbec348e6a tempest-CreateVolumesFromSnapshotTest-1951497831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1ce9488-f818-4250-890b-06f8d551fc18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:36:14 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-be0ce4b3-404b-49b6-84e8-04cbec348e6a tempest-CreateVolumesFromSnapshotTest-1951497831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ea60b42-1626-4009-a444-74ef49c1602d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:36:14 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-be0ce4b3-404b-49b6-84e8-04cbec348e6a tempest-CreateVolumesFromSnapshotTest-1951497831 None] Volume e070e431-73a7-4dab-af78-28d3d04b25c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e070e431-73a7-4dab-af78-28d3d04b25c2', 'volume_size': 1} Sep 28 09:36:14 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-be0ce4b3-404b-49b6-84e8-04cbec348e6a tempest-CreateVolumesFromSnapshotTest-1951497831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:36:14 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2c44c793-1e89-458d-b434-688c2eb1a8cb tempest-CreateVolumesFromSnapshotTest-1951497831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-55470911-773e-489a-9a2c-588bae208ad1 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:14 devstack sudo[102902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-55470911-773e-489a-9a2c-588bae208ad1 Sep 28 09:36:14 devstack sudo[102902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:14 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-89970db7-bda6-48a9-b553-79c668c6ca18 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:36:14 devstack sudo[102900]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:14 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-89970db7-bda6-48a9-b553-79c668c6ca18 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Flow 'volume_create_manager' (9ea759e8-4ce1-4043-bdc1-5a91b460deaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:36:14 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-89970db7-bda6-48a9-b553-79c668c6ca18 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdd7d742-ea8f-4762-8a29-4243d0dd4980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:36:14 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-83a72d59-2c81-4ae4-98c3-af7f26291049 tempest-VolumesGetTest-1635800146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-384d6c32-e983-4e49-986f-2492761792c0" returned: 0 in 0.844s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:15 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-89970db7-bda6-48a9-b553-79c668c6ca18 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdd7d742-ea8f-4762-8a29-4243d0dd4980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:36:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-705655056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dce15613-8e34-4a10-8578-b5cfad5b5ec2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e359d0925eb44f2a7e561320a744426',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:36:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:36:15Z,use_quota=True,user_id='e74b62425230402993f1838c109fbc44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:36:15 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-89970db7-bda6-48a9-b553-79c668c6ca18 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b88849ba-dbd7-489f-b531-3643a0180f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:36:15 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-89970db7-bda6-48a9-b553-79c668c6ca18 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b88849ba-dbd7-489f-b531-3643a0180f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:36:15 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-89970db7-bda6-48a9-b553-79c668c6ca18 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c54d4dd-eb99-4bf7-be7f-831e09d4ea43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:36:15 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-89970db7-bda6-48a9-b553-79c668c6ca18 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c54d4dd-eb99-4bf7-be7f-831e09d4ea43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dce15613-8e34-4a10-8578-b5cfad5b5ec2', 'volume_name': 'volume-dce15613-8e34-4a10-8578-b5cfad5b5ec2', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:36:15 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-89970db7-bda6-48a9-b553-79c668c6ca18 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f65c6d6-7085-4d61-a85d-b993243883d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:36:15 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-89970db7-bda6-48a9-b553-79c668c6ca18 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f65c6d6-7085-4d61-a85d-b993243883d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:36:15 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-89970db7-bda6-48a9-b553-79c668c6ca18 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bac872b9-0160-46e0-b88f-a147b94c65d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:36:15 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-89970db7-bda6-48a9-b553-79c668c6ca18 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Volume dce15613-8e34-4a10-8578-b5cfad5b5ec2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dce15613-8e34-4a10-8578-b5cfad5b5ec2', 'volume_size': 1} Sep 28 09:36:15 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-89970db7-bda6-48a9-b553-79c668c6ca18 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:36:15 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-83a72d59-2c81-4ae4-98c3-af7f26291049 tempest-VolumesGetTest-1635800146 None] Lock "cinder-quobyte-384d6c32-e983-4e49-986f-2492761792c0" released by "delete_volume" :: held 2.218s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:36:15 devstack sudo[102902]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:15 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2c44c793-1e89-458d-b434-688c2eb1a8cb tempest-CreateVolumesFromSnapshotTest-1951497831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-55470911-773e-489a-9a2c-588bae208ad1" returned: 0 in 0.933s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:15 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-2c44c793-1e89-458d-b434-688c2eb1a8cb tempest-CreateVolumesFromSnapshotTest-1951497831 None] <== create_volume: return (2530ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:36:15 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-2c44c793-1e89-458d-b434-688c2eb1a8cb tempest-CreateVolumesFromSnapshotTest-1951497831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.537s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:36:15 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-be0ce4b3-404b-49b6-84e8-04cbec348e6a tempest-CreateVolumesFromSnapshotTest-1951497831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.988s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:36:15 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-be0ce4b3-404b-49b6-84e8-04cbec348e6a tempest-CreateVolumesFromSnapshotTest-1951497831 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:36:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1640257066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e070e431-73a7-4dab-af78-28d3d04b25c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e359d0925eb44f2a7e561320a744426',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:36:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:36:14Z,use_quota=True,user_id='e74b62425230402993f1838c109fbc44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:36:15 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-be0ce4b3-404b-49b6-84e8-04cbec348e6a tempest-CreateVolumesFromSnapshotTest-1951497831 None] Creating volume e070e431-73a7-4dab-af78-28d3d04b25c2 {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:36:15 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-be0ce4b3-404b-49b6-84e8-04cbec348e6a tempest-CreateVolumesFromSnapshotTest-1951497831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:36:15 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-be0ce4b3-404b-49b6-84e8-04cbec348e6a tempest-CreateVolumesFromSnapshotTest-1951497831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:36:15 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-be0ce4b3-404b-49b6-84e8-04cbec348e6a tempest-CreateVolumesFromSnapshotTest-1951497831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:36:15 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-be0ce4b3-404b-49b6-84e8-04cbec348e6a tempest-CreateVolumesFromSnapshotTest-1951497831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:36:15 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-be0ce4b3-404b-49b6-84e8-04cbec348e6a tempest-CreateVolumesFromSnapshotTest-1951497831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:36:15 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-be0ce4b3-404b-49b6-84e8-04cbec348e6a tempest-CreateVolumesFromSnapshotTest-1951497831 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:36:15 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-be0ce4b3-404b-49b6-84e8-04cbec348e6a tempest-CreateVolumesFromSnapshotTest-1951497831 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:36:15 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-be0ce4b3-404b-49b6-84e8-04cbec348e6a tempest-CreateVolumesFromSnapshotTest-1951497831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-e070e431-73a7-4dab-af78-28d3d04b25c2 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:15 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-2c44c793-1e89-458d-b434-688c2eb1a8cb tempest-CreateVolumesFromSnapshotTest-1951497831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (185025b5-abe4-4a7f-952c-3ef7649b2bea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55470911-773e-489a-9a2c-588bae208ad1', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:36:15 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-2c44c793-1e89-458d-b434-688c2eb1a8cb tempest-CreateVolumesFromSnapshotTest-1951497831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0941374-cb21-44c4-b21b-482d77e422fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:36:15 devstack sudo[102907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-e070e431-73a7-4dab-af78-28d3d04b25c2 1073741824 Sep 28 09:36:15 devstack sudo[102907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:15 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-2c44c793-1e89-458d-b434-688c2eb1a8cb tempest-CreateVolumesFromSnapshotTest-1951497831 None] Volume volume-55470911-773e-489a-9a2c-588bae208ad1 (55470911-773e-489a-9a2c-588bae208ad1): created successfully Sep 28 09:36:15 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-2c44c793-1e89-458d-b434-688c2eb1a8cb tempest-CreateVolumesFromSnapshotTest-1951497831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0941374-cb21-44c4-b21b-482d77e422fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:36:15 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-2c44c793-1e89-458d-b434-688c2eb1a8cb tempest-CreateVolumesFromSnapshotTest-1951497831 None] Flow 'volume_create_manager' (fc938f28-a3bc-4621-a587-bbda9ed5f39b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:36:15 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-2c44c793-1e89-458d-b434-688c2eb1a8cb tempest-CreateVolumesFromSnapshotTest-1951497831 None] Created volume successfully. Sep 28 09:36:15 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-83a72d59-2c81-4ae4-98c3-af7f26291049 tempest-VolumesGetTest-1635800146 None] Created reservations ['387fa225-6d1e-4460-8d23-b32e8ec49a88', 'd83b74b9-a20f-4457-ac89-7f5d52782f93', '12632c62-55b5-4638-ac55-5e677cbebffc', '2140af92-3a2d-406c-a619-c3b5ad385dec'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:36:15 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-83a72d59-2c81-4ae4-98c3-af7f26291049 tempest-VolumesGetTest-1635800146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:36:15 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-83a72d59-2c81-4ae4-98c3-af7f26291049 tempest-VolumesGetTest-1635800146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:36:15 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-83a72d59-2c81-4ae4-98c3-af7f26291049 tempest-VolumesGetTest-1635800146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:36:15 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-83a72d59-2c81-4ae4-98c3-af7f26291049 tempest-VolumesGetTest-1635800146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:36:15 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-83a72d59-2c81-4ae4-98c3-af7f26291049 tempest-VolumesGetTest-1635800146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.058s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:36:15 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-83a72d59-2c81-4ae4-98c3-af7f26291049 tempest-VolumesGetTest-1635800146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:15 devstack sudo[102909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:36:15 devstack sudo[102909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:16 devstack sudo[102907]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:16 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-be0ce4b3-404b-49b6-84e8-04cbec348e6a tempest-CreateVolumesFromSnapshotTest-1951497831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-e070e431-73a7-4dab-af78-28d3d04b25c2 1073741824" returned: 0 in 1.314s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:16 devstack sudo[102909]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:16 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-739fe354-fd5c-4244-8082-f2b9e6020f3b tempest-CreateVolumesFromSnapshotTest-1951497831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:36:16 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-739fe354-fd5c-4244-8082-f2b9e6020f3b tempest-CreateVolumesFromSnapshotTest-1951497831 None] Flow 'volume_create_manager' (3fee2326-7e8a-4181-badf-f229ecee4ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:36:16 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-739fe354-fd5c-4244-8082-f2b9e6020f3b tempest-CreateVolumesFromSnapshotTest-1951497831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50180479-2b34-4177-a5bf-5a6cab03c002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:36:16 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-83a72d59-2c81-4ae4-98c3-af7f26291049 tempest-VolumesGetTest-1635800146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.940s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:16 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-83a72d59-2c81-4ae4-98c3-af7f26291049 tempest-VolumesGetTest-1635800146 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:36:16 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-be0ce4b3-404b-49b6-84e8-04cbec348e6a tempest-CreateVolumesFromSnapshotTest-1951497831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-e070e431-73a7-4dab-af78-28d3d04b25c2 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:16 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-83a72d59-2c81-4ae4-98c3-af7f26291049 tempest-VolumesGetTest-1635800146 None] Deleted volume successfully. Sep 28 09:36:16 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-739fe354-fd5c-4244-8082-f2b9e6020f3b tempest-CreateVolumesFromSnapshotTest-1951497831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50180479-2b34-4177-a5bf-5a6cab03c002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:36:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1282648501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65d91e0c-6334-4902-9c4b-9664c8af87ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e359d0925eb44f2a7e561320a744426',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:36:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:36:16Z,use_quota=True,user_id='e74b62425230402993f1838c109fbc44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:36:16 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-739fe354-fd5c-4244-8082-f2b9e6020f3b tempest-CreateVolumesFromSnapshotTest-1951497831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61a58a6a-80c6-4964-a7e9-9fe225321206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:36:16 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-739fe354-fd5c-4244-8082-f2b9e6020f3b tempest-CreateVolumesFromSnapshotTest-1951497831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61a58a6a-80c6-4964-a7e9-9fe225321206) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:36:16 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-739fe354-fd5c-4244-8082-f2b9e6020f3b tempest-CreateVolumesFromSnapshotTest-1951497831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62da4473-2699-4440-ac47-a693db1ff47b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:36:16 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-739fe354-fd5c-4244-8082-f2b9e6020f3b tempest-CreateVolumesFromSnapshotTest-1951497831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62da4473-2699-4440-ac47-a693db1ff47b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65d91e0c-6334-4902-9c4b-9664c8af87ae', 'volume_name': 'volume-65d91e0c-6334-4902-9c4b-9664c8af87ae', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:36:16 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-739fe354-fd5c-4244-8082-f2b9e6020f3b tempest-CreateVolumesFromSnapshotTest-1951497831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64e61b4d-971d-4ae4-9be2-04ea26daf5f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:36:16 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-739fe354-fd5c-4244-8082-f2b9e6020f3b tempest-CreateVolumesFromSnapshotTest-1951497831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64e61b4d-971d-4ae4-9be2-04ea26daf5f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:36:16 devstack sudo[102916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-e070e431-73a7-4dab-af78-28d3d04b25c2 Sep 28 09:36:16 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-739fe354-fd5c-4244-8082-f2b9e6020f3b tempest-CreateVolumesFromSnapshotTest-1951497831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d03c5d1-3e25-4380-aed5-b5b426104491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:36:16 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-739fe354-fd5c-4244-8082-f2b9e6020f3b tempest-CreateVolumesFromSnapshotTest-1951497831 None] Volume 65d91e0c-6334-4902-9c4b-9664c8af87ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65d91e0c-6334-4902-9c4b-9664c8af87ae', 'volume_size': 1} Sep 28 09:36:16 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-739fe354-fd5c-4244-8082-f2b9e6020f3b tempest-CreateVolumesFromSnapshotTest-1951497831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:36:16 devstack sudo[102916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:16 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-83a72d59-2c81-4ae4-98c3-af7f26291049 tempest-VolumesGetTest-1635800146 None] Lock "cinder-384d6c32-e983-4e49-986f-2492761792c0-delete_volume" released by "delete_volume" :: held 4.152s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:36:17 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e085fe1-8eab-4442-bfbd-cd445605efa8 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:36:17 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-4e085fe1-8eab-4442-bfbd-cd445605efa8 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Flow 'volume_create_manager' (2dedeb14-27b2-420d-81b8-903c12ddea08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:36:17 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-4e085fe1-8eab-4442-bfbd-cd445605efa8 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ace109ab-ac59-4822-b53b-e9ce44f717bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:36:17 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-4e085fe1-8eab-4442-bfbd-cd445605efa8 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ace109ab-ac59-4822-b53b-e9ce44f717bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:36:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-450929754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=790add7e-a0ba-4dd0-a58a-e6ca2744f083,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e359d0925eb44f2a7e561320a744426',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:36:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:36:17Z,use_quota=True,user_id='e74b62425230402993f1838c109fbc44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:36:17 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-4e085fe1-8eab-4442-bfbd-cd445605efa8 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caa54724-71b0-43b6-9844-09a5f236719a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:36:17 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-4e085fe1-8eab-4442-bfbd-cd445605efa8 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caa54724-71b0-43b6-9844-09a5f236719a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:36:17 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-4e085fe1-8eab-4442-bfbd-cd445605efa8 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c08e5b13-993d-4277-aa08-03cd712e01a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:36:17 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-4e085fe1-8eab-4442-bfbd-cd445605efa8 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c08e5b13-993d-4277-aa08-03cd712e01a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '790add7e-a0ba-4dd0-a58a-e6ca2744f083', 'volume_name': 'volume-790add7e-a0ba-4dd0-a58a-e6ca2744f083', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:36:17 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-4e085fe1-8eab-4442-bfbd-cd445605efa8 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (074f9269-7e99-4a53-8818-0f4362d9347f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:36:17 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-4e085fe1-8eab-4442-bfbd-cd445605efa8 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (074f9269-7e99-4a53-8818-0f4362d9347f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:36:17 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-4e085fe1-8eab-4442-bfbd-cd445605efa8 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b5b0f02-60ae-400f-a836-3951c304e6bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:36:17 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-4e085fe1-8eab-4442-bfbd-cd445605efa8 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Volume 790add7e-a0ba-4dd0-a58a-e6ca2744f083: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-790add7e-a0ba-4dd0-a58a-e6ca2744f083', 'volume_size': 1} Sep 28 09:36:17 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-4e085fe1-8eab-4442-bfbd-cd445605efa8 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:36:17 devstack sudo[102916]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:17 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-be0ce4b3-404b-49b6-84e8-04cbec348e6a tempest-CreateVolumesFromSnapshotTest-1951497831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-e070e431-73a7-4dab-af78-28d3d04b25c2" returned: 0 in 0.484s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:17 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-be0ce4b3-404b-49b6-84e8-04cbec348e6a tempest-CreateVolumesFromSnapshotTest-1951497831 None] <== create_volume: return (2020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:36:17 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-be0ce4b3-404b-49b6-84e8-04cbec348e6a tempest-CreateVolumesFromSnapshotTest-1951497831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.032s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:36:17 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-89970db7-bda6-48a9-b553-79c668c6ca18 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.114s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:36:17 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-89970db7-bda6-48a9-b553-79c668c6ca18 tempest-CreateVolumesFromSnapshotTest-1951497831 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:36:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-705655056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dce15613-8e34-4a10-8578-b5cfad5b5ec2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e359d0925eb44f2a7e561320a744426',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:36:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:36:15Z,use_quota=True,user_id='e74b62425230402993f1838c109fbc44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:36:17 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-89970db7-bda6-48a9-b553-79c668c6ca18 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Creating volume dce15613-8e34-4a10-8578-b5cfad5b5ec2 {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:36:17 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-89970db7-bda6-48a9-b553-79c668c6ca18 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:36:17 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-89970db7-bda6-48a9-b553-79c668c6ca18 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:36:17 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-89970db7-bda6-48a9-b553-79c668c6ca18 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:36:17 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-89970db7-bda6-48a9-b553-79c668c6ca18 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:36:17 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-89970db7-bda6-48a9-b553-79c668c6ca18 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:36:17 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-89970db7-bda6-48a9-b553-79c668c6ca18 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:36:17 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-89970db7-bda6-48a9-b553-79c668c6ca18 tempest-CreateVolumesFromSnapshotTest-1951497831 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:36:17 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-89970db7-bda6-48a9-b553-79c668c6ca18 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-dce15613-8e34-4a10-8578-b5cfad5b5ec2 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:17 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-be0ce4b3-404b-49b6-84e8-04cbec348e6a tempest-CreateVolumesFromSnapshotTest-1951497831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ea60b42-1626-4009-a444-74ef49c1602d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e070e431-73a7-4dab-af78-28d3d04b25c2', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:36:17 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-be0ce4b3-404b-49b6-84e8-04cbec348e6a tempest-CreateVolumesFromSnapshotTest-1951497831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6917fb4-071a-46ef-bdc5-058c85707008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:36:17 devstack sudo[102919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-dce15613-8e34-4a10-8578-b5cfad5b5ec2 1073741824 Sep 28 09:36:17 devstack sudo[102919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:17 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-be0ce4b3-404b-49b6-84e8-04cbec348e6a tempest-CreateVolumesFromSnapshotTest-1951497831 None] Volume volume-e070e431-73a7-4dab-af78-28d3d04b25c2 (e070e431-73a7-4dab-af78-28d3d04b25c2): created successfully Sep 28 09:36:17 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-be0ce4b3-404b-49b6-84e8-04cbec348e6a tempest-CreateVolumesFromSnapshotTest-1951497831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6917fb4-071a-46ef-bdc5-058c85707008) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:36:17 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-be0ce4b3-404b-49b6-84e8-04cbec348e6a tempest-CreateVolumesFromSnapshotTest-1951497831 None] Flow 'volume_create_manager' (9a60216a-27a2-4eae-b875-0a7fd0f6bd15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:36:17 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-be0ce4b3-404b-49b6-84e8-04cbec348e6a tempest-CreateVolumesFromSnapshotTest-1951497831 None] Created volume successfully. Sep 28 09:36:18 devstack sudo[102919]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:18 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-89970db7-bda6-48a9-b553-79c668c6ca18 tempest-CreateVolumesFromSnapshotTest-1951497831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-dce15613-8e34-4a10-8578-b5cfad5b5ec2 1073741824" returned: 0 in 0.761s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:18 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-89970db7-bda6-48a9-b553-79c668c6ca18 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-dce15613-8e34-4a10-8578-b5cfad5b5ec2 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:18 devstack sudo[102927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-dce15613-8e34-4a10-8578-b5cfad5b5ec2 Sep 28 09:36:18 devstack sudo[102927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:18 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-07284645-7e78-411d-9e9d-1b605f2cfc91 tempest-VolumesGetTest-1635800146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:36:18 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-07284645-7e78-411d-9e9d-1b605f2cfc91 tempest-VolumesGetTest-1635800146 None] Flow 'volume_create_manager' (590b6656-cc94-476f-9e8a-cb6c6acdb758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:36:18 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-07284645-7e78-411d-9e9d-1b605f2cfc91 tempest-VolumesGetTest-1635800146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b28ad63b-3bce-4f28-a264-bfb00cadf0ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:36:18 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-07284645-7e78-411d-9e9d-1b605f2cfc91 tempest-VolumesGetTest-1635800146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b28ad63b-3bce-4f28-a264-bfb00cadf0ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:36:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1271595273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca7a3780-e42a-42d0-bd8f-b23b489fd892,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='be84b080459e458496b0d755a3c89703',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:36:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:36:18Z,use_quota=True,user_id='a7990b3b37d84bc4acd2288b34b11a7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:36:18 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-07284645-7e78-411d-9e9d-1b605f2cfc91 tempest-VolumesGetTest-1635800146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af3c728f-1fd8-487f-80ac-18d011741a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:36:18 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-07284645-7e78-411d-9e9d-1b605f2cfc91 tempest-VolumesGetTest-1635800146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af3c728f-1fd8-487f-80ac-18d011741a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:36:18 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-07284645-7e78-411d-9e9d-1b605f2cfc91 tempest-VolumesGetTest-1635800146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33e58b88-2db5-42c6-992f-b85f1813f0b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:36:18 devstack cinder-volume[86553]: DEBUG cinder.image.glance [None req-07284645-7e78-411d-9e9d-1b605f2cfc91 tempest-VolumesGetTest-1635800146 None] Creating Keystone auth plugin from conf {{(pid=86553) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 09:36:18 devstack sudo[102927]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:18 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-89970db7-bda6-48a9-b553-79c668c6ca18 tempest-CreateVolumesFromSnapshotTest-1951497831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-dce15613-8e34-4a10-8578-b5cfad5b5ec2" returned: 0 in 0.393s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:18 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-89970db7-bda6-48a9-b553-79c668c6ca18 tempest-CreateVolumesFromSnapshotTest-1951497831 None] <== create_volume: return (1210ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:36:18 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-89970db7-bda6-48a9-b553-79c668c6ca18 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.214s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:36:18 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-739fe354-fd5c-4244-8082-f2b9e6020f3b tempest-CreateVolumesFromSnapshotTest-1951497831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.588s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:36:18 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-739fe354-fd5c-4244-8082-f2b9e6020f3b tempest-CreateVolumesFromSnapshotTest-1951497831 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:36:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1282648501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65d91e0c-6334-4902-9c4b-9664c8af87ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e359d0925eb44f2a7e561320a744426',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:36:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:36:16Z,use_quota=True,user_id='e74b62425230402993f1838c109fbc44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:36:18 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-739fe354-fd5c-4244-8082-f2b9e6020f3b tempest-CreateVolumesFromSnapshotTest-1951497831 None] Creating volume 65d91e0c-6334-4902-9c4b-9664c8af87ae {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:36:18 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-739fe354-fd5c-4244-8082-f2b9e6020f3b tempest-CreateVolumesFromSnapshotTest-1951497831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:36:18 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-739fe354-fd5c-4244-8082-f2b9e6020f3b tempest-CreateVolumesFromSnapshotTest-1951497831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:36:18 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-739fe354-fd5c-4244-8082-f2b9e6020f3b tempest-CreateVolumesFromSnapshotTest-1951497831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:36:18 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-739fe354-fd5c-4244-8082-f2b9e6020f3b tempest-CreateVolumesFromSnapshotTest-1951497831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:36:18 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-739fe354-fd5c-4244-8082-f2b9e6020f3b tempest-CreateVolumesFromSnapshotTest-1951497831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:36:18 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-739fe354-fd5c-4244-8082-f2b9e6020f3b tempest-CreateVolumesFromSnapshotTest-1951497831 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:36:18 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-739fe354-fd5c-4244-8082-f2b9e6020f3b tempest-CreateVolumesFromSnapshotTest-1951497831 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:36:18 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-739fe354-fd5c-4244-8082-f2b9e6020f3b tempest-CreateVolumesFromSnapshotTest-1951497831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-65d91e0c-6334-4902-9c4b-9664c8af87ae 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:18 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-89970db7-bda6-48a9-b553-79c668c6ca18 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bac872b9-0160-46e0-b88f-a147b94c65d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dce15613-8e34-4a10-8578-b5cfad5b5ec2', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:36:18 devstack sudo[102930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-65d91e0c-6334-4902-9c4b-9664c8af87ae 1073741824 Sep 28 09:36:18 devstack sudo[102930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:18 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-89970db7-bda6-48a9-b553-79c668c6ca18 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab48cc0f-3660-48fd-a8a0-612271214f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:36:18 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-89970db7-bda6-48a9-b553-79c668c6ca18 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Volume volume-dce15613-8e34-4a10-8578-b5cfad5b5ec2 (dce15613-8e34-4a10-8578-b5cfad5b5ec2): created successfully Sep 28 09:36:18 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-89970db7-bda6-48a9-b553-79c668c6ca18 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab48cc0f-3660-48fd-a8a0-612271214f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:36:18 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-89970db7-bda6-48a9-b553-79c668c6ca18 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Flow 'volume_create_manager' (9ea759e8-4ce1-4043-bdc1-5a91b460deaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:36:18 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-89970db7-bda6-48a9-b553-79c668c6ca18 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Created volume successfully. Sep 28 09:36:18 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-07284645-7e78-411d-9e9d-1b605f2cfc91 tempest-VolumesGetTest-1635800146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33e58b88-2db5-42c6-992f-b85f1813f0b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ca7a3780-e42a-42d0-bd8f-b23b489fd892', 'volume_name': 'volume-ca7a3780-e42a-42d0-bd8f-b23b489fd892', 'volume_size': 1, 'image_id': '1a11c21d-88b0-4620-aa82-1ded26f580c9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1a11c21d-88b0-4620-aa82-1ded26f580c9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b800784c68dc485682fd42484c46336e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1a11c21d-88b0-4620-aa82-1ded26f580c9', 'created_at': datetime.datetime(2026, 9, 28, 7, 16, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 7, 16, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a11c21d-88b0-4620-aa82-1ded26f580c9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:36:18 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-07284645-7e78-411d-9e9d-1b605f2cfc91 tempest-VolumesGetTest-1635800146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1f67308-1bfd-4b0d-bb1d-97aae87501c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:36:18 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-07284645-7e78-411d-9e9d-1b605f2cfc91 tempest-VolumesGetTest-1635800146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1f67308-1bfd-4b0d-bb1d-97aae87501c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:36:18 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-07284645-7e78-411d-9e9d-1b605f2cfc91 tempest-VolumesGetTest-1635800146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afd64903-767f-44df-ab44-33831a87bd5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:36:18 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-07284645-7e78-411d-9e9d-1b605f2cfc91 tempest-VolumesGetTest-1635800146 None] Volume ca7a3780-e42a-42d0-bd8f-b23b489fd892: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ca7a3780-e42a-42d0-bd8f-b23b489fd892', 'volume_size': 1, 'image_id': '1a11c21d-88b0-4620-aa82-1ded26f580c9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1a11c21d-88b0-4620-aa82-1ded26f580c9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b800784c68dc485682fd42484c46336e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1a11c21d-88b0-4620-aa82-1ded26f580c9', 'created_at': datetime.datetime(2026, 9, 28, 7, 16, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 7, 16, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a11c21d-88b0-4620-aa82-1ded26f580c9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 09:36:18 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-07284645-7e78-411d-9e9d-1b605f2cfc91 tempest-VolumesGetTest-1635800146 None] Trying to clone ca7a3780-e42a-42d0-bd8f-b23b489fd892 from image 1a11c21d-88b0-4620-aa82-1ded26f580c9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1a11c21d-88b0-4620-aa82-1ded26f580c9', 'metadata': {}}]). {{(pid=86553) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 09:36:19 devstack sudo[102930]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:19 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-739fe354-fd5c-4244-8082-f2b9e6020f3b tempest-CreateVolumesFromSnapshotTest-1951497831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-65d91e0c-6334-4902-9c4b-9664c8af87ae 1073741824" returned: 0 in 0.659s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:19 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-739fe354-fd5c-4244-8082-f2b9e6020f3b tempest-CreateVolumesFromSnapshotTest-1951497831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-65d91e0c-6334-4902-9c4b-9664c8af87ae {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:19 devstack sudo[102936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-65d91e0c-6334-4902-9c4b-9664c8af87ae Sep 28 09:36:19 devstack sudo[102936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:19 devstack cinder-volume[86553]: DEBUG cinder.image.image_utils [None req-07284645-7e78-411d-9e9d-1b605f2cfc91 tempest-VolumesGetTest-1635800146 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1a11c21d-88b0-4620-aa82-1ded26f580c9_v12vycobdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86553) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 09:36:19 devstack cinder-volume[86553]: INFO cinder.image.image_utils [None req-07284645-7e78-411d-9e9d-1b605f2cfc91 tempest-VolumesGetTest-1635800146 None] Image download 20.69 MB at 20.69 MB/s Sep 28 09:36:19 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[d27cda75-4ed6-451c-8bff-eea1567830a3]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:36:19 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-07284645-7e78-411d-9e9d-1b605f2cfc91 tempest-VolumesGetTest-1635800146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1a11c21d-88b0-4620-aa82-1ded26f580c9_v12vycobdevstack@QuobyteHD {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:19 devstack sudo[102936]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:19 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-739fe354-fd5c-4244-8082-f2b9e6020f3b tempest-CreateVolumesFromSnapshotTest-1951497831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-65d91e0c-6334-4902-9c4b-9664c8af87ae" returned: 0 in 0.484s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:19 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-739fe354-fd5c-4244-8082-f2b9e6020f3b tempest-CreateVolumesFromSnapshotTest-1951497831 None] <== create_volume: return (1248ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:36:19 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-739fe354-fd5c-4244-8082-f2b9e6020f3b tempest-CreateVolumesFromSnapshotTest-1951497831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.252s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:36:19 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-4e085fe1-8eab-4442-bfbd-cd445605efa8 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.572s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:36:19 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-4e085fe1-8eab-4442-bfbd-cd445605efa8 tempest-CreateVolumesFromSnapshotTest-1951497831 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:36:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-450929754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=790add7e-a0ba-4dd0-a58a-e6ca2744f083,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e359d0925eb44f2a7e561320a744426',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:36:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:36:17Z,use_quota=True,user_id='e74b62425230402993f1838c109fbc44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:36:19 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-4e085fe1-8eab-4442-bfbd-cd445605efa8 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Creating volume 790add7e-a0ba-4dd0-a58a-e6ca2744f083 {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:36:19 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-4e085fe1-8eab-4442-bfbd-cd445605efa8 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:36:19 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-4e085fe1-8eab-4442-bfbd-cd445605efa8 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:36:19 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-4e085fe1-8eab-4442-bfbd-cd445605efa8 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:36:19 devstack sudo[102939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1a11c21d-88b0-4620-aa82-1ded26f580c9_v12vycobdevstack@QuobyteHD Sep 28 09:36:19 devstack sudo[102939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:19 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-4e085fe1-8eab-4442-bfbd-cd445605efa8 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:36:19 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-4e085fe1-8eab-4442-bfbd-cd445605efa8 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:36:19 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-4e085fe1-8eab-4442-bfbd-cd445605efa8 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:36:19 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-4e085fe1-8eab-4442-bfbd-cd445605efa8 tempest-CreateVolumesFromSnapshotTest-1951497831 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:36:19 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-4e085fe1-8eab-4442-bfbd-cd445605efa8 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-790add7e-a0ba-4dd0-a58a-e6ca2744f083 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:19 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-739fe354-fd5c-4244-8082-f2b9e6020f3b tempest-CreateVolumesFromSnapshotTest-1951497831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d03c5d1-3e25-4380-aed5-b5b426104491) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65d91e0c-6334-4902-9c4b-9664c8af87ae', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:36:19 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-739fe354-fd5c-4244-8082-f2b9e6020f3b tempest-CreateVolumesFromSnapshotTest-1951497831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a03f0a90-55d4-4b33-ba0a-769ba4ee90d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:36:19 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-739fe354-fd5c-4244-8082-f2b9e6020f3b tempest-CreateVolumesFromSnapshotTest-1951497831 None] Volume volume-65d91e0c-6334-4902-9c4b-9664c8af87ae (65d91e0c-6334-4902-9c4b-9664c8af87ae): created successfully Sep 28 09:36:19 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-739fe354-fd5c-4244-8082-f2b9e6020f3b tempest-CreateVolumesFromSnapshotTest-1951497831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a03f0a90-55d4-4b33-ba0a-769ba4ee90d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:36:19 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-739fe354-fd5c-4244-8082-f2b9e6020f3b tempest-CreateVolumesFromSnapshotTest-1951497831 None] Flow 'volume_create_manager' (3fee2326-7e8a-4181-badf-f229ecee4ff3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:36:19 devstack sudo[102942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-790add7e-a0ba-4dd0-a58a-e6ca2744f083 1073741824 Sep 28 09:36:19 devstack sudo[102942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:19 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-739fe354-fd5c-4244-8082-f2b9e6020f3b tempest-CreateVolumesFromSnapshotTest-1951497831 None] Created volume successfully. Sep 28 09:36:20 devstack sudo[102939]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-07284645-7e78-411d-9e9d-1b605f2cfc91 tempest-VolumesGetTest-1635800146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1a11c21d-88b0-4620-aa82-1ded26f580c9_v12vycobdevstack@QuobyteHD" returned: 0 in 0.412s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:20 devstack cinder-volume[86553]: DEBUG cinder.image.image_utils [None req-07284645-7e78-411d-9e9d-1b605f2cfc91 tempest-VolumesGetTest-1635800146 None] Temporary image 1a11c21d-88b0-4620-aa82-1ded26f580c9 is fetched for user a7990b3b37d84bc4acd2288b34b11a7a. {{(pid=86553) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 09:36:20 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[b23c096f-b6f3-49e3-9438-64c7ba24485d]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:36:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-07284645-7e78-411d-9e9d-1b605f2cfc91 tempest-VolumesGetTest-1635800146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1a11c21d-88b0-4620-aa82-1ded26f580c9_v12vycobdevstack@QuobyteHD {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:20 devstack sudo[102948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1a11c21d-88b0-4620-aa82-1ded26f580c9_v12vycobdevstack@QuobyteHD Sep 28 09:36:20 devstack sudo[102948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:20 devstack sudo[102942]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-4e085fe1-8eab-4442-bfbd-cd445605efa8 tempest-CreateVolumesFromSnapshotTest-1951497831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-790add7e-a0ba-4dd0-a58a-e6ca2744f083 1073741824" returned: 0 in 0.760s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-4e085fe1-8eab-4442-bfbd-cd445605efa8 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-790add7e-a0ba-4dd0-a58a-e6ca2744f083 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:20 devstack sudo[102953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-790add7e-a0ba-4dd0-a58a-e6ca2744f083 Sep 28 09:36:20 devstack sudo[102953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:20 devstack sudo[102948]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-07284645-7e78-411d-9e9d-1b605f2cfc91 tempest-VolumesGetTest-1635800146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1a11c21d-88b0-4620-aa82-1ded26f580c9_v12vycobdevstack@QuobyteHD" returned: 0 in 0.463s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-07284645-7e78-411d-9e9d-1b605f2cfc91 tempest-VolumesGetTest-1635800146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:36:20 devstack sudo[102953]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-4e085fe1-8eab-4442-bfbd-cd445605efa8 tempest-CreateVolumesFromSnapshotTest-1951497831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-790add7e-a0ba-4dd0-a58a-e6ca2744f083" returned: 0 in 0.334s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:20 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-4e085fe1-8eab-4442-bfbd-cd445605efa8 tempest-CreateVolumesFromSnapshotTest-1951497831 None] <== create_volume: return (1153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:36:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-4e085fe1-8eab-4442-bfbd-cd445605efa8 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.157s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:36:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-07284645-7e78-411d-9e9d-1b605f2cfc91 tempest-VolumesGetTest-1635800146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.296s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:36:20 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-07284645-7e78-411d-9e9d-1b605f2cfc91 tempest-VolumesGetTest-1635800146 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:36:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1271595273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca7a3780-e42a-42d0-bd8f-b23b489fd892,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='be84b080459e458496b0d755a3c89703',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:36:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:36:18Z,use_quota=True,user_id='a7990b3b37d84bc4acd2288b34b11a7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:36:20 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-07284645-7e78-411d-9e9d-1b605f2cfc91 tempest-VolumesGetTest-1635800146 None] Creating volume ca7a3780-e42a-42d0-bd8f-b23b489fd892 {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:36:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-07284645-7e78-411d-9e9d-1b605f2cfc91 tempest-VolumesGetTest-1635800146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:36:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-07284645-7e78-411d-9e9d-1b605f2cfc91 tempest-VolumesGetTest-1635800146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:36:20 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-07284645-7e78-411d-9e9d-1b605f2cfc91 tempest-VolumesGetTest-1635800146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:36:20 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-07284645-7e78-411d-9e9d-1b605f2cfc91 tempest-VolumesGetTest-1635800146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:36:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-07284645-7e78-411d-9e9d-1b605f2cfc91 tempest-VolumesGetTest-1635800146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:36:20 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-07284645-7e78-411d-9e9d-1b605f2cfc91 tempest-VolumesGetTest-1635800146 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:36:20 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-07284645-7e78-411d-9e9d-1b605f2cfc91 tempest-VolumesGetTest-1635800146 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:36:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-07284645-7e78-411d-9e9d-1b605f2cfc91 tempest-VolumesGetTest-1635800146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-ca7a3780-e42a-42d0-bd8f-b23b489fd892 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:21 devstack sudo[102960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-ca7a3780-e42a-42d0-bd8f-b23b489fd892 1073741824 Sep 28 09:36:21 devstack sudo[102960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:21 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-4e085fe1-8eab-4442-bfbd-cd445605efa8 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b5b0f02-60ae-400f-a836-3951c304e6bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-790add7e-a0ba-4dd0-a58a-e6ca2744f083', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:36:21 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-4e085fe1-8eab-4442-bfbd-cd445605efa8 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c478d969-bc25-4eb5-98b0-231839ddcee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:36:21 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-4e085fe1-8eab-4442-bfbd-cd445605efa8 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Volume volume-790add7e-a0ba-4dd0-a58a-e6ca2744f083 (790add7e-a0ba-4dd0-a58a-e6ca2744f083): created successfully Sep 28 09:36:21 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-4e085fe1-8eab-4442-bfbd-cd445605efa8 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c478d969-bc25-4eb5-98b0-231839ddcee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:36:21 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-4e085fe1-8eab-4442-bfbd-cd445605efa8 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Flow 'volume_create_manager' (2dedeb14-27b2-420d-81b8-903c12ddea08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:36:21 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-4e085fe1-8eab-4442-bfbd-cd445605efa8 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Created volume successfully. Sep 28 09:36:21 devstack cinder-volume[86553]: DEBUG oslo_service.periodic_task [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86553) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 09:36:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:36:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:36:21 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:36:21 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:36:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:36:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:21 devstack sudo[102999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:36:21 devstack sudo[102999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:21 devstack sudo[102960]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-07284645-7e78-411d-9e9d-1b605f2cfc91 tempest-VolumesGetTest-1635800146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-ca7a3780-e42a-42d0-bd8f-b23b489fd892 1073741824" returned: 0 in 0.725s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:21 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-75933b4e-b7a2-47b2-aef8-ddb43a046759 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Acquiring lock "cinder-790add7e-a0ba-4dd0-a58a-e6ca2744f083-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:36:21 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-75933b4e-b7a2-47b2-aef8-ddb43a046759 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Lock "cinder-790add7e-a0ba-4dd0-a58a-e6ca2744f083-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:36:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-07284645-7e78-411d-9e9d-1b605f2cfc91 tempest-VolumesGetTest-1635800146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-ca7a3780-e42a-42d0-bd8f-b23b489fd892 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:21 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-75933b4e-b7a2-47b2-aef8-ddb43a046759 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Acquiring lock "cinder-quobyte-790add7e-a0ba-4dd0-a58a-e6ca2744f083" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:36:21 devstack sudo[103001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-ca7a3780-e42a-42d0-bd8f-b23b489fd892 Sep 28 09:36:21 devstack sudo[103001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:21 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-75933b4e-b7a2-47b2-aef8-ddb43a046759 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Lock "cinder-quobyte-790add7e-a0ba-4dd0-a58a-e6ca2744f083" acquired by "delete_volume" :: waited 0.061s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:36:22 devstack sudo[102999]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:22 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.413s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:22 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:36:22 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ec748e-0aa6-45b4-bd6b-5cf132ed00b9]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:36:22 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-75933b4e-b7a2-47b2-aef8-ddb43a046759 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-790add7e-a0ba-4dd0-a58a-e6ca2744f083 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:22 devstack cinder-volume[86553]: DEBUG oslo_service.periodic_task [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Running periodic task VolumeManager._thread_info {{(pid=86553) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 09:36:22 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] thread count: 28 {{(pid=86553) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 09:36:22 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] thread info: [<_MainThread(MainThread, started 134684877779072)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86553) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 09:36:22 devstack sudo[103004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-790add7e-a0ba-4dd0-a58a-e6ca2744f083 Sep 28 09:36:22 devstack sudo[103004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:22 devstack sudo[103001]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:22 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-07284645-7e78-411d-9e9d-1b605f2cfc91 tempest-VolumesGetTest-1635800146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-ca7a3780-e42a-42d0-bd8f-b23b489fd892" returned: 0 in 0.649s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:22 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-07284645-7e78-411d-9e9d-1b605f2cfc91 tempest-VolumesGetTest-1635800146 None] <== create_volume: return (1531ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:36:22 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-07284645-7e78-411d-9e9d-1b605f2cfc91 tempest-VolumesGetTest-1635800146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.541s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:36:22 devstack cinder-volume[86553]: DEBUG cinder.volume.volume_utils [None req-07284645-7e78-411d-9e9d-1b605f2cfc91 tempest-VolumesGetTest-1635800146 None] Attempting download of 1a11c21d-88b0-4620-aa82-1ded26f580c9 ((None, [{'url': 'file:///opt/stack/data/glance/images/1a11c21d-88b0-4620-aa82-1ded26f580c9', 'metadata': {}}])) to volume ca7a3780-e42a-42d0-bd8f-b23b489fd892. {{(pid=86553) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 09:36:22 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[b21380b4-a3ad-46cb-acdc-1338f0860350]: (4, 'raw') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:36:22 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-07284645-7e78-411d-9e9d-1b605f2cfc91 tempest-VolumesGetTest-1635800146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1a11c21d-88b0-4620-aa82-1ded26f580c9_kf0buhtb {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:22 devstack sudo[103004]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:22 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-75933b4e-b7a2-47b2-aef8-ddb43a046759 tempest-CreateVolumesFromSnapshotTest-1951497831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-790add7e-a0ba-4dd0-a58a-e6ca2744f083" returned: 0 in 0.864s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:22 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-75933b4e-b7a2-47b2-aef8-ddb43a046759 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-790add7e-a0ba-4dd0-a58a-e6ca2744f083 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:22 devstack sudo[103014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1a11c21d-88b0-4620-aa82-1ded26f580c9_kf0buhtb Sep 28 09:36:22 devstack sudo[103014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:23 devstack sudo[103015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-790add7e-a0ba-4dd0-a58a-e6ca2744f083 Sep 28 09:36:23 devstack sudo[103015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:23 devstack sudo[103014]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:23 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-07284645-7e78-411d-9e9d-1b605f2cfc91 tempest-VolumesGetTest-1635800146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1a11c21d-88b0-4620-aa82-1ded26f580c9_kf0buhtb" returned: 0 in 0.551s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:23 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-07284645-7e78-411d-9e9d-1b605f2cfc91 tempest-VolumesGetTest-1635800146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1a11c21d-88b0-4620-aa82-1ded26f580c9_kf0buhtb {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:23 devstack sudo[103020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1a11c21d-88b0-4620-aa82-1ded26f580c9_kf0buhtb Sep 28 09:36:23 devstack sudo[103020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:23 devstack sudo[103015]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:23 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-75933b4e-b7a2-47b2-aef8-ddb43a046759 tempest-CreateVolumesFromSnapshotTest-1951497831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-790add7e-a0ba-4dd0-a58a-e6ca2744f083" returned: 0 in 0.774s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:23 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-75933b4e-b7a2-47b2-aef8-ddb43a046759 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Lock "cinder-quobyte-790add7e-a0ba-4dd0-a58a-e6ca2744f083" released by "delete_volume" :: held 1.768s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:36:23 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-75933b4e-b7a2-47b2-aef8-ddb43a046759 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Created reservations ['4bf6ef31-4f20-40b6-8fba-b0427d820405', '44a8d1b5-02ec-42de-99a3-7089823f009e', 'c4e65b48-d968-42cf-a5c5-13076456c701', 'dcbae222-124a-44ef-9f05-4a88dd730777'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:36:24 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-75933b4e-b7a2-47b2-aef8-ddb43a046759 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:36:24 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-75933b4e-b7a2-47b2-aef8-ddb43a046759 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:36:24 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-75933b4e-b7a2-47b2-aef8-ddb43a046759 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:36:24 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-75933b4e-b7a2-47b2-aef8-ddb43a046759 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:36:24 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-75933b4e-b7a2-47b2-aef8-ddb43a046759 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:36:24 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-75933b4e-b7a2-47b2-aef8-ddb43a046759 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:24 devstack sudo[103047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:36:24 devstack sudo[103047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:24 devstack sudo[103020]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:24 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-07284645-7e78-411d-9e9d-1b605f2cfc91 tempest-VolumesGetTest-1635800146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1a11c21d-88b0-4620-aa82-1ded26f580c9_kf0buhtb" returned: 1 in 0.926s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:24 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-07284645-7e78-411d-9e9d-1b605f2cfc91 tempest-VolumesGetTest-1635800146 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1a11c21d-88b0-4620-aa82-1ded26f580c9_kf0buhtb' failed. Not Retrying. {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 09:36:24 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[f04aa377-b7f8-4343-8834-b33a9f35574d]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:36:24 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-07284645-7e78-411d-9e9d-1b605f2cfc91 tempest-VolumesGetTest-1635800146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1a11c21d-88b0-4620-aa82-1ded26f580c9_v12vycobdevstack@QuobyteHD {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:24 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-b0572158-ef83-4ccc-a7de-cebbf44e3c22 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Acquiring lock "cinder-65d91e0c-6334-4902-9c4b-9664c8af87ae-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:36:24 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-b0572158-ef83-4ccc-a7de-cebbf44e3c22 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Lock "cinder-65d91e0c-6334-4902-9c4b-9664c8af87ae-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:36:24 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-b0572158-ef83-4ccc-a7de-cebbf44e3c22 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Acquiring lock "cinder-quobyte-65d91e0c-6334-4902-9c4b-9664c8af87ae" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:36:24 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-b0572158-ef83-4ccc-a7de-cebbf44e3c22 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Lock "cinder-quobyte-65d91e0c-6334-4902-9c4b-9664c8af87ae" acquired by "delete_volume" :: waited 0.029s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:36:24 devstack sudo[103047]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:24 devstack sudo[103052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1a11c21d-88b0-4620-aa82-1ded26f580c9_v12vycobdevstack@QuobyteHD Sep 28 09:36:24 devstack sudo[103052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:24 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-75933b4e-b7a2-47b2-aef8-ddb43a046759 tempest-CreateVolumesFromSnapshotTest-1951497831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.443s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:24 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-75933b4e-b7a2-47b2-aef8-ddb43a046759 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:36:24 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c1561a-b1e4-4dcd-8be5-2b7dad36d4e5]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:36:24 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b0572158-ef83-4ccc-a7de-cebbf44e3c22 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-65d91e0c-6334-4902-9c4b-9664c8af87ae {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:24 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-75933b4e-b7a2-47b2-aef8-ddb43a046759 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Deleted volume successfully. Sep 28 09:36:24 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-75933b4e-b7a2-47b2-aef8-ddb43a046759 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Lock "cinder-790add7e-a0ba-4dd0-a58a-e6ca2744f083-delete_volume" released by "delete_volume" :: held 2.795s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:36:24 devstack sudo[103055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-65d91e0c-6334-4902-9c4b-9664c8af87ae Sep 28 09:36:24 devstack sudo[103055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:25 devstack sudo[103052]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:25 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-07284645-7e78-411d-9e9d-1b605f2cfc91 tempest-VolumesGetTest-1635800146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1a11c21d-88b0-4620-aa82-1ded26f580c9_v12vycobdevstack@QuobyteHD" returned: 0 in 0.828s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:25 devstack cinder-volume[86553]: DEBUG cinder.image.image_utils [None req-07284645-7e78-411d-9e9d-1b605f2cfc91 tempest-VolumesGetTest-1635800146 None] 1a11c21d-88b0-4620-aa82-1ded26f580c9 was qcow2, converting to qcow2 {{(pid=86553) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 09:36:25 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-07284645-7e78-411d-9e9d-1b605f2cfc91 tempest-VolumesGetTest-1635800146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1a11c21d-88b0-4620-aa82-1ded26f580c9_v12vycobdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-ca7a3780-e42a-42d0-bd8f-b23b489fd892 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:25 devstack sudo[103055]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:25 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b0572158-ef83-4ccc-a7de-cebbf44e3c22 tempest-CreateVolumesFromSnapshotTest-1951497831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-65d91e0c-6334-4902-9c4b-9664c8af87ae" returned: 0 in 0.604s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:25 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b0572158-ef83-4ccc-a7de-cebbf44e3c22 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-65d91e0c-6334-4902-9c4b-9664c8af87ae {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:25 devstack sudo[103067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1a11c21d-88b0-4620-aa82-1ded26f580c9_v12vycobdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-ca7a3780-e42a-42d0-bd8f-b23b489fd892 Sep 28 09:36:25 devstack sudo[103067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:25 devstack sudo[103069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-65d91e0c-6334-4902-9c4b-9664c8af87ae Sep 28 09:36:25 devstack sudo[103069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:25 devstack sudo[103069]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:25 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b0572158-ef83-4ccc-a7de-cebbf44e3c22 tempest-CreateVolumesFromSnapshotTest-1951497831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-65d91e0c-6334-4902-9c4b-9664c8af87ae" returned: 0 in 0.412s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:25 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-b0572158-ef83-4ccc-a7de-cebbf44e3c22 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Lock "cinder-quobyte-65d91e0c-6334-4902-9c4b-9664c8af87ae" released by "delete_volume" :: held 1.118s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:36:25 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-b0572158-ef83-4ccc-a7de-cebbf44e3c22 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Created reservations ['f2cae5f8-89bc-4463-bece-ee72e17bfa5b', 'f18e179b-5f4a-444f-ba68-c7e7870ec197', 'f1556452-32a0-48c9-ac8e-b192f6bc41ce', '9ea11699-96d8-406e-ae43-bba326ac5d69'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:36:25 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-b0572158-ef83-4ccc-a7de-cebbf44e3c22 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:36:25 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-b0572158-ef83-4ccc-a7de-cebbf44e3c22 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:36:25 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-b0572158-ef83-4ccc-a7de-cebbf44e3c22 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:36:25 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-b0572158-ef83-4ccc-a7de-cebbf44e3c22 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:36:25 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-b0572158-ef83-4ccc-a7de-cebbf44e3c22 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:36:25 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b0572158-ef83-4ccc-a7de-cebbf44e3c22 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:25 devstack sudo[103078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:36:25 devstack sudo[103078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:26 devstack sudo[103078]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:26 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b0572158-ef83-4ccc-a7de-cebbf44e3c22 tempest-CreateVolumesFromSnapshotTest-1951497831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.431s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:26 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-b0572158-ef83-4ccc-a7de-cebbf44e3c22 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:36:26 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-b0572158-ef83-4ccc-a7de-cebbf44e3c22 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Deleted volume successfully. Sep 28 09:36:26 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-b0572158-ef83-4ccc-a7de-cebbf44e3c22 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Lock "cinder-65d91e0c-6334-4902-9c4b-9664c8af87ae-delete_volume" released by "delete_volume" :: held 1.931s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:36:26 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-fe75c8cb-440e-4fdc-bdfa-6580a2275929 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Acquiring lock "cinder-dce15613-8e34-4a10-8578-b5cfad5b5ec2-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:36:26 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-fe75c8cb-440e-4fdc-bdfa-6580a2275929 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Lock "cinder-dce15613-8e34-4a10-8578-b5cfad5b5ec2-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:36:26 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-fe75c8cb-440e-4fdc-bdfa-6580a2275929 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Acquiring lock "cinder-quobyte-dce15613-8e34-4a10-8578-b5cfad5b5ec2" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:36:26 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-fe75c8cb-440e-4fdc-bdfa-6580a2275929 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Lock "cinder-quobyte-dce15613-8e34-4a10-8578-b5cfad5b5ec2" acquired by "delete_volume" :: waited 0.030s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:36:26 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb8977dd-ec57-40b5-a94c-858eb273e553]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:36:26 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-fe75c8cb-440e-4fdc-bdfa-6580a2275929 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-dce15613-8e34-4a10-8578-b5cfad5b5ec2 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:27 devstack sudo[103094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-dce15613-8e34-4a10-8578-b5cfad5b5ec2 Sep 28 09:36:27 devstack sudo[103094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:27 devstack sudo[103094]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:27 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-fe75c8cb-440e-4fdc-bdfa-6580a2275929 tempest-CreateVolumesFromSnapshotTest-1951497831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-dce15613-8e34-4a10-8578-b5cfad5b5ec2" returned: 0 in 0.655s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:27 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-fe75c8cb-440e-4fdc-bdfa-6580a2275929 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-dce15613-8e34-4a10-8578-b5cfad5b5ec2 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:27 devstack sudo[103099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-dce15613-8e34-4a10-8578-b5cfad5b5ec2 Sep 28 09:36:27 devstack sudo[103099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:27 devstack sudo[103099]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:27 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-fe75c8cb-440e-4fdc-bdfa-6580a2275929 tempest-CreateVolumesFromSnapshotTest-1951497831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-dce15613-8e34-4a10-8578-b5cfad5b5ec2" returned: 0 in 0.305s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:27 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-fe75c8cb-440e-4fdc-bdfa-6580a2275929 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Lock "cinder-quobyte-dce15613-8e34-4a10-8578-b5cfad5b5ec2" released by "delete_volume" :: held 1.032s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:36:28 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-fe75c8cb-440e-4fdc-bdfa-6580a2275929 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Created reservations ['aaa3d11f-2da5-44f2-9b98-8ef4d3832f24', 'e42d4f51-37a9-4001-b179-4b3ed8f0dfb2', 'fc6ceb0b-22f7-467c-9a73-af126cf3241a', 'fa529cac-af12-4cac-b66b-26be6b747c38'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:36:28 devstack sudo[103067]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:28 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-07284645-7e78-411d-9e9d-1b605f2cfc91 tempest-VolumesGetTest-1635800146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1a11c21d-88b0-4620-aa82-1ded26f580c9_v12vycobdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-ca7a3780-e42a-42d0-bd8f-b23b489fd892" returned: 0 in 2.953s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:28 devstack cinder-volume[86553]: DEBUG cinder.image.image_utils [None req-07284645-7e78-411d-9e9d-1b605f2cfc91 tempest-VolumesGetTest-1635800146 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1a11c21d-88b0-4620-aa82-1ded26f580c9_v12vycobdevstack@QuobyteHD, size 112.00 MB, duration 2.95 sec, destination /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-ca7a3780-e42a-42d0-bd8f-b23b489fd892 {{(pid=86553) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 09:36:28 devstack cinder-volume[86553]: INFO cinder.image.image_utils [None req-07284645-7e78-411d-9e9d-1b605f2cfc91 tempest-VolumesGetTest-1635800146 None] Converted 112.00 MB image at 37.91 MB/s Sep 28 09:36:28 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-07284645-7e78-411d-9e9d-1b605f2cfc91 tempest-VolumesGetTest-1635800146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-ca7a3780-e42a-42d0-bd8f-b23b489fd892 1G {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:28 devstack sudo[103103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-ca7a3780-e42a-42d0-bd8f-b23b489fd892 1G Sep 28 09:36:28 devstack sudo[103103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:28 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-fe75c8cb-440e-4fdc-bdfa-6580a2275929 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:36:28 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-fe75c8cb-440e-4fdc-bdfa-6580a2275929 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:36:28 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-fe75c8cb-440e-4fdc-bdfa-6580a2275929 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:36:28 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-fe75c8cb-440e-4fdc-bdfa-6580a2275929 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:36:28 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-fe75c8cb-440e-4fdc-bdfa-6580a2275929 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:36:28 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-fe75c8cb-440e-4fdc-bdfa-6580a2275929 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:28 devstack sudo[103105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:36:28 devstack sudo[103105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:28 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-e184a56b-33ba-4878-8ceb-df8f3b0c2289 tempest-TestServerVolumeAttachmentScenario-522292647 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:36:28 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e184a56b-33ba-4878-8ceb-df8f3b0c2289 tempest-TestServerVolumeAttachmentScenario-522292647 None] Flow 'volume_create_manager' (d4706ac8-208f-4a49-9dcc-615a0b082272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:36:28 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e184a56b-33ba-4878-8ceb-df8f3b0c2289 tempest-TestServerVolumeAttachmentScenario-522292647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44aa9243-d036-4929-b907-4b18523f7dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:36:28 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e184a56b-33ba-4878-8ceb-df8f3b0c2289 tempest-TestServerVolumeAttachmentScenario-522292647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44aa9243-d036-4929-b907-4b18523f7dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:36:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2025972842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1aed4847-2eb9-4062-92bd-a26a64e28dea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='267f5f91074241e2a9bc2e358c56e8af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:36:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:36:28Z,use_quota=True,user_id='b3c5cb8d937d4f5a9c958a4700f730b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:36:28 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e184a56b-33ba-4878-8ceb-df8f3b0c2289 tempest-TestServerVolumeAttachmentScenario-522292647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2c2b571-eb28-4024-b067-e17d4cf27ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:36:28 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e184a56b-33ba-4878-8ceb-df8f3b0c2289 tempest-TestServerVolumeAttachmentScenario-522292647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2c2b571-eb28-4024-b067-e17d4cf27ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:36:28 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e184a56b-33ba-4878-8ceb-df8f3b0c2289 tempest-TestServerVolumeAttachmentScenario-522292647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fb7119c-0f03-4760-b7bf-9f005ee8f6e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:36:28 devstack sudo[103103]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:28 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e184a56b-33ba-4878-8ceb-df8f3b0c2289 tempest-TestServerVolumeAttachmentScenario-522292647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fb7119c-0f03-4760-b7bf-9f005ee8f6e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1aed4847-2eb9-4062-92bd-a26a64e28dea', 'volume_name': 'volume-1aed4847-2eb9-4062-92bd-a26a64e28dea', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:36:28 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e184a56b-33ba-4878-8ceb-df8f3b0c2289 tempest-TestServerVolumeAttachmentScenario-522292647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e78bf6d-ff9c-4611-b84f-5a9748d96987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:36:28 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e184a56b-33ba-4878-8ceb-df8f3b0c2289 tempest-TestServerVolumeAttachmentScenario-522292647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e78bf6d-ff9c-4611-b84f-5a9748d96987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:36:28 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e184a56b-33ba-4878-8ceb-df8f3b0c2289 tempest-TestServerVolumeAttachmentScenario-522292647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3f83a4f-6e5f-418e-ac40-6dfafa7f7be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:36:28 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-e184a56b-33ba-4878-8ceb-df8f3b0c2289 tempest-TestServerVolumeAttachmentScenario-522292647 None] Volume 1aed4847-2eb9-4062-92bd-a26a64e28dea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1aed4847-2eb9-4062-92bd-a26a64e28dea', 'volume_size': 1} Sep 28 09:36:28 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-e184a56b-33ba-4878-8ceb-df8f3b0c2289 tempest-TestServerVolumeAttachmentScenario-522292647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:36:28 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-e184a56b-33ba-4878-8ceb-df8f3b0c2289 tempest-TestServerVolumeAttachmentScenario-522292647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:36:28 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-e184a56b-33ba-4878-8ceb-df8f3b0c2289 tempest-TestServerVolumeAttachmentScenario-522292647 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:36:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2025972842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1aed4847-2eb9-4062-92bd-a26a64e28dea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='267f5f91074241e2a9bc2e358c56e8af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:36:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:36:28Z,use_quota=True,user_id='b3c5cb8d937d4f5a9c958a4700f730b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:36:28 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-e184a56b-33ba-4878-8ceb-df8f3b0c2289 tempest-TestServerVolumeAttachmentScenario-522292647 None] Creating volume 1aed4847-2eb9-4062-92bd-a26a64e28dea {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:36:28 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-e184a56b-33ba-4878-8ceb-df8f3b0c2289 tempest-TestServerVolumeAttachmentScenario-522292647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:36:28 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-e184a56b-33ba-4878-8ceb-df8f3b0c2289 tempest-TestServerVolumeAttachmentScenario-522292647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:36:28 devstack sudo[103105]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:28 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-e184a56b-33ba-4878-8ceb-df8f3b0c2289 tempest-TestServerVolumeAttachmentScenario-522292647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:36:28 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-e184a56b-33ba-4878-8ceb-df8f3b0c2289 tempest-TestServerVolumeAttachmentScenario-522292647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:36:28 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-e184a56b-33ba-4878-8ceb-df8f3b0c2289 tempest-TestServerVolumeAttachmentScenario-522292647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:36:28 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-e184a56b-33ba-4878-8ceb-df8f3b0c2289 tempest-TestServerVolumeAttachmentScenario-522292647 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:36:28 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-e184a56b-33ba-4878-8ceb-df8f3b0c2289 tempest-TestServerVolumeAttachmentScenario-522292647 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:36:28 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e184a56b-33ba-4878-8ceb-df8f3b0c2289 tempest-TestServerVolumeAttachmentScenario-522292647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1aed4847-2eb9-4062-92bd-a26a64e28dea 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:28 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-07284645-7e78-411d-9e9d-1b605f2cfc91 tempest-VolumesGetTest-1635800146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-ca7a3780-e42a-42d0-bd8f-b23b489fd892 1G" returned: 0 in 0.462s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:28 devstack cinder-volume[86553]: DEBUG cinder.volume.volume_utils [None req-07284645-7e78-411d-9e9d-1b605f2cfc91 tempest-VolumesGetTest-1635800146 None] Downloaded image 1a11c21d-88b0-4620-aa82-1ded26f580c9 ((None, [{'url': 'file:///opt/stack/data/glance/images/1a11c21d-88b0-4620-aa82-1ded26f580c9', 'metadata': {}}])) to volume ca7a3780-e42a-42d0-bd8f-b23b489fd892 successfully. {{(pid=86553) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 09:36:28 devstack cinder-volume[86553]: DEBUG cinder.image.image_utils [None req-07284645-7e78-411d-9e9d-1b605f2cfc91 tempest-VolumesGetTest-1635800146 None] Temporary image 1a11c21d-88b0-4620-aa82-1ded26f580c9 for user a7990b3b37d84bc4acd2288b34b11a7a is deleted. {{(pid=86553) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 09:36:28 devstack cinder-volume[86553]: DEBUG cinder.volume.volume_utils [None req-07284645-7e78-411d-9e9d-1b605f2cfc91 tempest-VolumesGetTest-1635800146 None] Marking volume ca7a3780-e42a-42d0-bd8f-b23b489fd892 as bootable. {{(pid=86553) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 09:36:28 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-fe75c8cb-440e-4fdc-bdfa-6580a2275929 tempest-CreateVolumesFromSnapshotTest-1951497831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.377s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:28 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-fe75c8cb-440e-4fdc-bdfa-6580a2275929 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:36:28 devstack sudo[103111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1aed4847-2eb9-4062-92bd-a26a64e28dea 1073741824 Sep 28 09:36:28 devstack sudo[103111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:28 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-fe75c8cb-440e-4fdc-bdfa-6580a2275929 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Deleted volume successfully. Sep 28 09:36:28 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-07284645-7e78-411d-9e9d-1b605f2cfc91 tempest-VolumesGetTest-1635800146 None] Copying metadata from image 1a11c21d-88b0-4620-aa82-1ded26f580c9 to ca7a3780-e42a-42d0-bd8f-b23b489fd892. {{(pid=86553) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 09:36:28 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-07284645-7e78-411d-9e9d-1b605f2cfc91 tempest-VolumesGetTest-1635800146 None] Creating volume glance metadata for volume ca7a3780-e42a-42d0-bd8f-b23b489fd892 backed by image 1a11c21d-88b0-4620-aa82-1ded26f580c9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '1a11c21d-88b0-4620-aa82-1ded26f580c9', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86553) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 09:36:28 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-fe75c8cb-440e-4fdc-bdfa-6580a2275929 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Lock "cinder-dce15613-8e34-4a10-8578-b5cfad5b5ec2-delete_volume" released by "delete_volume" :: held 1.762s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:36:28 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-07284645-7e78-411d-9e9d-1b605f2cfc91 tempest-VolumesGetTest-1635800146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afd64903-767f-44df-ab44-33831a87bd5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca7a3780-e42a-42d0-bd8f-b23b489fd892', 'volume_size': 1, 'image_id': '1a11c21d-88b0-4620-aa82-1ded26f580c9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1a11c21d-88b0-4620-aa82-1ded26f580c9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b800784c68dc485682fd42484c46336e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1a11c21d-88b0-4620-aa82-1ded26f580c9', 'created_at': datetime.datetime(2026, 9, 28, 7, 16, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 7, 16, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a11c21d-88b0-4620-aa82-1ded26f580c9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:36:28 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-07284645-7e78-411d-9e9d-1b605f2cfc91 tempest-VolumesGetTest-1635800146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (058392a0-f0da-4a78-98be-7e30dd7c97f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:36:28 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-07284645-7e78-411d-9e9d-1b605f2cfc91 tempest-VolumesGetTest-1635800146 None] Volume volume-ca7a3780-e42a-42d0-bd8f-b23b489fd892 (ca7a3780-e42a-42d0-bd8f-b23b489fd892): created successfully Sep 28 09:36:28 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-07284645-7e78-411d-9e9d-1b605f2cfc91 tempest-VolumesGetTest-1635800146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (058392a0-f0da-4a78-98be-7e30dd7c97f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:36:28 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-07284645-7e78-411d-9e9d-1b605f2cfc91 tempest-VolumesGetTest-1635800146 None] Flow 'volume_create_manager' (590b6656-cc94-476f-9e8a-cb6c6acdb758) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:36:28 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-07284645-7e78-411d-9e9d-1b605f2cfc91 tempest-VolumesGetTest-1635800146 None] Created volume successfully. Sep 28 09:36:28 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb1c02aa-a652-4666-bf93-d7c81807243c tempest-TestServerVolumeAttachmentScenario-522292647 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:36:28 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-bb1c02aa-a652-4666-bf93-d7c81807243c tempest-TestServerVolumeAttachmentScenario-522292647 None] Flow 'volume_create_manager' (0385af4d-f256-4588-965a-ecfd338b2db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:36:28 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-bb1c02aa-a652-4666-bf93-d7c81807243c tempest-TestServerVolumeAttachmentScenario-522292647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7859e8fe-34aa-4226-8801-0e4dcb11f410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:36:28 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-bb1c02aa-a652-4666-bf93-d7c81807243c tempest-TestServerVolumeAttachmentScenario-522292647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7859e8fe-34aa-4226-8801-0e4dcb11f410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:36:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1248603042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70735ee3-680d-460d-85fd-482532d6462e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='267f5f91074241e2a9bc2e358c56e8af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:36:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:36:29Z,use_quota=True,user_id='b3c5cb8d937d4f5a9c958a4700f730b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:36:28 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-bb1c02aa-a652-4666-bf93-d7c81807243c tempest-TestServerVolumeAttachmentScenario-522292647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c162c422-59ce-4456-b4b0-7ead5f198d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:36:28 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-bb1c02aa-a652-4666-bf93-d7c81807243c tempest-TestServerVolumeAttachmentScenario-522292647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c162c422-59ce-4456-b4b0-7ead5f198d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:36:28 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-bb1c02aa-a652-4666-bf93-d7c81807243c tempest-TestServerVolumeAttachmentScenario-522292647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3008577b-e831-4a7d-9f76-2bdba0bb55e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:36:28 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-bb1c02aa-a652-4666-bf93-d7c81807243c tempest-TestServerVolumeAttachmentScenario-522292647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3008577b-e831-4a7d-9f76-2bdba0bb55e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70735ee3-680d-460d-85fd-482532d6462e', 'volume_name': 'volume-70735ee3-680d-460d-85fd-482532d6462e', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:36:28 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-bb1c02aa-a652-4666-bf93-d7c81807243c tempest-TestServerVolumeAttachmentScenario-522292647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (953fd008-36d7-4e4e-9112-071756f084c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:36:28 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-bb1c02aa-a652-4666-bf93-d7c81807243c tempest-TestServerVolumeAttachmentScenario-522292647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (953fd008-36d7-4e4e-9112-071756f084c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:36:28 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-bb1c02aa-a652-4666-bf93-d7c81807243c tempest-TestServerVolumeAttachmentScenario-522292647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86b2b12b-b024-4702-b432-fbf0e57ac811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:36:28 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-bb1c02aa-a652-4666-bf93-d7c81807243c tempest-TestServerVolumeAttachmentScenario-522292647 None] Volume 70735ee3-680d-460d-85fd-482532d6462e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70735ee3-680d-460d-85fd-482532d6462e', 'volume_size': 1} Sep 28 09:36:28 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-bb1c02aa-a652-4666-bf93-d7c81807243c tempest-TestServerVolumeAttachmentScenario-522292647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:36:29 devstack sudo[103111]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:29 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e184a56b-33ba-4878-8ceb-df8f3b0c2289 tempest-TestServerVolumeAttachmentScenario-522292647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1aed4847-2eb9-4062-92bd-a26a64e28dea 1073741824" returned: 0 in 0.568s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:29 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-56dd182b-36a2-4e14-a5ad-af5967add62d tempest-CreateVolumesFromSnapshotTest-1951497831 None] Acquiring lock "cinder-e070e431-73a7-4dab-af78-28d3d04b25c2-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:36:29 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-56dd182b-36a2-4e14-a5ad-af5967add62d tempest-CreateVolumesFromSnapshotTest-1951497831 None] Lock "cinder-e070e431-73a7-4dab-af78-28d3d04b25c2-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:36:29 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e184a56b-33ba-4878-8ceb-df8f3b0c2289 tempest-TestServerVolumeAttachmentScenario-522292647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1aed4847-2eb9-4062-92bd-a26a64e28dea {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:29 devstack sudo[103117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1aed4847-2eb9-4062-92bd-a26a64e28dea Sep 28 09:36:29 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-56dd182b-36a2-4e14-a5ad-af5967add62d tempest-CreateVolumesFromSnapshotTest-1951497831 None] Acquiring lock "cinder-quobyte-e070e431-73a7-4dab-af78-28d3d04b25c2" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:36:29 devstack sudo[103117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:29 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-56dd182b-36a2-4e14-a5ad-af5967add62d tempest-CreateVolumesFromSnapshotTest-1951497831 None] Lock "cinder-quobyte-e070e431-73a7-4dab-af78-28d3d04b25c2" acquired by "delete_volume" :: waited 0.019s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:36:29 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0cd2f25-e9c6-47d1-b2f6-b3f936d782e4]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:36:29 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-56dd182b-36a2-4e14-a5ad-af5967add62d tempest-CreateVolumesFromSnapshotTest-1951497831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-e070e431-73a7-4dab-af78-28d3d04b25c2 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:29 devstack sudo[103119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-e070e431-73a7-4dab-af78-28d3d04b25c2 Sep 28 09:36:29 devstack sudo[103119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:29 devstack sudo[103117]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:29 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e184a56b-33ba-4878-8ceb-df8f3b0c2289 tempest-TestServerVolumeAttachmentScenario-522292647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1aed4847-2eb9-4062-92bd-a26a64e28dea" returned: 0 in 0.293s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:29 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-e184a56b-33ba-4878-8ceb-df8f3b0c2289 tempest-TestServerVolumeAttachmentScenario-522292647 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:36:29 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-e184a56b-33ba-4878-8ceb-df8f3b0c2289 tempest-TestServerVolumeAttachmentScenario-522292647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:36:29 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-bb1c02aa-a652-4666-bf93-d7c81807243c tempest-TestServerVolumeAttachmentScenario-522292647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.533s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:36:29 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-bb1c02aa-a652-4666-bf93-d7c81807243c tempest-TestServerVolumeAttachmentScenario-522292647 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:36:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1248603042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70735ee3-680d-460d-85fd-482532d6462e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='267f5f91074241e2a9bc2e358c56e8af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:36:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:36:29Z,use_quota=True,user_id='b3c5cb8d937d4f5a9c958a4700f730b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:36:29 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-bb1c02aa-a652-4666-bf93-d7c81807243c tempest-TestServerVolumeAttachmentScenario-522292647 None] Creating volume 70735ee3-680d-460d-85fd-482532d6462e {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:36:29 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-bb1c02aa-a652-4666-bf93-d7c81807243c tempest-TestServerVolumeAttachmentScenario-522292647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:36:29 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-bb1c02aa-a652-4666-bf93-d7c81807243c tempest-TestServerVolumeAttachmentScenario-522292647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:36:29 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-bb1c02aa-a652-4666-bf93-d7c81807243c tempest-TestServerVolumeAttachmentScenario-522292647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:36:29 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-bb1c02aa-a652-4666-bf93-d7c81807243c tempest-TestServerVolumeAttachmentScenario-522292647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:36:29 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-bb1c02aa-a652-4666-bf93-d7c81807243c tempest-TestServerVolumeAttachmentScenario-522292647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:36:29 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-bb1c02aa-a652-4666-bf93-d7c81807243c tempest-TestServerVolumeAttachmentScenario-522292647 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:36:29 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-bb1c02aa-a652-4666-bf93-d7c81807243c tempest-TestServerVolumeAttachmentScenario-522292647 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:36:29 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-bb1c02aa-a652-4666-bf93-d7c81807243c tempest-TestServerVolumeAttachmentScenario-522292647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-70735ee3-680d-460d-85fd-482532d6462e 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:29 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e184a56b-33ba-4878-8ceb-df8f3b0c2289 tempest-TestServerVolumeAttachmentScenario-522292647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3f83a4f-6e5f-418e-ac40-6dfafa7f7be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1aed4847-2eb9-4062-92bd-a26a64e28dea', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:36:29 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e184a56b-33ba-4878-8ceb-df8f3b0c2289 tempest-TestServerVolumeAttachmentScenario-522292647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (389f30f8-f451-4770-ac49-85731b897946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:36:29 devstack sudo[103122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-70735ee3-680d-460d-85fd-482532d6462e 1073741824 Sep 28 09:36:29 devstack sudo[103122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:29 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-e184a56b-33ba-4878-8ceb-df8f3b0c2289 tempest-TestServerVolumeAttachmentScenario-522292647 None] Volume volume-1aed4847-2eb9-4062-92bd-a26a64e28dea (1aed4847-2eb9-4062-92bd-a26a64e28dea): created successfully Sep 28 09:36:29 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e184a56b-33ba-4878-8ceb-df8f3b0c2289 tempest-TestServerVolumeAttachmentScenario-522292647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (389f30f8-f451-4770-ac49-85731b897946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:36:29 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e184a56b-33ba-4878-8ceb-df8f3b0c2289 tempest-TestServerVolumeAttachmentScenario-522292647 None] Flow 'volume_create_manager' (d4706ac8-208f-4a49-9dcc-615a0b082272) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:36:29 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-e184a56b-33ba-4878-8ceb-df8f3b0c2289 tempest-TestServerVolumeAttachmentScenario-522292647 None] Created volume successfully. Sep 28 09:36:29 devstack sudo[103119]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:29 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-56dd182b-36a2-4e14-a5ad-af5967add62d tempest-CreateVolumesFromSnapshotTest-1951497831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-e070e431-73a7-4dab-af78-28d3d04b25c2" returned: 0 in 0.501s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:29 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-56dd182b-36a2-4e14-a5ad-af5967add62d tempest-CreateVolumesFromSnapshotTest-1951497831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-e070e431-73a7-4dab-af78-28d3d04b25c2 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:29 devstack sudo[103130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-e070e431-73a7-4dab-af78-28d3d04b25c2 Sep 28 09:36:29 devstack sudo[103130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:30 devstack sudo[103130]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-56dd182b-36a2-4e14-a5ad-af5967add62d tempest-CreateVolumesFromSnapshotTest-1951497831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-e070e431-73a7-4dab-af78-28d3d04b25c2" returned: 0 in 0.323s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:30 devstack sudo[103122]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-bb1c02aa-a652-4666-bf93-d7c81807243c tempest-TestServerVolumeAttachmentScenario-522292647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-70735ee3-680d-460d-85fd-482532d6462e 1073741824" returned: 0 in 0.630s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:30 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-56dd182b-36a2-4e14-a5ad-af5967add62d tempest-CreateVolumesFromSnapshotTest-1951497831 None] Lock "cinder-quobyte-e070e431-73a7-4dab-af78-28d3d04b25c2" released by "delete_volume" :: held 0.896s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:36:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-bb1c02aa-a652-4666-bf93-d7c81807243c tempest-TestServerVolumeAttachmentScenario-522292647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-70735ee3-680d-460d-85fd-482532d6462e {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:30 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-56dd182b-36a2-4e14-a5ad-af5967add62d tempest-CreateVolumesFromSnapshotTest-1951497831 None] Created reservations ['51a9409b-ece3-46bf-99eb-6417162ac929', '93af753f-fb86-4c40-8d67-cd4991f6e4f8', 'adfdb80d-a27f-4e21-8fd4-845d641380f4', '3c21ecc4-72c2-4945-8383-bd2c12978cb7'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:36:30 devstack sudo[103134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-70735ee3-680d-460d-85fd-482532d6462e Sep 28 09:36:30 devstack sudo[103134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-56dd182b-36a2-4e14-a5ad-af5967add62d tempest-CreateVolumesFromSnapshotTest-1951497831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:36:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-56dd182b-36a2-4e14-a5ad-af5967add62d tempest-CreateVolumesFromSnapshotTest-1951497831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:36:30 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-56dd182b-36a2-4e14-a5ad-af5967add62d tempest-CreateVolumesFromSnapshotTest-1951497831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:36:30 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-56dd182b-36a2-4e14-a5ad-af5967add62d tempest-CreateVolumesFromSnapshotTest-1951497831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:36:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-56dd182b-36a2-4e14-a5ad-af5967add62d tempest-CreateVolumesFromSnapshotTest-1951497831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:36:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-56dd182b-36a2-4e14-a5ad-af5967add62d tempest-CreateVolumesFromSnapshotTest-1951497831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:30 devstack sudo[103136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:36:30 devstack sudo[103136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:30 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-46ffb4d3-1275-41e8-a3f9-3c4bcec35f72 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Acquiring lock "cinder-55470911-773e-489a-9a2c-588bae208ad1-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:36:30 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-46ffb4d3-1275-41e8-a3f9-3c4bcec35f72 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Lock "cinder-55470911-773e-489a-9a2c-588bae208ad1-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:36:30 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-46ffb4d3-1275-41e8-a3f9-3c4bcec35f72 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Acquiring lock "cinder-quobyte-55470911-773e-489a-9a2c-588bae208ad1" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:36:30 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-46ffb4d3-1275-41e8-a3f9-3c4bcec35f72 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Lock "cinder-quobyte-55470911-773e-489a-9a2c-588bae208ad1" acquired by "delete_volume" :: waited 0.029s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:36:30 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[f305048d-51cd-4406-9e12-0a82cee3223d]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:36:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-46ffb4d3-1275-41e8-a3f9-3c4bcec35f72 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-55470911-773e-489a-9a2c-588bae208ad1 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:30 devstack sudo[103136]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-56dd182b-36a2-4e14-a5ad-af5967add62d tempest-CreateVolumesFromSnapshotTest-1951497831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.293s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:30 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-56dd182b-36a2-4e14-a5ad-af5967add62d tempest-CreateVolumesFromSnapshotTest-1951497831 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:36:30 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-56dd182b-36a2-4e14-a5ad-af5967add62d tempest-CreateVolumesFromSnapshotTest-1951497831 None] Deleted volume successfully. Sep 28 09:36:30 devstack sudo[103134]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-bb1c02aa-a652-4666-bf93-d7c81807243c tempest-TestServerVolumeAttachmentScenario-522292647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-70735ee3-680d-460d-85fd-482532d6462e" returned: 0 in 0.500s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:30 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-bb1c02aa-a652-4666-bf93-d7c81807243c tempest-TestServerVolumeAttachmentScenario-522292647 None] <== create_volume: return (1189ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:36:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-bb1c02aa-a652-4666-bf93-d7c81807243c tempest-TestServerVolumeAttachmentScenario-522292647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.193s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:36:30 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-bb1c02aa-a652-4666-bf93-d7c81807243c tempest-TestServerVolumeAttachmentScenario-522292647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86b2b12b-b024-4702-b432-fbf0e57ac811) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70735ee3-680d-460d-85fd-482532d6462e', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:36:30 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-bb1c02aa-a652-4666-bf93-d7c81807243c tempest-TestServerVolumeAttachmentScenario-522292647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efb8eda3-a1e1-4011-9f60-ac0345080dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:36:30 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-56dd182b-36a2-4e14-a5ad-af5967add62d tempest-CreateVolumesFromSnapshotTest-1951497831 None] Lock "cinder-e070e431-73a7-4dab-af78-28d3d04b25c2-delete_volume" released by "delete_volume" :: held 1.551s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:36:30 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-bb1c02aa-a652-4666-bf93-d7c81807243c tempest-TestServerVolumeAttachmentScenario-522292647 None] Volume volume-70735ee3-680d-460d-85fd-482532d6462e (70735ee3-680d-460d-85fd-482532d6462e): created successfully Sep 28 09:36:30 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-bb1c02aa-a652-4666-bf93-d7c81807243c tempest-TestServerVolumeAttachmentScenario-522292647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efb8eda3-a1e1-4011-9f60-ac0345080dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:36:30 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-bb1c02aa-a652-4666-bf93-d7c81807243c tempest-TestServerVolumeAttachmentScenario-522292647 None] Flow 'volume_create_manager' (0385af4d-f256-4588-965a-ecfd338b2db5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:36:30 devstack sudo[103140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-55470911-773e-489a-9a2c-588bae208ad1 Sep 28 09:36:30 devstack sudo[103140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:30 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-bb1c02aa-a652-4666-bf93-d7c81807243c tempest-TestServerVolumeAttachmentScenario-522292647 None] Created volume successfully. Sep 28 09:36:30 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae302584-882d-4901-9f6f-b31eb61452fb tempest-VolumesGetTest-1635800146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:36:30 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ae302584-882d-4901-9f6f-b31eb61452fb tempest-VolumesGetTest-1635800146 None] Flow 'volume_create_manager' (94fa77c9-da52-4c1a-94fc-81fff370e8a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:36:30 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ae302584-882d-4901-9f6f-b31eb61452fb tempest-VolumesGetTest-1635800146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7261b8c-537c-42aa-909e-cd33a49527fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:36:30 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ae302584-882d-4901-9f6f-b31eb61452fb tempest-VolumesGetTest-1635800146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7261b8c-537c-42aa-909e-cd33a49527fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:36:30Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-597166123',display_name='tempest-VolumesGetTest-Volume-1502811949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08289272-d247-4ca3-97d6-712143ef4d3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be84b080459e458496b0d755a3c89703',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:36:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:36:31Z,use_quota=True,user_id='a7990b3b37d84bc4acd2288b34b11a7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:36:30 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ae302584-882d-4901-9f6f-b31eb61452fb tempest-VolumesGetTest-1635800146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f438d09f-13dd-45ec-b2b4-12c7df16e440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:36:30 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ae302584-882d-4901-9f6f-b31eb61452fb tempest-VolumesGetTest-1635800146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f438d09f-13dd-45ec-b2b4-12c7df16e440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:36:30 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ae302584-882d-4901-9f6f-b31eb61452fb tempest-VolumesGetTest-1635800146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00ef5fc0-35fe-439f-93c6-5b227549dd86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:36:30 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ae302584-882d-4901-9f6f-b31eb61452fb tempest-VolumesGetTest-1635800146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00ef5fc0-35fe-439f-93c6-5b227549dd86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08289272-d247-4ca3-97d6-712143ef4d3b', 'volume_name': 'volume-08289272-d247-4ca3-97d6-712143ef4d3b', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:36:30 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ae302584-882d-4901-9f6f-b31eb61452fb tempest-VolumesGetTest-1635800146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5906dec5-2d21-434b-bc85-8d4dcdf032bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:36:30 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ae302584-882d-4901-9f6f-b31eb61452fb tempest-VolumesGetTest-1635800146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5906dec5-2d21-434b-bc85-8d4dcdf032bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:36:30 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ae302584-882d-4901-9f6f-b31eb61452fb tempest-VolumesGetTest-1635800146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3881117f-75b1-4197-9606-f0fbc9dc1b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:36:30 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-ae302584-882d-4901-9f6f-b31eb61452fb tempest-VolumesGetTest-1635800146 None] Volume 08289272-d247-4ca3-97d6-712143ef4d3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08289272-d247-4ca3-97d6-712143ef4d3b', 'volume_size': 1} Sep 28 09:36:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ae302584-882d-4901-9f6f-b31eb61452fb tempest-VolumesGetTest-1635800146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:36:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ae302584-882d-4901-9f6f-b31eb61452fb tempest-VolumesGetTest-1635800146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:36:30 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ae302584-882d-4901-9f6f-b31eb61452fb tempest-VolumesGetTest-1635800146 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:36:30Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-597166123',display_name='tempest-VolumesGetTest-Volume-1502811949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08289272-d247-4ca3-97d6-712143ef4d3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be84b080459e458496b0d755a3c89703',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:36:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:36:31Z,use_quota=True,user_id='a7990b3b37d84bc4acd2288b34b11a7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:36:30 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-ae302584-882d-4901-9f6f-b31eb61452fb tempest-VolumesGetTest-1635800146 None] Creating volume 08289272-d247-4ca3-97d6-712143ef4d3b {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:36:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ae302584-882d-4901-9f6f-b31eb61452fb tempest-VolumesGetTest-1635800146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:36:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ae302584-882d-4901-9f6f-b31eb61452fb tempest-VolumesGetTest-1635800146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:36:30 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ae302584-882d-4901-9f6f-b31eb61452fb tempest-VolumesGetTest-1635800146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:36:30 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ae302584-882d-4901-9f6f-b31eb61452fb tempest-VolumesGetTest-1635800146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:36:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ae302584-882d-4901-9f6f-b31eb61452fb tempest-VolumesGetTest-1635800146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:36:30 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ae302584-882d-4901-9f6f-b31eb61452fb tempest-VolumesGetTest-1635800146 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:36:30 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-ae302584-882d-4901-9f6f-b31eb61452fb tempest-VolumesGetTest-1635800146 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:36:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ae302584-882d-4901-9f6f-b31eb61452fb tempest-VolumesGetTest-1635800146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-08289272-d247-4ca3-97d6-712143ef4d3b 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:30 devstack sudo[103142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-08289272-d247-4ca3-97d6-712143ef4d3b 1073741824 Sep 28 09:36:30 devstack sudo[103142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:30 devstack sudo[103140]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-46ffb4d3-1275-41e8-a3f9-3c4bcec35f72 tempest-CreateVolumesFromSnapshotTest-1951497831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-55470911-773e-489a-9a2c-588bae208ad1" returned: 0 in 0.440s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-46ffb4d3-1275-41e8-a3f9-3c4bcec35f72 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-55470911-773e-489a-9a2c-588bae208ad1 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:31 devstack sudo[103147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-55470911-773e-489a-9a2c-588bae208ad1 Sep 28 09:36:31 devstack sudo[103147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:31 devstack sudo[103147]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:31 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-46ffb4d3-1275-41e8-a3f9-3c4bcec35f72 tempest-CreateVolumesFromSnapshotTest-1951497831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-55470911-773e-489a-9a2c-588bae208ad1" returned: 0 in 0.315s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:31 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-46ffb4d3-1275-41e8-a3f9-3c4bcec35f72 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Lock "cinder-quobyte-55470911-773e-489a-9a2c-588bae208ad1" released by "delete_volume" :: held 0.847s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:36:31 devstack sudo[103142]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:31 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ae302584-882d-4901-9f6f-b31eb61452fb tempest-VolumesGetTest-1635800146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-08289272-d247-4ca3-97d6-712143ef4d3b 1073741824" returned: 0 in 0.544s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:31 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-46ffb4d3-1275-41e8-a3f9-3c4bcec35f72 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Created reservations ['544c3bed-ad56-46fc-b4bd-f646a1b6cd0c', 'c44570a3-158f-4978-991b-a5280c4174f4', '7b3296bf-39dc-47d8-8adb-f7163bd274d6', '2758a494-8ae2-4a34-a5b5-375a0f4b46ee'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:36:31 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ae302584-882d-4901-9f6f-b31eb61452fb tempest-VolumesGetTest-1635800146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-08289272-d247-4ca3-97d6-712143ef4d3b {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:31 devstack sudo[103159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-08289272-d247-4ca3-97d6-712143ef4d3b Sep 28 09:36:31 devstack sudo[103159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:31 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-46ffb4d3-1275-41e8-a3f9-3c4bcec35f72 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:36:31 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-46ffb4d3-1275-41e8-a3f9-3c4bcec35f72 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:36:31 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-46ffb4d3-1275-41e8-a3f9-3c4bcec35f72 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:36:31 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-46ffb4d3-1275-41e8-a3f9-3c4bcec35f72 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:36:31 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-46ffb4d3-1275-41e8-a3f9-3c4bcec35f72 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:36:31 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-46ffb4d3-1275-41e8-a3f9-3c4bcec35f72 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:31 devstack sudo[103161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:36:31 devstack sudo[103161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:31 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-13bda66e-023a-491e-8f36-88f859aa2774 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Acquiring lock "cinder-cc1fb8a1-52b9-43ea-8f63-cae5a94c4d35-delete_snapshot" by "delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:36:31 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-13bda66e-023a-491e-8f36-88f859aa2774 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Lock "cinder-cc1fb8a1-52b9-43ea-8f63-cae5a94c4d35-delete_snapshot" acquired by "delete_snapshot" :: waited 0.058s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:36:31 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-13bda66e-023a-491e-8f36-88f859aa2774 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Acquiring lock "cinder-quobyte-a9333397-e5e6-4da5-9e73-1da4b9b904eb" by "delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:36:31 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-13bda66e-023a-491e-8f36-88f859aa2774 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Lock "cinder-quobyte-a9333397-e5e6-4da5-9e73-1da4b9b904eb" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:36:31 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-13bda66e-023a-491e-8f36-88f859aa2774 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Acquiring lock "cinder-quobyte-cc1fb8a1-52b9-43ea-8f63-cae5a94c4d35" by "_delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:36:31 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-13bda66e-023a-491e-8f36-88f859aa2774 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Lock "cinder-quobyte-cc1fb8a1-52b9-43ea-8f63-cae5a94c4d35" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:36:31 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-13bda66e-023a-491e-8f36-88f859aa2774 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Deleting offline snapshot cc1fb8a1-52b9-43ea-8f63-cae5a94c4d35 of volume a9333397-e5e6-4da5-9e73-1da4b9b904eb {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 09:36:31 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-13bda66e-023a-491e-8f36-88f859aa2774 tempest-CreateVolumesFromSnapshotTest-1951497831 None] snapshot_file for this snap is: volume-a9333397-e5e6-4da5-9e73-1da4b9b904eb.cc1fb8a1-52b9-43ea-8f63-cae5a94c4d35 {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 09:36:31 devstack sudo[103159]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:31 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ae302584-882d-4901-9f6f-b31eb61452fb tempest-VolumesGetTest-1635800146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-08289272-d247-4ca3-97d6-712143ef4d3b" returned: 0 in 0.323s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:31 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ae302584-882d-4901-9f6f-b31eb61452fb tempest-VolumesGetTest-1635800146 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:36:31 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ae302584-882d-4901-9f6f-b31eb61452fb tempest-VolumesGetTest-1635800146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:36:31 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d38117a-7501-42e2-84a0-c301f5e30ba3]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:36:31 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-13bda66e-023a-491e-8f36-88f859aa2774 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a9333397-e5e6-4da5-9e73-1da4b9b904eb.cc1fb8a1-52b9-43ea-8f63-cae5a94c4d35 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:31 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ae302584-882d-4901-9f6f-b31eb61452fb tempest-VolumesGetTest-1635800146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3881117f-75b1-4197-9606-f0fbc9dc1b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08289272-d247-4ca3-97d6-712143ef4d3b', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:36:31 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ae302584-882d-4901-9f6f-b31eb61452fb tempest-VolumesGetTest-1635800146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f546720d-b215-4168-9dbc-51f839e63e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:36:31 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-ae302584-882d-4901-9f6f-b31eb61452fb tempest-VolumesGetTest-1635800146 None] Volume volume-08289272-d247-4ca3-97d6-712143ef4d3b (08289272-d247-4ca3-97d6-712143ef4d3b): created successfully Sep 28 09:36:31 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ae302584-882d-4901-9f6f-b31eb61452fb tempest-VolumesGetTest-1635800146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f546720d-b215-4168-9dbc-51f839e63e63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:36:31 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ae302584-882d-4901-9f6f-b31eb61452fb tempest-VolumesGetTest-1635800146 None] Flow 'volume_create_manager' (94fa77c9-da52-4c1a-94fc-81fff370e8a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:36:31 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-ae302584-882d-4901-9f6f-b31eb61452fb tempest-VolumesGetTest-1635800146 None] Created volume successfully. Sep 28 09:36:31 devstack sudo[103161]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:31 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-46ffb4d3-1275-41e8-a3f9-3c4bcec35f72 tempest-CreateVolumesFromSnapshotTest-1951497831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.371s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:31 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-46ffb4d3-1275-41e8-a3f9-3c4bcec35f72 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:36:31 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-46ffb4d3-1275-41e8-a3f9-3c4bcec35f72 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Deleted volume successfully. Sep 28 09:36:31 devstack sudo[103164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a9333397-e5e6-4da5-9e73-1da4b9b904eb.cc1fb8a1-52b9-43ea-8f63-cae5a94c4d35 Sep 28 09:36:31 devstack sudo[103164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:31 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-46ffb4d3-1275-41e8-a3f9-3c4bcec35f72 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Lock "cinder-55470911-773e-489a-9a2c-588bae208ad1-delete_volume" released by "delete_volume" :: held 1.518s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:36:32 devstack sudo[103164]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-13bda66e-023a-491e-8f36-88f859aa2774 tempest-CreateVolumesFromSnapshotTest-1951497831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a9333397-e5e6-4da5-9e73-1da4b9b904eb.cc1fb8a1-52b9-43ea-8f63-cae5a94c4d35" returned: 0 in 0.391s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:32 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-13bda66e-023a-491e-8f36-88f859aa2774 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a9333397-e5e6-4da5-9e73-1da4b9b904eb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86553) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 09:36:32 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d64d13-049e-467c-8c61-a515f72c35f8]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:36:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-13bda66e-023a-491e-8f36-88f859aa2774 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a9333397-e5e6-4da5-9e73-1da4b9b904eb {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:32 devstack sudo[103170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a9333397-e5e6-4da5-9e73-1da4b9b904eb Sep 28 09:36:32 devstack sudo[103170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:32 devstack sudo[103170]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-13bda66e-023a-491e-8f36-88f859aa2774 tempest-CreateVolumesFromSnapshotTest-1951497831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a9333397-e5e6-4da5-9e73-1da4b9b904eb" returned: 0 in 0.366s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-13bda66e-023a-491e-8f36-88f859aa2774 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a9333397-e5e6-4da5-9e73-1da4b9b904eb.cc1fb8a1-52b9-43ea-8f63-cae5a94c4d35 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:32 devstack sudo[103175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a9333397-e5e6-4da5-9e73-1da4b9b904eb.cc1fb8a1-52b9-43ea-8f63-cae5a94c4d35 Sep 28 09:36:32 devstack sudo[103175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:32 devstack sudo[103175]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-13bda66e-023a-491e-8f36-88f859aa2774 tempest-CreateVolumesFromSnapshotTest-1951497831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a9333397-e5e6-4da5-9e73-1da4b9b904eb.cc1fb8a1-52b9-43ea-8f63-cae5a94c4d35" returned: 0 in 0.422s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-13bda66e-023a-491e-8f36-88f859aa2774 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a9333397-e5e6-4da5-9e73-1da4b9b904eb.cc1fb8a1-52b9-43ea-8f63-cae5a94c4d35 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:33 devstack sudo[103184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a9333397-e5e6-4da5-9e73-1da4b9b904eb.cc1fb8a1-52b9-43ea-8f63-cae5a94c4d35 Sep 28 09:36:33 devstack sudo[103184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:33 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-e903b0d0-2b67-4749-8e6e-db5730e0f9d7 tempest-VolumesGetTest-1635800146 None] Acquiring lock "cinder-08289272-d247-4ca3-97d6-712143ef4d3b-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:36:33 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-e903b0d0-2b67-4749-8e6e-db5730e0f9d7 tempest-VolumesGetTest-1635800146 None] Lock "cinder-08289272-d247-4ca3-97d6-712143ef4d3b-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:36:33 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-e903b0d0-2b67-4749-8e6e-db5730e0f9d7 tempest-VolumesGetTest-1635800146 None] Acquiring lock "cinder-quobyte-08289272-d247-4ca3-97d6-712143ef4d3b" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:36:33 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-e903b0d0-2b67-4749-8e6e-db5730e0f9d7 tempest-VolumesGetTest-1635800146 None] Lock "cinder-quobyte-08289272-d247-4ca3-97d6-712143ef4d3b" acquired by "delete_volume" :: waited 0.014s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:36:33 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[c51421d9-56ce-457f-82c0-11bacdf59756]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:36:33 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e903b0d0-2b67-4749-8e6e-db5730e0f9d7 tempest-VolumesGetTest-1635800146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-08289272-d247-4ca3-97d6-712143ef4d3b {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:33 devstack sudo[103186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-08289272-d247-4ca3-97d6-712143ef4d3b Sep 28 09:36:33 devstack sudo[103186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:33 devstack sudo[103184]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:33 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-13bda66e-023a-491e-8f36-88f859aa2774 tempest-CreateVolumesFromSnapshotTest-1951497831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a9333397-e5e6-4da5-9e73-1da4b9b904eb.cc1fb8a1-52b9-43ea-8f63-cae5a94c4d35" returned: 0 in 0.356s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:33 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-13bda66e-023a-491e-8f36-88f859aa2774 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Lock "cinder-quobyte-cc1fb8a1-52b9-43ea-8f63-cae5a94c4d35" released by "_delete_snapshot" :: held 1.685s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:36:33 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-13bda66e-023a-491e-8f36-88f859aa2774 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Lock "cinder-quobyte-a9333397-e5e6-4da5-9e73-1da4b9b904eb" released by "delete_snapshot" :: held 1.717s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:36:33 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-13bda66e-023a-491e-8f36-88f859aa2774 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Created reservations ['5b01a667-1af5-4874-9b47-2d087d812981', '2ba5deb8-a49c-46ba-b29e-a923f50ba738', '3b5b7312-644d-4a5f-b9ca-a84b3258173d', 'da69616f-ac2a-4f44-beeb-f43aa20b325a'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:36:33 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-13bda66e-023a-491e-8f36-88f859aa2774 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Delete snapshot completed successfully. Sep 28 09:36:33 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-13bda66e-023a-491e-8f36-88f859aa2774 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Lock "cinder-cc1fb8a1-52b9-43ea-8f63-cae5a94c4d35-delete_snapshot" released by "delete_snapshot" :: held 1.886s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:36:33 devstack sudo[103186]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:33 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e903b0d0-2b67-4749-8e6e-db5730e0f9d7 tempest-VolumesGetTest-1635800146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-08289272-d247-4ca3-97d6-712143ef4d3b" returned: 0 in 0.399s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:33 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e903b0d0-2b67-4749-8e6e-db5730e0f9d7 tempest-VolumesGetTest-1635800146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-08289272-d247-4ca3-97d6-712143ef4d3b {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:33 devstack sudo[103192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-08289272-d247-4ca3-97d6-712143ef4d3b Sep 28 09:36:33 devstack sudo[103192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:33 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-de35b464-ff4a-4e80-abbf-ff62dd9eb8c1 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Acquiring lock "cinder-a9333397-e5e6-4da5-9e73-1da4b9b904eb-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:36:33 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-de35b464-ff4a-4e80-abbf-ff62dd9eb8c1 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Lock "cinder-a9333397-e5e6-4da5-9e73-1da4b9b904eb-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:36:33 devstack sudo[103192]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:33 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-de35b464-ff4a-4e80-abbf-ff62dd9eb8c1 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Acquiring lock "cinder-quobyte-a9333397-e5e6-4da5-9e73-1da4b9b904eb" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:36:33 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e903b0d0-2b67-4749-8e6e-db5730e0f9d7 tempest-VolumesGetTest-1635800146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-08289272-d247-4ca3-97d6-712143ef4d3b" returned: 0 in 0.288s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:33 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-e903b0d0-2b67-4749-8e6e-db5730e0f9d7 tempest-VolumesGetTest-1635800146 None] Lock "cinder-quobyte-08289272-d247-4ca3-97d6-712143ef4d3b" released by "delete_volume" :: held 0.742s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:36:33 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-de35b464-ff4a-4e80-abbf-ff62dd9eb8c1 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Lock "cinder-quobyte-a9333397-e5e6-4da5-9e73-1da4b9b904eb" acquired by "delete_volume" :: waited 0.034s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:36:33 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[89cd7012-800d-4b14-aeb0-499668b36ba1]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:36:33 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-de35b464-ff4a-4e80-abbf-ff62dd9eb8c1 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a9333397-e5e6-4da5-9e73-1da4b9b904eb {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:33 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-e903b0d0-2b67-4749-8e6e-db5730e0f9d7 tempest-VolumesGetTest-1635800146 None] Created reservations ['009c8569-76eb-4ebd-ad16-6537e2943bb2', 'dfc06df2-31b8-42eb-a00e-a9f9fc79796c', 'ec377ef2-0b32-4790-ad4d-6c2967fe15e2', '1a81a9f5-e1db-4270-a764-48172a44b77e'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:36:34 devstack sudo[103195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a9333397-e5e6-4da5-9e73-1da4b9b904eb Sep 28 09:36:34 devstack sudo[103195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:34 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-e903b0d0-2b67-4749-8e6e-db5730e0f9d7 tempest-VolumesGetTest-1635800146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:36:34 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-e903b0d0-2b67-4749-8e6e-db5730e0f9d7 tempest-VolumesGetTest-1635800146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:36:34 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-e903b0d0-2b67-4749-8e6e-db5730e0f9d7 tempest-VolumesGetTest-1635800146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:36:34 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-e903b0d0-2b67-4749-8e6e-db5730e0f9d7 tempest-VolumesGetTest-1635800146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:36:34 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-e903b0d0-2b67-4749-8e6e-db5730e0f9d7 tempest-VolumesGetTest-1635800146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.049s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:36:34 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e903b0d0-2b67-4749-8e6e-db5730e0f9d7 tempest-VolumesGetTest-1635800146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:34 devstack sudo[103197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:36:34 devstack sudo[103197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:34 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-a7a71e19-9b9e-4c5a-8da0-d9090b986e96 tempest-VolumesGetTest-1635800146 None] Acquiring lock "cinder-ca7a3780-e42a-42d0-bd8f-b23b489fd892-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:36:34 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-a7a71e19-9b9e-4c5a-8da0-d9090b986e96 tempest-VolumesGetTest-1635800146 None] Lock "cinder-ca7a3780-e42a-42d0-bd8f-b23b489fd892-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:36:34 devstack sudo[103195]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:34 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-de35b464-ff4a-4e80-abbf-ff62dd9eb8c1 tempest-CreateVolumesFromSnapshotTest-1951497831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a9333397-e5e6-4da5-9e73-1da4b9b904eb" returned: 0 in 0.689s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:34 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-de35b464-ff4a-4e80-abbf-ff62dd9eb8c1 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a9333397-e5e6-4da5-9e73-1da4b9b904eb {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:34 devstack sudo[103202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a9333397-e5e6-4da5-9e73-1da4b9b904eb Sep 28 09:36:34 devstack sudo[103202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:34 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-a7a71e19-9b9e-4c5a-8da0-d9090b986e96 tempest-VolumesGetTest-1635800146 None] Acquiring lock "cinder-quobyte-ca7a3780-e42a-42d0-bd8f-b23b489fd892" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:36:34 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-a7a71e19-9b9e-4c5a-8da0-d9090b986e96 tempest-VolumesGetTest-1635800146 None] Lock "cinder-quobyte-ca7a3780-e42a-42d0-bd8f-b23b489fd892" acquired by "delete_volume" :: waited 0.044s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:36:34 devstack sudo[103197]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:34 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e903b0d0-2b67-4749-8e6e-db5730e0f9d7 tempest-VolumesGetTest-1635800146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.604s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:34 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-e903b0d0-2b67-4749-8e6e-db5730e0f9d7 tempest-VolumesGetTest-1635800146 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:36:34 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-e903b0d0-2b67-4749-8e6e-db5730e0f9d7 tempest-VolumesGetTest-1635800146 None] Deleted volume successfully. Sep 28 09:36:34 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0fcbcc0-0510-4f25-bc18-3f1cd05a97f4]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:36:34 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a7a71e19-9b9e-4c5a-8da0-d9090b986e96 tempest-VolumesGetTest-1635800146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-ca7a3780-e42a-42d0-bd8f-b23b489fd892 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:34 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-e903b0d0-2b67-4749-8e6e-db5730e0f9d7 tempest-VolumesGetTest-1635800146 None] Lock "cinder-08289272-d247-4ca3-97d6-712143ef4d3b-delete_volume" released by "delete_volume" :: held 1.851s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:36:34 devstack sudo[103202]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:34 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-de35b464-ff4a-4e80-abbf-ff62dd9eb8c1 tempest-CreateVolumesFromSnapshotTest-1951497831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a9333397-e5e6-4da5-9e73-1da4b9b904eb" returned: 0 in 0.329s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:34 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-de35b464-ff4a-4e80-abbf-ff62dd9eb8c1 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Lock "cinder-quobyte-a9333397-e5e6-4da5-9e73-1da4b9b904eb" released by "delete_volume" :: held 1.097s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:36:35 devstack sudo[103206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-ca7a3780-e42a-42d0-bd8f-b23b489fd892 Sep 28 09:36:35 devstack sudo[103206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:35 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-de35b464-ff4a-4e80-abbf-ff62dd9eb8c1 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Created reservations ['d6dfa01f-36fa-4bd2-be60-3feae04b6a40', 'a48e2a58-4d20-4b4b-aba0-7b09764184f5', '68584104-13e2-40f1-9ca3-b47d9c7c1ad6', '10f617ed-e4ae-413d-bb7f-c176d2e6001c'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:36:35 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-de35b464-ff4a-4e80-abbf-ff62dd9eb8c1 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:36:35 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-de35b464-ff4a-4e80-abbf-ff62dd9eb8c1 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:36:35 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-de35b464-ff4a-4e80-abbf-ff62dd9eb8c1 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:36:35 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-de35b464-ff4a-4e80-abbf-ff62dd9eb8c1 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:36:35 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-de35b464-ff4a-4e80-abbf-ff62dd9eb8c1 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:36:35 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-de35b464-ff4a-4e80-abbf-ff62dd9eb8c1 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:35 devstack sudo[103215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:36:35 devstack sudo[103215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:35 devstack sudo[103206]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:35 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a7a71e19-9b9e-4c5a-8da0-d9090b986e96 tempest-VolumesGetTest-1635800146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-ca7a3780-e42a-42d0-bd8f-b23b489fd892" returned: 0 in 0.630s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:35 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a7a71e19-9b9e-4c5a-8da0-d9090b986e96 tempest-VolumesGetTest-1635800146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-ca7a3780-e42a-42d0-bd8f-b23b489fd892 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:35 devstack sudo[103225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-ca7a3780-e42a-42d0-bd8f-b23b489fd892 Sep 28 09:36:35 devstack sudo[103225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:35 devstack sudo[103215]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:35 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-de35b464-ff4a-4e80-abbf-ff62dd9eb8c1 tempest-CreateVolumesFromSnapshotTest-1951497831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.532s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:35 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-de35b464-ff4a-4e80-abbf-ff62dd9eb8c1 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:36:35 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-de35b464-ff4a-4e80-abbf-ff62dd9eb8c1 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Deleted volume successfully. Sep 28 09:36:35 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-de35b464-ff4a-4e80-abbf-ff62dd9eb8c1 tempest-CreateVolumesFromSnapshotTest-1951497831 None] Lock "cinder-a9333397-e5e6-4da5-9e73-1da4b9b904eb-delete_volume" released by "delete_volume" :: held 2.048s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:36:36 devstack sudo[103225]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:36 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a7a71e19-9b9e-4c5a-8da0-d9090b986e96 tempest-VolumesGetTest-1635800146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-ca7a3780-e42a-42d0-bd8f-b23b489fd892" returned: 0 in 0.551s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:36 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-a7a71e19-9b9e-4c5a-8da0-d9090b986e96 tempest-VolumesGetTest-1635800146 None] Lock "cinder-quobyte-ca7a3780-e42a-42d0-bd8f-b23b489fd892" released by "delete_volume" :: held 1.299s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:36:36 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-a7a71e19-9b9e-4c5a-8da0-d9090b986e96 tempest-VolumesGetTest-1635800146 None] Created reservations ['824dfa00-5243-4928-ad0b-ef884d897bb9', '5a1582a3-46d3-4935-ba5d-ee731e9113fc', '43e5b85a-a2ad-4736-802e-cd6174d0c2e0', 'a59970df-c686-44e6-a6fd-e6171825c843'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:36:36 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-a7a71e19-9b9e-4c5a-8da0-d9090b986e96 tempest-VolumesGetTest-1635800146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:36:36 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-a7a71e19-9b9e-4c5a-8da0-d9090b986e96 tempest-VolumesGetTest-1635800146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:36:36 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-a7a71e19-9b9e-4c5a-8da0-d9090b986e96 tempest-VolumesGetTest-1635800146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:36:36 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-a7a71e19-9b9e-4c5a-8da0-d9090b986e96 tempest-VolumesGetTest-1635800146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:36:36 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-a7a71e19-9b9e-4c5a-8da0-d9090b986e96 tempest-VolumesGetTest-1635800146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:36:36 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a7a71e19-9b9e-4c5a-8da0-d9090b986e96 tempest-VolumesGetTest-1635800146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:36 devstack sudo[103234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:36:36 devstack sudo[103234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:36 devstack sudo[103234]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:36 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a7a71e19-9b9e-4c5a-8da0-d9090b986e96 tempest-VolumesGetTest-1635800146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.333s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:36 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-a7a71e19-9b9e-4c5a-8da0-d9090b986e96 tempest-VolumesGetTest-1635800146 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:36:36 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-a7a71e19-9b9e-4c5a-8da0-d9090b986e96 tempest-VolumesGetTest-1635800146 None] Deleted volume successfully. Sep 28 09:36:36 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-a7a71e19-9b9e-4c5a-8da0-d9090b986e96 tempest-VolumesGetTest-1635800146 None] Lock "cinder-ca7a3780-e42a-42d0-bd8f-b23b489fd892-delete_volume" released by "delete_volume" :: held 2.003s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:36:41 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9508c28-02a7-41d5-a4c6-47dc16e63ec4 tempest-VolumeDependencyTests-942945816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:36:41 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-c9508c28-02a7-41d5-a4c6-47dc16e63ec4 tempest-VolumeDependencyTests-942945816 None] Flow 'volume_create_manager' (28014a9a-312b-47f6-a5c3-9ee7b7f7645d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:36:41 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-c9508c28-02a7-41d5-a4c6-47dc16e63ec4 tempest-VolumeDependencyTests-942945816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c74bd63-cdc5-41e1-ba57-721323d6936d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:36:41 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-c9508c28-02a7-41d5-a4c6-47dc16e63ec4 tempest-VolumeDependencyTests-942945816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c74bd63-cdc5-41e1-ba57-721323d6936d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:36:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1573956033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03603d40-abb2-4669-ad61-23bc83069112,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ee5dfd4778440f58b40d0ab3fe7019d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:36:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:36:41Z,use_quota=True,user_id='405e01184e2e4de18c45137214bd49b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:36:41 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-c9508c28-02a7-41d5-a4c6-47dc16e63ec4 tempest-VolumeDependencyTests-942945816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27730acd-d538-4ecb-ae5c-6338ccfea9ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:36:41 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-c9508c28-02a7-41d5-a4c6-47dc16e63ec4 tempest-VolumeDependencyTests-942945816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27730acd-d538-4ecb-ae5c-6338ccfea9ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:36:41 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-c9508c28-02a7-41d5-a4c6-47dc16e63ec4 tempest-VolumeDependencyTests-942945816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08d4602d-537e-4f54-b5be-c68bb52ddd7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:36:41 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-c9508c28-02a7-41d5-a4c6-47dc16e63ec4 tempest-VolumeDependencyTests-942945816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08d4602d-537e-4f54-b5be-c68bb52ddd7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03603d40-abb2-4669-ad61-23bc83069112', 'volume_name': 'volume-03603d40-abb2-4669-ad61-23bc83069112', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:36:41 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-c9508c28-02a7-41d5-a4c6-47dc16e63ec4 tempest-VolumeDependencyTests-942945816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb04b016-bf50-47b2-93df-cf6ea1c16e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:36:41 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-c9508c28-02a7-41d5-a4c6-47dc16e63ec4 tempest-VolumeDependencyTests-942945816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb04b016-bf50-47b2-93df-cf6ea1c16e99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:36:41 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-c9508c28-02a7-41d5-a4c6-47dc16e63ec4 tempest-VolumeDependencyTests-942945816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4eeec6c-9e0c-4d5c-a30c-1d0487d8d391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:36:41 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-c9508c28-02a7-41d5-a4c6-47dc16e63ec4 tempest-VolumeDependencyTests-942945816 None] Volume 03603d40-abb2-4669-ad61-23bc83069112: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03603d40-abb2-4669-ad61-23bc83069112', 'volume_size': 1} Sep 28 09:36:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-c9508c28-02a7-41d5-a4c6-47dc16e63ec4 tempest-VolumeDependencyTests-942945816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:36:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-c9508c28-02a7-41d5-a4c6-47dc16e63ec4 tempest-VolumeDependencyTests-942945816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:36:41 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-c9508c28-02a7-41d5-a4c6-47dc16e63ec4 tempest-VolumeDependencyTests-942945816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:36:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1573956033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03603d40-abb2-4669-ad61-23bc83069112,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ee5dfd4778440f58b40d0ab3fe7019d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:36:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:36:41Z,use_quota=True,user_id='405e01184e2e4de18c45137214bd49b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:36:41 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-c9508c28-02a7-41d5-a4c6-47dc16e63ec4 tempest-VolumeDependencyTests-942945816 None] Creating volume 03603d40-abb2-4669-ad61-23bc83069112 {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:36:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-c9508c28-02a7-41d5-a4c6-47dc16e63ec4 tempest-VolumeDependencyTests-942945816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:36:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-c9508c28-02a7-41d5-a4c6-47dc16e63ec4 tempest-VolumeDependencyTests-942945816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:36:41 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-c9508c28-02a7-41d5-a4c6-47dc16e63ec4 tempest-VolumeDependencyTests-942945816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:36:41 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-c9508c28-02a7-41d5-a4c6-47dc16e63ec4 tempest-VolumeDependencyTests-942945816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:36:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-c9508c28-02a7-41d5-a4c6-47dc16e63ec4 tempest-VolumeDependencyTests-942945816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:36:41 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-c9508c28-02a7-41d5-a4c6-47dc16e63ec4 tempest-VolumeDependencyTests-942945816 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:36:41 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-c9508c28-02a7-41d5-a4c6-47dc16e63ec4 tempest-VolumeDependencyTests-942945816 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:36:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c9508c28-02a7-41d5-a4c6-47dc16e63ec4 tempest-VolumeDependencyTests-942945816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-03603d40-abb2-4669-ad61-23bc83069112 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:41 devstack sudo[103339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-03603d40-abb2-4669-ad61-23bc83069112 1073741824 Sep 28 09:36:41 devstack sudo[103339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:42 devstack sudo[103339]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c9508c28-02a7-41d5-a4c6-47dc16e63ec4 tempest-VolumeDependencyTests-942945816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-03603d40-abb2-4669-ad61-23bc83069112 1073741824" returned: 0 in 1.093s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c9508c28-02a7-41d5-a4c6-47dc16e63ec4 tempest-VolumeDependencyTests-942945816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-03603d40-abb2-4669-ad61-23bc83069112 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:42 devstack sudo[103363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-03603d40-abb2-4669-ad61-23bc83069112 Sep 28 09:36:42 devstack sudo[103363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:42 devstack cinder-volume[86553]: INFO cinder.volume.manager [req-a183a3da-25b7-48a4-a715-97c8ef5e0308 req-2f4573e2-4f7b-4b43-8625-4ba1c20e8be9 tempest-TestShelveInstance-165027966 None] Terminate volume connection completed successfully. Sep 28 09:36:42 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [req-a183a3da-25b7-48a4-a715-97c8ef5e0308 req-2f4573e2-4f7b-4b43-8625-4ba1c20e8be9 tempest-TestShelveInstance-165027966 None] Deleting attachment d706afb6-9158-46fe-8ae7-d7f0ca6f5634. {{(pid=86553) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 09:36:43 devstack sudo[103363]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:43 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c9508c28-02a7-41d5-a4c6-47dc16e63ec4 tempest-VolumeDependencyTests-942945816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-03603d40-abb2-4669-ad61-23bc83069112" returned: 0 in 0.509s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:43 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-c9508c28-02a7-41d5-a4c6-47dc16e63ec4 tempest-VolumeDependencyTests-942945816 None] <== create_volume: return (1737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:36:43 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-c9508c28-02a7-41d5-a4c6-47dc16e63ec4 tempest-VolumeDependencyTests-942945816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.740s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:36:43 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-c9508c28-02a7-41d5-a4c6-47dc16e63ec4 tempest-VolumeDependencyTests-942945816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4eeec6c-9e0c-4d5c-a30c-1d0487d8d391) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03603d40-abb2-4669-ad61-23bc83069112', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:36:43 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-c9508c28-02a7-41d5-a4c6-47dc16e63ec4 tempest-VolumeDependencyTests-942945816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa711d2c-40ca-4749-8423-1b0d71ee8284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:36:43 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-c9508c28-02a7-41d5-a4c6-47dc16e63ec4 tempest-VolumeDependencyTests-942945816 None] Volume volume-03603d40-abb2-4669-ad61-23bc83069112 (03603d40-abb2-4669-ad61-23bc83069112): created successfully Sep 28 09:36:43 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-c9508c28-02a7-41d5-a4c6-47dc16e63ec4 tempest-VolumeDependencyTests-942945816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa711d2c-40ca-4749-8423-1b0d71ee8284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:36:43 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-c9508c28-02a7-41d5-a4c6-47dc16e63ec4 tempest-VolumeDependencyTests-942945816 None] Flow 'volume_create_manager' (28014a9a-312b-47f6-a5c3-9ee7b7f7645d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:36:43 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-c9508c28-02a7-41d5-a4c6-47dc16e63ec4 tempest-VolumeDependencyTests-942945816 None] Created volume successfully. Sep 28 09:36:44 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-a32b89cb-e49d-4615-8800-3806c398d74a tempest-VolumesSnapshotListTestJSON-454019371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:36:44 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-a32b89cb-e49d-4615-8800-3806c398d74a tempest-VolumesSnapshotListTestJSON-454019371 None] Flow 'volume_create_manager' (ebe06a7a-8942-4df7-84bb-0892f84ddac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:36:44 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-a32b89cb-e49d-4615-8800-3806c398d74a tempest-VolumesSnapshotListTestJSON-454019371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5efd5842-e64a-4373-9745-4deb08bd4ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:36:44 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-a32b89cb-e49d-4615-8800-3806c398d74a tempest-VolumesSnapshotListTestJSON-454019371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5efd5842-e64a-4373-9745-4deb08bd4ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:36:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1957251998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20681f0d-3f82-4bd0-841c-2b6ac4f29554,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddb18cf1970942a287144befe7af70b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:36:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:36:44Z,use_quota=True,user_id='775358e1dc894f9398d1efe8933bd15f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:36:44 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-a32b89cb-e49d-4615-8800-3806c398d74a tempest-VolumesSnapshotListTestJSON-454019371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (437c7547-7177-4003-ad36-f41f85f003ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:36:44 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-a32b89cb-e49d-4615-8800-3806c398d74a tempest-VolumesSnapshotListTestJSON-454019371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (437c7547-7177-4003-ad36-f41f85f003ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:36:44 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-a32b89cb-e49d-4615-8800-3806c398d74a tempest-VolumesSnapshotListTestJSON-454019371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba53275b-2f86-4934-859c-abdf941c7a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:36:44 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-a32b89cb-e49d-4615-8800-3806c398d74a tempest-VolumesSnapshotListTestJSON-454019371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba53275b-2f86-4934-859c-abdf941c7a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20681f0d-3f82-4bd0-841c-2b6ac4f29554', 'volume_name': 'volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:36:44 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-a32b89cb-e49d-4615-8800-3806c398d74a tempest-VolumesSnapshotListTestJSON-454019371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10e4ff54-6c0c-4060-b107-6c8c66597f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:36:44 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-a32b89cb-e49d-4615-8800-3806c398d74a tempest-VolumesSnapshotListTestJSON-454019371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10e4ff54-6c0c-4060-b107-6c8c66597f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:36:44 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-a32b89cb-e49d-4615-8800-3806c398d74a tempest-VolumesSnapshotListTestJSON-454019371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca0f3447-d53d-45a5-9d7f-105bbf2a254e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:36:44 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-a32b89cb-e49d-4615-8800-3806c398d74a tempest-VolumesSnapshotListTestJSON-454019371 None] Volume 20681f0d-3f82-4bd0-841c-2b6ac4f29554: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554', 'volume_size': 1} Sep 28 09:36:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-a32b89cb-e49d-4615-8800-3806c398d74a tempest-VolumesSnapshotListTestJSON-454019371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:36:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-a32b89cb-e49d-4615-8800-3806c398d74a tempest-VolumesSnapshotListTestJSON-454019371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:36:44 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-a32b89cb-e49d-4615-8800-3806c398d74a tempest-VolumesSnapshotListTestJSON-454019371 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:36:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1957251998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20681f0d-3f82-4bd0-841c-2b6ac4f29554,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddb18cf1970942a287144befe7af70b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:36:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:36:44Z,use_quota=True,user_id='775358e1dc894f9398d1efe8933bd15f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:36:44 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-a32b89cb-e49d-4615-8800-3806c398d74a tempest-VolumesSnapshotListTestJSON-454019371 None] Creating volume 20681f0d-3f82-4bd0-841c-2b6ac4f29554 {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:36:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-a32b89cb-e49d-4615-8800-3806c398d74a tempest-VolumesSnapshotListTestJSON-454019371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:36:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-a32b89cb-e49d-4615-8800-3806c398d74a tempest-VolumesSnapshotListTestJSON-454019371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:36:44 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-a32b89cb-e49d-4615-8800-3806c398d74a tempest-VolumesSnapshotListTestJSON-454019371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:36:44 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-a32b89cb-e49d-4615-8800-3806c398d74a tempest-VolumesSnapshotListTestJSON-454019371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:36:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-a32b89cb-e49d-4615-8800-3806c398d74a tempest-VolumesSnapshotListTestJSON-454019371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:36:44 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-a32b89cb-e49d-4615-8800-3806c398d74a tempest-VolumesSnapshotListTestJSON-454019371 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:36:44 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-a32b89cb-e49d-4615-8800-3806c398d74a tempest-VolumesSnapshotListTestJSON-454019371 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:36:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a32b89cb-e49d-4615-8800-3806c398d74a tempest-VolumesSnapshotListTestJSON-454019371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:44 devstack sudo[103368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554 1073741824 Sep 28 09:36:44 devstack sudo[103368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-093c5ab1-36fa-4ca4-b551-02cce61798ab tempest-VolumeDependencyTests-942945816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:36:45 devstack sudo[103368]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:45 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a32b89cb-e49d-4615-8800-3806c398d74a tempest-VolumesSnapshotListTestJSON-454019371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554 1073741824" returned: 0 in 0.700s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:45 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a32b89cb-e49d-4615-8800-3806c398d74a tempest-VolumesSnapshotListTestJSON-454019371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:45 devstack sudo[103376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554 Sep 28 09:36:45 devstack sudo[103376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:45 devstack sudo[103376]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:45 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a32b89cb-e49d-4615-8800-3806c398d74a tempest-VolumesSnapshotListTestJSON-454019371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554" returned: 0 in 0.397s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:45 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-a32b89cb-e49d-4615-8800-3806c398d74a tempest-VolumesSnapshotListTestJSON-454019371 None] <== create_volume: return (1178ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:36:45 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-a32b89cb-e49d-4615-8800-3806c398d74a tempest-VolumesSnapshotListTestJSON-454019371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.184s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:36:45 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-093c5ab1-36fa-4ca4-b551-02cce61798ab tempest-VolumeDependencyTests-942945816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.057s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:36:45 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-093c5ab1-36fa-4ca4-b551-02cce61798ab tempest-VolumeDependencyTests-942945816 None] Creating offline snapshot 003494ce-0aaf-47f7-9129-0373c219fd33 of volume 03603d40-abb2-4669-ad61-23bc83069112 {{(pid=86553) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 09:36:45 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-a32b89cb-e49d-4615-8800-3806c398d74a tempest-VolumesSnapshotListTestJSON-454019371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca0f3447-d53d-45a5-9d7f-105bbf2a254e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:36:45 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-a32b89cb-e49d-4615-8800-3806c398d74a tempest-VolumesSnapshotListTestJSON-454019371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a255c1f3-a5fa-4b5b-804a-53df2060b82d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:36:45 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ce6290-a80b-42f0-b7f1-47d2fc8e192a]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:36:45 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-093c5ab1-36fa-4ca4-b551-02cce61798ab tempest-VolumeDependencyTests-942945816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-03603d40-abb2-4669-ad61-23bc83069112 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:45 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-a32b89cb-e49d-4615-8800-3806c398d74a tempest-VolumesSnapshotListTestJSON-454019371 None] Volume volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554 (20681f0d-3f82-4bd0-841c-2b6ac4f29554): created successfully Sep 28 09:36:45 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-a32b89cb-e49d-4615-8800-3806c398d74a tempest-VolumesSnapshotListTestJSON-454019371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a255c1f3-a5fa-4b5b-804a-53df2060b82d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:36:45 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-a32b89cb-e49d-4615-8800-3806c398d74a tempest-VolumesSnapshotListTestJSON-454019371 None] Flow 'volume_create_manager' (ebe06a7a-8942-4df7-84bb-0892f84ddac1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:36:46 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-a32b89cb-e49d-4615-8800-3806c398d74a tempest-VolumesSnapshotListTestJSON-454019371 None] Created volume successfully. Sep 28 09:36:46 devstack sudo[103381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-03603d40-abb2-4669-ad61-23bc83069112 Sep 28 09:36:46 devstack sudo[103381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:46 devstack sudo[103381]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:46 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-093c5ab1-36fa-4ca4-b551-02cce61798ab tempest-VolumeDependencyTests-942945816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-03603d40-abb2-4669-ad61-23bc83069112" returned: 0 in 0.650s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:46 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-093c5ab1-36fa-4ca4-b551-02cce61798ab tempest-VolumeDependencyTests-942945816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-03603d40-abb2-4669-ad61-23bc83069112,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-03603d40-abb2-4669-ad61-23bc83069112.003494ce-0aaf-47f7-9129-0373c219fd33 1G {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:46 devstack sudo[103386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-03603d40-abb2-4669-ad61-23bc83069112,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-03603d40-abb2-4669-ad61-23bc83069112.003494ce-0aaf-47f7-9129-0373c219fd33 1G Sep 28 09:36:46 devstack sudo[103386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:46 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-d53a36c7-b3dd-4147-b753-3a16b2218f5c tempest-VolumesSnapshotListTestJSON-454019371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:36:47 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-24fd11ad-0aad-4543-8a07-442db59c4ba7 req-dda05dc6-21e4-4ffb-ab88-9505263f39fa tempest-TestShelveInstance-165027966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:36:47 devstack sudo[103386]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:47 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-093c5ab1-36fa-4ca4-b551-02cce61798ab tempest-VolumeDependencyTests-942945816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-03603d40-abb2-4669-ad61-23bc83069112,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-03603d40-abb2-4669-ad61-23bc83069112.003494ce-0aaf-47f7-9129-0373c219fd33 1G" returned: 0 in 0.538s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:47 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-093c5ab1-36fa-4ca4-b551-02cce61798ab tempest-VolumeDependencyTests-942945816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03603d40-abb2-4669-ad61-23bc83069112 -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-03603d40-abb2-4669-ad61-23bc83069112.003494ce-0aaf-47f7-9129-0373c219fd33 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:47 devstack sudo[103400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03603d40-abb2-4669-ad61-23bc83069112 -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-03603d40-abb2-4669-ad61-23bc83069112.003494ce-0aaf-47f7-9129-0373c219fd33 Sep 28 09:36:47 devstack sudo[103400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:47 devstack sudo[103400]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:47 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-093c5ab1-36fa-4ca4-b551-02cce61798ab tempest-VolumeDependencyTests-942945816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03603d40-abb2-4669-ad61-23bc83069112 -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-03603d40-abb2-4669-ad61-23bc83069112.003494ce-0aaf-47f7-9129-0373c219fd33" returned: 0 in 0.323s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:47 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-093c5ab1-36fa-4ca4-b551-02cce61798ab tempest-VolumeDependencyTests-942945816 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-03603d40-abb2-4669-ad61-23bc83069112.003494ce-0aaf-47f7-9129-0373c219fd33 is being set with open permissions: ugo+rw Sep 28 09:36:47 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-093c5ab1-36fa-4ca4-b551-02cce61798ab tempest-VolumeDependencyTests-942945816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-03603d40-abb2-4669-ad61-23bc83069112.003494ce-0aaf-47f7-9129-0373c219fd33 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:47 devstack sudo[103405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-03603d40-abb2-4669-ad61-23bc83069112.003494ce-0aaf-47f7-9129-0373c219fd33 Sep 28 09:36:47 devstack sudo[103405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:47 devstack sudo[103405]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:47 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-093c5ab1-36fa-4ca4-b551-02cce61798ab tempest-VolumeDependencyTests-942945816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-03603d40-abb2-4669-ad61-23bc83069112.003494ce-0aaf-47f7-9129-0373c219fd33" returned: 0 in 0.267s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:47 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-093c5ab1-36fa-4ca4-b551-02cce61798ab tempest-VolumeDependencyTests-942945816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-03603d40-abb2-4669-ad61-23bc83069112.info {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:47 devstack sudo[103408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-03603d40-abb2-4669-ad61-23bc83069112.info Sep 28 09:36:47 devstack sudo[103408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:48 devstack sudo[103408]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-093c5ab1-36fa-4ca4-b551-02cce61798ab tempest-VolumeDependencyTests-942945816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-03603d40-abb2-4669-ad61-23bc83069112.info" returned: 0 in 0.300s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:48 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-093c5ab1-36fa-4ca4-b551-02cce61798ab tempest-VolumeDependencyTests-942945816 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-03603d40-abb2-4669-ad61-23bc83069112.info is being set with open permissions: ugo+rw Sep 28 09:36:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-093c5ab1-36fa-4ca4-b551-02cce61798ab tempest-VolumeDependencyTests-942945816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-03603d40-abb2-4669-ad61-23bc83069112.info {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:48 devstack sudo[103412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-03603d40-abb2-4669-ad61-23bc83069112.info Sep 28 09:36:48 devstack sudo[103412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:48 devstack sudo[103412]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-093c5ab1-36fa-4ca4-b551-02cce61798ab tempest-VolumeDependencyTests-942945816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-03603d40-abb2-4669-ad61-23bc83069112.info" returned: 0 in 0.252s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-093c5ab1-36fa-4ca4-b551-02cce61798ab tempest-VolumeDependencyTests-942945816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.462s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:36:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-d53a36c7-b3dd-4147-b753-3a16b2218f5c tempest-VolumesSnapshotListTestJSON-454019371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.616s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:36:48 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-d53a36c7-b3dd-4147-b753-3a16b2218f5c tempest-VolumesSnapshotListTestJSON-454019371 None] Creating offline snapshot 988d9ba7-60b6-4466-bd36-e5915ff8ca17 of volume 20681f0d-3f82-4bd0-841c-2b6ac4f29554 {{(pid=86553) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 09:36:48 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-093c5ab1-36fa-4ca4-b551-02cce61798ab tempest-VolumeDependencyTests-942945816 None] Create snapshot completed successfully Sep 28 09:36:48 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf49bd8f-e3f4-4117-a432-697d52a313b6]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:36:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-d53a36c7-b3dd-4147-b753-3a16b2218f5c tempest-VolumesSnapshotListTestJSON-454019371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:48 devstack sudo[103415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554 Sep 28 09:36:48 devstack sudo[103415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:48 devstack sudo[103415]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-d53a36c7-b3dd-4147-b753-3a16b2218f5c tempest-VolumesSnapshotListTestJSON-454019371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554" returned: 0 in 0.396s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-d53a36c7-b3dd-4147-b753-3a16b2218f5c tempest-VolumesSnapshotListTestJSON-454019371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554.988d9ba7-60b6-4466-bd36-e5915ff8ca17 1G {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:48 devstack sudo[103420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554.988d9ba7-60b6-4466-bd36-e5915ff8ca17 1G Sep 28 09:36:48 devstack sudo[103420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:49 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b3a9340-1ab2-4b5e-ae97-1f4a41579b74 tempest-VolumeDependencyTests-942945816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:36:49 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-4b3a9340-1ab2-4b5e-ae97-1f4a41579b74 tempest-VolumeDependencyTests-942945816 None] Flow 'volume_create_manager' (6d624d45-ab02-4f2c-ac77-503b08d11f97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:36:49 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-4b3a9340-1ab2-4b5e-ae97-1f4a41579b74 tempest-VolumeDependencyTests-942945816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12c31843-cfcc-4fcf-bdab-edbfae09a2b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:36:49 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-4b3a9340-1ab2-4b5e-ae97-1f4a41579b74 tempest-VolumeDependencyTests-942945816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12c31843-cfcc-4fcf-bdab-edbfae09a2b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:36:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1543664497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57a389a8-5b8e-4f94-acf9-4d37f1275de1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ee5dfd4778440f58b40d0ab3fe7019d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:36:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=003494ce-0aaf-47f7-9129-0373c219fd33,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:36:49Z,use_quota=True,user_id='405e01184e2e4de18c45137214bd49b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:36:49 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-4b3a9340-1ab2-4b5e-ae97-1f4a41579b74 tempest-VolumeDependencyTests-942945816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7788e61e-bace-47cc-b58e-02f9edceab78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:36:49 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-4b3a9340-1ab2-4b5e-ae97-1f4a41579b74 tempest-VolumeDependencyTests-942945816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7788e61e-bace-47cc-b58e-02f9edceab78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:36:49 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-4b3a9340-1ab2-4b5e-ae97-1f4a41579b74 tempest-VolumeDependencyTests-942945816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (810c7530-41c7-46f3-aeb2-a18a77a0407f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:36:49 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-4b3a9340-1ab2-4b5e-ae97-1f4a41579b74 tempest-VolumeDependencyTests-942945816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (810c7530-41c7-46f3-aeb2-a18a77a0407f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '57a389a8-5b8e-4f94-acf9-4d37f1275de1', 'volume_name': 'volume-57a389a8-5b8e-4f94-acf9-4d37f1275de1', 'volume_size': 1, 'snapshot_id': '003494ce-0aaf-47f7-9129-0373c219fd33'}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:36:49 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-4b3a9340-1ab2-4b5e-ae97-1f4a41579b74 tempest-VolumeDependencyTests-942945816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cbfb90c-1777-4ded-ada0-c79065d4a2e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:36:49 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-4b3a9340-1ab2-4b5e-ae97-1f4a41579b74 tempest-VolumeDependencyTests-942945816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cbfb90c-1777-4ded-ada0-c79065d4a2e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:36:49 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-4b3a9340-1ab2-4b5e-ae97-1f4a41579b74 tempest-VolumeDependencyTests-942945816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfa1c01a-b171-4014-af03-21aed43c5ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:36:49 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-4b3a9340-1ab2-4b5e-ae97-1f4a41579b74 tempest-VolumeDependencyTests-942945816 None] Volume 57a389a8-5b8e-4f94-acf9-4d37f1275de1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-57a389a8-5b8e-4f94-acf9-4d37f1275de1', 'volume_size': 1, 'snapshot_id': '003494ce-0aaf-47f7-9129-0373c219fd33'} Sep 28 09:36:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-4b3a9340-1ab2-4b5e-ae97-1f4a41579b74 tempest-VolumeDependencyTests-942945816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:36:49 devstack sudo[103420]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-d53a36c7-b3dd-4147-b753-3a16b2218f5c tempest-VolumesSnapshotListTestJSON-454019371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554.988d9ba7-60b6-4466-bd36-e5915ff8ca17 1G" returned: 0 in 0.540s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-d53a36c7-b3dd-4147-b753-3a16b2218f5c tempest-VolumesSnapshotListTestJSON-454019371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554 -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554.988d9ba7-60b6-4466-bd36-e5915ff8ca17 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:49 devstack sudo[103426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554 -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554.988d9ba7-60b6-4466-bd36-e5915ff8ca17 Sep 28 09:36:49 devstack sudo[103426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:49 devstack sudo[103426]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-d53a36c7-b3dd-4147-b753-3a16b2218f5c tempest-VolumesSnapshotListTestJSON-454019371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554 -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554.988d9ba7-60b6-4466-bd36-e5915ff8ca17" returned: 0 in 0.303s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:49 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-d53a36c7-b3dd-4147-b753-3a16b2218f5c tempest-VolumesSnapshotListTestJSON-454019371 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554.988d9ba7-60b6-4466-bd36-e5915ff8ca17 is being set with open permissions: ugo+rw Sep 28 09:36:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-d53a36c7-b3dd-4147-b753-3a16b2218f5c tempest-VolumesSnapshotListTestJSON-454019371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554.988d9ba7-60b6-4466-bd36-e5915ff8ca17 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:49 devstack sudo[103431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554.988d9ba7-60b6-4466-bd36-e5915ff8ca17 Sep 28 09:36:49 devstack sudo[103431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:49 devstack sudo[103431]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-d53a36c7-b3dd-4147-b753-3a16b2218f5c tempest-VolumesSnapshotListTestJSON-454019371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554.988d9ba7-60b6-4466-bd36-e5915ff8ca17" returned: 0 in 0.263s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-d53a36c7-b3dd-4147-b753-3a16b2218f5c tempest-VolumesSnapshotListTestJSON-454019371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554.info {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:49 devstack sudo[103434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554.info Sep 28 09:36:49 devstack sudo[103434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:50 devstack sudo[103434]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-d53a36c7-b3dd-4147-b753-3a16b2218f5c tempest-VolumesSnapshotListTestJSON-454019371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554.info" returned: 0 in 0.277s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:50 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-d53a36c7-b3dd-4147-b753-3a16b2218f5c tempest-VolumesSnapshotListTestJSON-454019371 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554.info is being set with open permissions: ugo+rw Sep 28 09:36:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-d53a36c7-b3dd-4147-b753-3a16b2218f5c tempest-VolumesSnapshotListTestJSON-454019371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554.info {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:50 devstack sudo[103437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554.info Sep 28 09:36:50 devstack sudo[103437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:50 devstack sudo[103437]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-d53a36c7-b3dd-4147-b753-3a16b2218f5c tempest-VolumesSnapshotListTestJSON-454019371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554.info" returned: 0 in 0.273s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-d53a36c7-b3dd-4147-b753-3a16b2218f5c tempest-VolumesSnapshotListTestJSON-454019371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.165s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:36:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-24fd11ad-0aad-4543-8a07-442db59c4ba7 req-dda05dc6-21e4-4ffb-ab88-9505263f39fa tempest-TestShelveInstance-165027966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.458s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:36:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-24fd11ad-0aad-4543-8a07-442db59c4ba7 req-dda05dc6-21e4-4ffb-ab88-9505263f39fa tempest-TestShelveInstance-165027966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:36:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-4b3a9340-1ab2-4b5e-ae97-1f4a41579b74 tempest-VolumeDependencyTests-942945816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.243s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:36:50 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-4b3a9340-1ab2-4b5e-ae97-1f4a41579b74 tempest-VolumeDependencyTests-942945816 None] Acquiring lock "cinder-quobyte-003494ce-0aaf-47f7-9129-0373c219fd33-57a389a8-5b8e-4f94-acf9-4d37f1275de1" by "_create_volume_from_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:36:50 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-d53a36c7-b3dd-4147-b753-3a16b2218f5c tempest-VolumesSnapshotListTestJSON-454019371 None] Create snapshot completed successfully Sep 28 09:36:50 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-4b3a9340-1ab2-4b5e-ae97-1f4a41579b74 tempest-VolumeDependencyTests-942945816 None] Lock "cinder-quobyte-003494ce-0aaf-47f7-9129-0373c219fd33-57a389a8-5b8e-4f94-acf9-4d37f1275de1" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:36:50 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-4b3a9340-1ab2-4b5e-ae97-1f4a41579b74 tempest-VolumeDependencyTests-942945816 None] Creating volume 57a389a8-5b8e-4f94-acf9-4d37f1275de1 from snapshot 003494ce-0aaf-47f7-9129-0373c219fd33 {{(pid=86553) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 09:36:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-4b3a9340-1ab2-4b5e-ae97-1f4a41579b74 tempest-VolumeDependencyTests-942945816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:36:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-4b3a9340-1ab2-4b5e-ae97-1f4a41579b74 tempest-VolumeDependencyTests-942945816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:36:50 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-4b3a9340-1ab2-4b5e-ae97-1f4a41579b74 tempest-VolumeDependencyTests-942945816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:36:50 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-4b3a9340-1ab2-4b5e-ae97-1f4a41579b74 tempest-VolumeDependencyTests-942945816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:36:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-4b3a9340-1ab2-4b5e-ae97-1f4a41579b74 tempest-VolumeDependencyTests-942945816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:36:50 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-4b3a9340-1ab2-4b5e-ae97-1f4a41579b74 tempest-VolumeDependencyTests-942945816 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:36:50 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-4b3a9340-1ab2-4b5e-ae97-1f4a41579b74 tempest-VolumeDependencyTests-942945816 None] Acquiring lock "cinder-quobyte-57a389a8-5b8e-4f94-acf9-4d37f1275de1" by "_copy_volume_from_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:36:50 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-4b3a9340-1ab2-4b5e-ae97-1f4a41579b74 tempest-VolumeDependencyTests-942945816 None] Lock "cinder-quobyte-57a389a8-5b8e-4f94-acf9-4d37f1275de1" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:36:50 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-4b3a9340-1ab2-4b5e-ae97-1f4a41579b74 tempest-VolumeDependencyTests-942945816 None] snapshot: 003494ce-0aaf-47f7-9129-0373c219fd33, volume: 57a389a8-5b8e-4f94-acf9-4d37f1275de1, {{(pid=86553) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 09:36:50 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [req-24fd11ad-0aad-4543-8a07-442db59c4ba7 req-dda05dc6-21e4-4ffb-ab88-9505263f39fa tempest-TestShelveInstance-165027966 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d', 'name': 'volume-57d3d311-43fc-4c70-b1dd-0cf01f63a115', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5cba5bde-dc76-4fdd-ab3e-76768220c64c', 'enforce_multipath': True} {{(pid=86553) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 09:36:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-4b3a9340-1ab2-4b5e-ae97-1f4a41579b74 tempest-VolumeDependencyTests-942945816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:36:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-4b3a9340-1ab2-4b5e-ae97-1f4a41579b74 tempest-VolumeDependencyTests-942945816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:36:50 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-4b3a9340-1ab2-4b5e-ae97-1f4a41579b74 tempest-VolumeDependencyTests-942945816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:36:50 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-4b3a9340-1ab2-4b5e-ae97-1f4a41579b74 tempest-VolumeDependencyTests-942945816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:36:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-4b3a9340-1ab2-4b5e-ae97-1f4a41579b74 tempest-VolumeDependencyTests-942945816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:36:50 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[964aa191-e24a-43ec-b45c-f50a2487d68f]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:36:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-4b3a9340-1ab2-4b5e-ae97-1f4a41579b74 tempest-VolumeDependencyTests-942945816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-03603d40-abb2-4669-ad61-23bc83069112.003494ce-0aaf-47f7-9129-0373c219fd33 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:50 devstack cinder-volume[86553]: INFO cinder.volume.manager [req-24fd11ad-0aad-4543-8a07-442db59c4ba7 req-dda05dc6-21e4-4ffb-ab88-9505263f39fa tempest-TestShelveInstance-165027966 None] attachment_update completed successfully. Sep 28 09:36:50 devstack sudo[103440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-03603d40-abb2-4669-ad61-23bc83069112.003494ce-0aaf-47f7-9129-0373c219fd33 Sep 28 09:36:50 devstack sudo[103440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:51 devstack sudo[103440]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:51 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-4b3a9340-1ab2-4b5e-ae97-1f4a41579b74 tempest-VolumeDependencyTests-942945816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-03603d40-abb2-4669-ad61-23bc83069112.003494ce-0aaf-47f7-9129-0373c219fd33" returned: 0 in 0.507s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:51 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-4b3a9340-1ab2-4b5e-ae97-1f4a41579b74 tempest-VolumeDependencyTests-942945816 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-03603d40-abb2-4669-ad61-23bc83069112(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86553) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 09:36:51 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d19a84a-df95-40ad-8c4d-8c4cc1ace336]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:36:51 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-4b3a9340-1ab2-4b5e-ae97-1f4a41579b74 tempest-VolumeDependencyTests-942945816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-03603d40-abb2-4669-ad61-23bc83069112 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:51 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-bcb65ecb-3d24-45b4-b335-c6f02700fce1 tempest-VolumesSnapshotListTestJSON-454019371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:36:51 devstack sudo[103445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-03603d40-abb2-4669-ad61-23bc83069112 Sep 28 09:36:51 devstack sudo[103445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:36:51 devstack sudo[103445]: pam_unix(sudo:session): session closed for user root Sep 28 09:36:51 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-4b3a9340-1ab2-4b5e-ae97-1f4a41579b74 tempest-VolumeDependencyTests-942945816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-03603d40-abb2-4669-ad61-23bc83069112" returned: 0 in 0.522s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:36:51 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-4b3a9340-1ab2-4b5e-ae97-1f4a41579b74 tempest-VolumeDependencyTests-942945816 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-03603d40-abb2-4669-ad61-23bc83069112 {{(pid=86553) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 09:36:51 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-4b3a9340-1ab2-4b5e-ae97-1f4a41579b74 tempest-VolumeDependencyTests-942945816 None] Creating direct copy from snapshot {{(pid=86553) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 09:36:51 devstack cinder-volume[86553]: DEBUG cinder.utils [None req-4b3a9340-1ab2-4b5e-ae97-1f4a41579b74 tempest-VolumeDependencyTests-942945816 None] Path /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-57a389a8-5b8e-4f94-acf9-4d37f1275de1 not found in is_blk_device check {{(pid=86553) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 09:36:51 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-4b3a9340-1ab2-4b5e-ae97-1f4a41579b74 tempest-VolumeDependencyTests-942945816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-03603d40-abb2-4669-ad61-23bc83069112 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-57a389a8-5b8e-4f94-acf9-4d37f1275de1 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:36:51 devstack sudo[103450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-03603d40-abb2-4669-ad61-23bc83069112 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-57a389a8-5b8e-4f94-acf9-4d37f1275de1 Sep 28 09:36:51 devstack sudo[103450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:37:00 devstack sudo[103450]: pam_unix(sudo:session): session closed for user root Sep 28 09:37:00 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-4b3a9340-1ab2-4b5e-ae97-1f4a41579b74 tempest-VolumeDependencyTests-942945816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-03603d40-abb2-4669-ad61-23bc83069112 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-57a389a8-5b8e-4f94-acf9-4d37f1275de1" returned: 0 in 8.930s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:37:00 devstack cinder-volume[86553]: DEBUG cinder.image.image_utils [None req-4b3a9340-1ab2-4b5e-ae97-1f4a41579b74 tempest-VolumeDependencyTests-942945816 None] Image conversion details: src /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-03603d40-abb2-4669-ad61-23bc83069112, size 1024.00 MB, duration 8.93 sec, destination /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-57a389a8-5b8e-4f94-acf9-4d37f1275de1 {{(pid=86553) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 09:37:00 devstack cinder-volume[86553]: INFO cinder.image.image_utils [None req-4b3a9340-1ab2-4b5e-ae97-1f4a41579b74 tempest-VolumeDependencyTests-942945816 None] Converted 1024.00 MB image at 114.66 MB/s Sep 28 09:37:00 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-4b3a9340-1ab2-4b5e-ae97-1f4a41579b74 tempest-VolumeDependencyTests-942945816 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-57a389a8-5b8e-4f94-acf9-4d37f1275de1 is being set with open permissions: ugo+rw Sep 28 09:37:00 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-4b3a9340-1ab2-4b5e-ae97-1f4a41579b74 tempest-VolumeDependencyTests-942945816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-57a389a8-5b8e-4f94-acf9-4d37f1275de1 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:37:00 devstack sudo[103975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-57a389a8-5b8e-4f94-acf9-4d37f1275de1 Sep 28 09:37:00 devstack sudo[103975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:37:00 devstack sudo[103975]: pam_unix(sudo:session): session closed for user root Sep 28 09:37:00 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-4b3a9340-1ab2-4b5e-ae97-1f4a41579b74 tempest-VolumeDependencyTests-942945816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-57a389a8-5b8e-4f94-acf9-4d37f1275de1" returned: 0 in 0.254s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:37:00 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-4b3a9340-1ab2-4b5e-ae97-1f4a41579b74 tempest-VolumeDependencyTests-942945816 None] Lock "cinder-quobyte-57a389a8-5b8e-4f94-acf9-4d37f1275de1" released by "_copy_volume_from_snapshot" :: held 10.323s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:37:00 devstack cinder-volume[86553]: DEBUG dbcounter [-] [86553] Writing DB stats cinder:UPDATE=158,cinder:SELECT=117,cinder:DELETE=15,cinder:INSERT=38 {{(pid=86553) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 09:37:00 devstack cinder-volume[86553]: DEBUG dbcounter [-] [86553] Writing DB stats cinder:UPDATE=135,cinder:SELECT=126,cinder:INSERT=40,cinder:DELETE=13 {{(pid=86553) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 09:37:00 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-4b3a9340-1ab2-4b5e-ae97-1f4a41579b74 tempest-VolumeDependencyTests-942945816 None] Lock "cinder-quobyte-003494ce-0aaf-47f7-9129-0373c219fd33-57a389a8-5b8e-4f94-acf9-4d37f1275de1" released by "_create_volume_from_snapshot" :: held 10.422s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:37:00 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-4b3a9340-1ab2-4b5e-ae97-1f4a41579b74 tempest-VolumeDependencyTests-942945816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.458s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:37:00 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-bcb65ecb-3d24-45b4-b335-c6f02700fce1 tempest-VolumesSnapshotListTestJSON-454019371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.618s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:37:00 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-bcb65ecb-3d24-45b4-b335-c6f02700fce1 tempest-VolumesSnapshotListTestJSON-454019371 None] Creating offline snapshot da5775fa-5f00-45fd-8152-2c4b6ffb2f23 of volume 20681f0d-3f82-4bd0-841c-2b6ac4f29554 {{(pid=86553) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 09:37:01 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-4b3a9340-1ab2-4b5e-ae97-1f4a41579b74 tempest-VolumeDependencyTests-942945816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfa1c01a-b171-4014-af03-21aed43c5ec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57a389a8-5b8e-4f94-acf9-4d37f1275de1', 'volume_size': 1, 'snapshot_id': '003494ce-0aaf-47f7-9129-0373c219fd33'}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:37:01 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-4b3a9340-1ab2-4b5e-ae97-1f4a41579b74 tempest-VolumeDependencyTests-942945816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (726bc1b2-723f-4665-b2aa-4904c2eb124d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:37:01 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a50aaf4-ed92-4f97-bf96-c03567e40831]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:37:01 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-bcb65ecb-3d24-45b4-b335-c6f02700fce1 tempest-VolumesSnapshotListTestJSON-454019371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554.988d9ba7-60b6-4466-bd36-e5915ff8ca17 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:37:01 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-4b3a9340-1ab2-4b5e-ae97-1f4a41579b74 tempest-VolumeDependencyTests-942945816 None] Volume volume-57a389a8-5b8e-4f94-acf9-4d37f1275de1 (57a389a8-5b8e-4f94-acf9-4d37f1275de1): created successfully Sep 28 09:37:01 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-4b3a9340-1ab2-4b5e-ae97-1f4a41579b74 tempest-VolumeDependencyTests-942945816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (726bc1b2-723f-4665-b2aa-4904c2eb124d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:37:01 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-4b3a9340-1ab2-4b5e-ae97-1f4a41579b74 tempest-VolumeDependencyTests-942945816 None] Flow 'volume_create_manager' (6d624d45-ab02-4f2c-ac77-503b08d11f97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:37:01 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-4b3a9340-1ab2-4b5e-ae97-1f4a41579b74 tempest-VolumeDependencyTests-942945816 None] Created volume successfully. Sep 28 09:37:01 devstack sudo[103978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554.988d9ba7-60b6-4466-bd36-e5915ff8ca17 Sep 28 09:37:01 devstack sudo[103978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:37:01 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-a96d3557-1169-4d0b-9ac9-0e521a427841 tempest-VolumeDependencyTests-942945816 None] Acquiring lock "cinder-003494ce-0aaf-47f7-9129-0373c219fd33-delete_snapshot" by "delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:37:01 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-a96d3557-1169-4d0b-9ac9-0e521a427841 tempest-VolumeDependencyTests-942945816 None] Lock "cinder-003494ce-0aaf-47f7-9129-0373c219fd33-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:37:01 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-a96d3557-1169-4d0b-9ac9-0e521a427841 tempest-VolumeDependencyTests-942945816 None] Acquiring lock "cinder-quobyte-03603d40-abb2-4669-ad61-23bc83069112" by "delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:37:01 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-a96d3557-1169-4d0b-9ac9-0e521a427841 tempest-VolumeDependencyTests-942945816 None] Lock "cinder-quobyte-03603d40-abb2-4669-ad61-23bc83069112" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:37:01 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-a96d3557-1169-4d0b-9ac9-0e521a427841 tempest-VolumeDependencyTests-942945816 None] Acquiring lock "cinder-quobyte-003494ce-0aaf-47f7-9129-0373c219fd33" by "_delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:37:01 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-a96d3557-1169-4d0b-9ac9-0e521a427841 tempest-VolumeDependencyTests-942945816 None] Lock "cinder-quobyte-003494ce-0aaf-47f7-9129-0373c219fd33" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:37:01 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-a96d3557-1169-4d0b-9ac9-0e521a427841 tempest-VolumeDependencyTests-942945816 None] Deleting offline snapshot 003494ce-0aaf-47f7-9129-0373c219fd33 of volume 03603d40-abb2-4669-ad61-23bc83069112 {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 09:37:01 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-a96d3557-1169-4d0b-9ac9-0e521a427841 tempest-VolumeDependencyTests-942945816 None] snapshot_file for this snap is: volume-03603d40-abb2-4669-ad61-23bc83069112.003494ce-0aaf-47f7-9129-0373c219fd33 {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 09:37:01 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f98a90-f534-4346-a750-1319e21b2621]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:37:01 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a96d3557-1169-4d0b-9ac9-0e521a427841 tempest-VolumeDependencyTests-942945816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-03603d40-abb2-4669-ad61-23bc83069112.003494ce-0aaf-47f7-9129-0373c219fd33 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:37:01 devstack sudo[103978]: pam_unix(sudo:session): session closed for user root Sep 28 09:37:01 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-bcb65ecb-3d24-45b4-b335-c6f02700fce1 tempest-VolumesSnapshotListTestJSON-454019371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554.988d9ba7-60b6-4466-bd36-e5915ff8ca17" returned: 0 in 0.651s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:37:01 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-bcb65ecb-3d24-45b4-b335-c6f02700fce1 tempest-VolumesSnapshotListTestJSON-454019371 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86553) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 09:37:01 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-bcb65ecb-3d24-45b4-b335-c6f02700fce1 tempest-VolumesSnapshotListTestJSON-454019371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554.988d9ba7-60b6-4466-bd36-e5915ff8ca17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554.da5775fa-5f00-45fd-8152-2c4b6ffb2f23 1G {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:37:01 devstack sudo[103986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554.988d9ba7-60b6-4466-bd36-e5915ff8ca17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554.da5775fa-5f00-45fd-8152-2c4b6ffb2f23 1G Sep 28 09:37:01 devstack sudo[103982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-03603d40-abb2-4669-ad61-23bc83069112.003494ce-0aaf-47f7-9129-0373c219fd33 Sep 28 09:37:01 devstack sudo[103982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:37:01 devstack sudo[103986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:37:02 devstack sudo[103982]: pam_unix(sudo:session): session closed for user root Sep 28 09:37:02 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a96d3557-1169-4d0b-9ac9-0e521a427841 tempest-VolumeDependencyTests-942945816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-03603d40-abb2-4669-ad61-23bc83069112.003494ce-0aaf-47f7-9129-0373c219fd33" returned: 0 in 0.611s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:37:02 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-a96d3557-1169-4d0b-9ac9-0e521a427841 tempest-VolumeDependencyTests-942945816 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-03603d40-abb2-4669-ad61-23bc83069112(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86553) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 09:37:02 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[357da1e2-50e6-455f-9667-00c454d75bf9]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:37:02 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a96d3557-1169-4d0b-9ac9-0e521a427841 tempest-VolumeDependencyTests-942945816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-03603d40-abb2-4669-ad61-23bc83069112 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:37:02 devstack sudo[103986]: pam_unix(sudo:session): session closed for user root Sep 28 09:37:02 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-bcb65ecb-3d24-45b4-b335-c6f02700fce1 tempest-VolumesSnapshotListTestJSON-454019371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554.988d9ba7-60b6-4466-bd36-e5915ff8ca17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554.da5775fa-5f00-45fd-8152-2c4b6ffb2f23 1G" returned: 0 in 0.616s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:37:02 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-bcb65ecb-3d24-45b4-b335-c6f02700fce1 tempest-VolumesSnapshotListTestJSON-454019371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554.988d9ba7-60b6-4466-bd36-e5915ff8ca17 -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554.da5775fa-5f00-45fd-8152-2c4b6ffb2f23 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:37:02 devstack sudo[103996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-03603d40-abb2-4669-ad61-23bc83069112 Sep 28 09:37:02 devstack sudo[103996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:37:02 devstack sudo[103998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554.988d9ba7-60b6-4466-bd36-e5915ff8ca17 -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554.da5775fa-5f00-45fd-8152-2c4b6ffb2f23 Sep 28 09:37:02 devstack sudo[103998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:37:02 devstack sudo[103998]: pam_unix(sudo:session): session closed for user root Sep 28 09:37:02 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-bcb65ecb-3d24-45b4-b335-c6f02700fce1 tempest-VolumesSnapshotListTestJSON-454019371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554.988d9ba7-60b6-4466-bd36-e5915ff8ca17 -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554.da5775fa-5f00-45fd-8152-2c4b6ffb2f23" returned: 0 in 0.372s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:37:02 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-bcb65ecb-3d24-45b4-b335-c6f02700fce1 tempest-VolumesSnapshotListTestJSON-454019371 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554.da5775fa-5f00-45fd-8152-2c4b6ffb2f23 is being set with open permissions: ugo+rw Sep 28 09:37:02 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-bcb65ecb-3d24-45b4-b335-c6f02700fce1 tempest-VolumesSnapshotListTestJSON-454019371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554.da5775fa-5f00-45fd-8152-2c4b6ffb2f23 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:37:02 devstack sudo[104007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554.da5775fa-5f00-45fd-8152-2c4b6ffb2f23 Sep 28 09:37:02 devstack sudo[104007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:37:02 devstack sudo[103996]: pam_unix(sudo:session): session closed for user root Sep 28 09:37:02 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a96d3557-1169-4d0b-9ac9-0e521a427841 tempest-VolumeDependencyTests-942945816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-03603d40-abb2-4669-ad61-23bc83069112" returned: 0 in 0.689s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:37:02 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a96d3557-1169-4d0b-9ac9-0e521a427841 tempest-VolumeDependencyTests-942945816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-03603d40-abb2-4669-ad61-23bc83069112.003494ce-0aaf-47f7-9129-0373c219fd33 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:37:02 devstack sudo[104010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-03603d40-abb2-4669-ad61-23bc83069112.003494ce-0aaf-47f7-9129-0373c219fd33 Sep 28 09:37:02 devstack sudo[104010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:37:02 devstack sudo[104007]: pam_unix(sudo:session): session closed for user root Sep 28 09:37:02 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-bcb65ecb-3d24-45b4-b335-c6f02700fce1 tempest-VolumesSnapshotListTestJSON-454019371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554.da5775fa-5f00-45fd-8152-2c4b6ffb2f23" returned: 0 in 0.266s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:37:03 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-bcb65ecb-3d24-45b4-b335-c6f02700fce1 tempest-VolumesSnapshotListTestJSON-454019371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.048s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:37:03 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-bcb65ecb-3d24-45b4-b335-c6f02700fce1 tempest-VolumesSnapshotListTestJSON-454019371 None] Create snapshot completed successfully Sep 28 09:37:03 devstack sudo[104010]: pam_unix(sudo:session): session closed for user root Sep 28 09:37:03 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a96d3557-1169-4d0b-9ac9-0e521a427841 tempest-VolumeDependencyTests-942945816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-03603d40-abb2-4669-ad61-23bc83069112.003494ce-0aaf-47f7-9129-0373c219fd33" returned: 0 in 0.401s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:37:03 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a96d3557-1169-4d0b-9ac9-0e521a427841 tempest-VolumeDependencyTests-942945816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-03603d40-abb2-4669-ad61-23bc83069112.003494ce-0aaf-47f7-9129-0373c219fd33 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:37:03 devstack sudo[104017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-03603d40-abb2-4669-ad61-23bc83069112.003494ce-0aaf-47f7-9129-0373c219fd33 Sep 28 09:37:03 devstack sudo[104017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:37:03 devstack sudo[104017]: pam_unix(sudo:session): session closed for user root Sep 28 09:37:03 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a96d3557-1169-4d0b-9ac9-0e521a427841 tempest-VolumeDependencyTests-942945816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-03603d40-abb2-4669-ad61-23bc83069112.003494ce-0aaf-47f7-9129-0373c219fd33" returned: 0 in 0.307s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:37:03 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-a96d3557-1169-4d0b-9ac9-0e521a427841 tempest-VolumeDependencyTests-942945816 None] Lock "cinder-quobyte-003494ce-0aaf-47f7-9129-0373c219fd33" released by "_delete_snapshot" :: held 2.184s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:37:03 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-a96d3557-1169-4d0b-9ac9-0e521a427841 tempest-VolumeDependencyTests-942945816 None] Lock "cinder-quobyte-03603d40-abb2-4669-ad61-23bc83069112" released by "delete_snapshot" :: held 2.224s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:37:03 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-a96d3557-1169-4d0b-9ac9-0e521a427841 tempest-VolumeDependencyTests-942945816 None] Created reservations ['f98187ac-87b4-4d5f-b4ae-b96c2b1565ed', 'd493cf72-ba4c-4c84-8c41-e1ab508246cd', 'bd557220-653c-4841-9d7d-5d41265dd33a', 'fcb6dfea-7844-4620-a191-82140a5772ed'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:37:03 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-a96d3557-1169-4d0b-9ac9-0e521a427841 tempest-VolumeDependencyTests-942945816 None] Delete snapshot completed successfully. Sep 28 09:37:03 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-a96d3557-1169-4d0b-9ac9-0e521a427841 tempest-VolumeDependencyTests-942945816 None] Lock "cinder-003494ce-0aaf-47f7-9129-0373c219fd33-delete_snapshot" released by "delete_snapshot" :: held 2.405s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:37:04 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-9c6b7baf-69c4-4986-8ff8-0465971b463f tempest-VolumesSnapshotListTestJSON-454019371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:37:04 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-9c6b7baf-69c4-4986-8ff8-0465971b463f tempest-VolumesSnapshotListTestJSON-454019371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:37:04 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-9c6b7baf-69c4-4986-8ff8-0465971b463f tempest-VolumesSnapshotListTestJSON-454019371 None] Creating offline snapshot c7095c98-6619-49cd-9948-9342da35a437 of volume 20681f0d-3f82-4bd0-841c-2b6ac4f29554 {{(pid=86553) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 09:37:04 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae77f7a8-59d1-4760-b307-a428978158bb]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:37:04 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-9c6b7baf-69c4-4986-8ff8-0465971b463f tempest-VolumesSnapshotListTestJSON-454019371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554.da5775fa-5f00-45fd-8152-2c4b6ffb2f23 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:37:04 devstack sudo[104021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554.da5775fa-5f00-45fd-8152-2c4b6ffb2f23 Sep 28 09:37:04 devstack sudo[104021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:37:04 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-27f340e3-05ef-481f-996f-4e538d459f1d tempest-VolumeDependencyTests-942945816 None] Acquiring lock "cinder-03603d40-abb2-4669-ad61-23bc83069112-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:37:04 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-27f340e3-05ef-481f-996f-4e538d459f1d tempest-VolumeDependencyTests-942945816 None] Lock "cinder-03603d40-abb2-4669-ad61-23bc83069112-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:37:04 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-27f340e3-05ef-481f-996f-4e538d459f1d tempest-VolumeDependencyTests-942945816 None] Acquiring lock "cinder-quobyte-03603d40-abb2-4669-ad61-23bc83069112" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:37:04 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-27f340e3-05ef-481f-996f-4e538d459f1d tempest-VolumeDependencyTests-942945816 None] Lock "cinder-quobyte-03603d40-abb2-4669-ad61-23bc83069112" acquired by "delete_volume" :: waited 0.029s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:37:04 devstack sudo[104021]: pam_unix(sudo:session): session closed for user root Sep 28 09:37:04 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-9c6b7baf-69c4-4986-8ff8-0465971b463f tempest-VolumesSnapshotListTestJSON-454019371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554.da5775fa-5f00-45fd-8152-2c4b6ffb2f23" returned: 0 in 0.478s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:37:04 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-9c6b7baf-69c4-4986-8ff8-0465971b463f tempest-VolumesSnapshotListTestJSON-454019371 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86553) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 09:37:04 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-9c6b7baf-69c4-4986-8ff8-0465971b463f tempest-VolumesSnapshotListTestJSON-454019371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554.da5775fa-5f00-45fd-8152-2c4b6ffb2f23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554.c7095c98-6619-49cd-9948-9342da35a437 1G {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:37:04 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[df2eb37c-5c20-4a81-b2fa-98d4db906392]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:37:04 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-27f340e3-05ef-481f-996f-4e538d459f1d tempest-VolumeDependencyTests-942945816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-03603d40-abb2-4669-ad61-23bc83069112 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:37:04 devstack sudo[104028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554.da5775fa-5f00-45fd-8152-2c4b6ffb2f23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554.c7095c98-6619-49cd-9948-9342da35a437 1G Sep 28 09:37:04 devstack sudo[104028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:37:05 devstack sudo[104029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-03603d40-abb2-4669-ad61-23bc83069112 Sep 28 09:37:05 devstack sudo[104029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:37:05 devstack sudo[104029]: pam_unix(sudo:session): session closed for user root Sep 28 09:37:05 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-27f340e3-05ef-481f-996f-4e538d459f1d tempest-VolumeDependencyTests-942945816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-03603d40-abb2-4669-ad61-23bc83069112" returned: 0 in 0.533s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:37:05 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-27f340e3-05ef-481f-996f-4e538d459f1d tempest-VolumeDependencyTests-942945816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-03603d40-abb2-4669-ad61-23bc83069112 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:37:05 devstack sudo[104039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-03603d40-abb2-4669-ad61-23bc83069112 Sep 28 09:37:05 devstack sudo[104039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:37:05 devstack sudo[104028]: pam_unix(sudo:session): session closed for user root Sep 28 09:37:05 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-9c6b7baf-69c4-4986-8ff8-0465971b463f tempest-VolumesSnapshotListTestJSON-454019371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554.da5775fa-5f00-45fd-8152-2c4b6ffb2f23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554.c7095c98-6619-49cd-9948-9342da35a437 1G" returned: 0 in 0.686s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:37:05 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-9c6b7baf-69c4-4986-8ff8-0465971b463f tempest-VolumesSnapshotListTestJSON-454019371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554.da5775fa-5f00-45fd-8152-2c4b6ffb2f23 -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554.c7095c98-6619-49cd-9948-9342da35a437 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:37:05 devstack sudo[104041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554.da5775fa-5f00-45fd-8152-2c4b6ffb2f23 -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554.c7095c98-6619-49cd-9948-9342da35a437 Sep 28 09:37:05 devstack sudo[104041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:37:05 devstack sudo[104039]: pam_unix(sudo:session): session closed for user root Sep 28 09:37:05 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-27f340e3-05ef-481f-996f-4e538d459f1d tempest-VolumeDependencyTests-942945816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-03603d40-abb2-4669-ad61-23bc83069112" returned: 0 in 0.327s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:37:05 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-27f340e3-05ef-481f-996f-4e538d459f1d tempest-VolumeDependencyTests-942945816 None] Lock "cinder-quobyte-03603d40-abb2-4669-ad61-23bc83069112" released by "delete_volume" :: held 0.972s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:37:05 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-27f340e3-05ef-481f-996f-4e538d459f1d tempest-VolumeDependencyTests-942945816 None] Created reservations ['78fe6770-ad01-46e9-83be-3087abaaaf23', '7c0f5299-b12a-4416-8094-2a5276448cda', '06b60042-9dc0-490e-a2f4-cb60b64573f1', '42c4673c-0b0b-4108-a111-850f122d7068'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:37:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-27f340e3-05ef-481f-996f-4e538d459f1d tempest-VolumeDependencyTests-942945816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:37:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-27f340e3-05ef-481f-996f-4e538d459f1d tempest-VolumeDependencyTests-942945816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:37:06 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-27f340e3-05ef-481f-996f-4e538d459f1d tempest-VolumeDependencyTests-942945816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:37:06 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-27f340e3-05ef-481f-996f-4e538d459f1d tempest-VolumeDependencyTests-942945816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:37:06 devstack sudo[104041]: pam_unix(sudo:session): session closed for user root Sep 28 09:37:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-27f340e3-05ef-481f-996f-4e538d459f1d tempest-VolumeDependencyTests-942945816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:37:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-27f340e3-05ef-481f-996f-4e538d459f1d tempest-VolumeDependencyTests-942945816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:37:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-9c6b7baf-69c4-4986-8ff8-0465971b463f tempest-VolumesSnapshotListTestJSON-454019371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554.da5775fa-5f00-45fd-8152-2c4b6ffb2f23 -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554.c7095c98-6619-49cd-9948-9342da35a437" returned: 0 in 0.444s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:37:06 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-9c6b7baf-69c4-4986-8ff8-0465971b463f tempest-VolumesSnapshotListTestJSON-454019371 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554.c7095c98-6619-49cd-9948-9342da35a437 is being set with open permissions: ugo+rw Sep 28 09:37:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-9c6b7baf-69c4-4986-8ff8-0465971b463f tempest-VolumesSnapshotListTestJSON-454019371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554.c7095c98-6619-49cd-9948-9342da35a437 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:37:06 devstack sudo[104050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:37:06 devstack sudo[104050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:37:06 devstack sudo[104051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554.c7095c98-6619-49cd-9948-9342da35a437 Sep 28 09:37:06 devstack sudo[104051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:37:06 devstack sudo[104050]: pam_unix(sudo:session): session closed for user root Sep 28 09:37:06 devstack sudo[104051]: pam_unix(sudo:session): session closed for user root Sep 28 09:37:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-27f340e3-05ef-481f-996f-4e538d459f1d tempest-VolumeDependencyTests-942945816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.356s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:37:06 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-27f340e3-05ef-481f-996f-4e538d459f1d tempest-VolumeDependencyTests-942945816 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:37:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-9c6b7baf-69c4-4986-8ff8-0465971b463f tempest-VolumesSnapshotListTestJSON-454019371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554.c7095c98-6619-49cd-9948-9342da35a437" returned: 0 in 0.339s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:37:06 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-27f340e3-05ef-481f-996f-4e538d459f1d tempest-VolumeDependencyTests-942945816 None] Deleted volume successfully. Sep 28 09:37:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-9c6b7baf-69c4-4986-8ff8-0465971b463f tempest-VolumesSnapshotListTestJSON-454019371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.103s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:37:06 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-27f340e3-05ef-481f-996f-4e538d459f1d tempest-VolumeDependencyTests-942945816 None] Lock "cinder-03603d40-abb2-4669-ad61-23bc83069112-delete_volume" released by "delete_volume" :: held 1.731s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:37:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-fdb79645-1ee5-446c-87e1-00da2272bb8c req-1ee9f3aa-99e6-4944-aad5-81d65a7b3f03 tempest-TestServerVolumeAttachmentScenario-522292647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:37:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-fdb79645-1ee5-446c-87e1-00da2272bb8c req-1ee9f3aa-99e6-4944-aad5-81d65a7b3f03 tempest-TestServerVolumeAttachmentScenario-522292647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:37:06 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-9c6b7baf-69c4-4986-8ff8-0465971b463f tempest-VolumesSnapshotListTestJSON-454019371 None] Create snapshot completed successfully Sep 28 09:37:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-fdb79645-1ee5-446c-87e1-00da2272bb8c req-1ee9f3aa-99e6-4944-aad5-81d65a7b3f03 tempest-TestServerVolumeAttachmentScenario-522292647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:37:06 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [req-fdb79645-1ee5-446c-87e1-00da2272bb8c req-1ee9f3aa-99e6-4944-aad5-81d65a7b3f03 tempest-TestServerVolumeAttachmentScenario-522292647 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d', 'name': 'volume-1aed4847-2eb9-4062-92bd-a26a64e28dea', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2c1d8c25-3cc0-4da4-ab25-3addc35640c4', 'enforce_multipath': True} {{(pid=86553) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 09:37:06 devstack cinder-volume[86553]: INFO cinder.volume.manager [req-fdb79645-1ee5-446c-87e1-00da2272bb8c req-1ee9f3aa-99e6-4944-aad5-81d65a7b3f03 tempest-TestServerVolumeAttachmentScenario-522292647 None] attachment_update completed successfully. Sep 28 09:37:07 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-cb485014-c6f3-4df8-b546-8277c642e8af tempest-VolumeDependencyTests-942945816 None] Acquiring lock "cinder-57a389a8-5b8e-4f94-acf9-4d37f1275de1-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:37:07 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-cb485014-c6f3-4df8-b546-8277c642e8af tempest-VolumeDependencyTests-942945816 None] Lock "cinder-57a389a8-5b8e-4f94-acf9-4d37f1275de1-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:37:07 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-cb485014-c6f3-4df8-b546-8277c642e8af tempest-VolumeDependencyTests-942945816 None] Acquiring lock "cinder-quobyte-57a389a8-5b8e-4f94-acf9-4d37f1275de1" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:37:07 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-cb485014-c6f3-4df8-b546-8277c642e8af tempest-VolumeDependencyTests-942945816 None] Lock "cinder-quobyte-57a389a8-5b8e-4f94-acf9-4d37f1275de1" acquired by "delete_volume" :: waited 0.045s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:37:07 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4e0a43f-f722-440a-8904-1b85fe452cc7]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:37:07 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-cb485014-c6f3-4df8-b546-8277c642e8af tempest-VolumeDependencyTests-942945816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-57a389a8-5b8e-4f94-acf9-4d37f1275de1 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:37:07 devstack sudo[104070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-57a389a8-5b8e-4f94-acf9-4d37f1275de1 Sep 28 09:37:07 devstack sudo[104070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:37:07 devstack sudo[104070]: pam_unix(sudo:session): session closed for user root Sep 28 09:37:07 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-cb485014-c6f3-4df8-b546-8277c642e8af tempest-VolumeDependencyTests-942945816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-57a389a8-5b8e-4f94-acf9-4d37f1275de1" returned: 0 in 0.420s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:37:07 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-cb485014-c6f3-4df8-b546-8277c642e8af tempest-VolumeDependencyTests-942945816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-57a389a8-5b8e-4f94-acf9-4d37f1275de1 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:37:07 devstack sudo[104076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-57a389a8-5b8e-4f94-acf9-4d37f1275de1 Sep 28 09:37:07 devstack sudo[104076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:37:07 devstack sudo[104076]: pam_unix(sudo:session): session closed for user root Sep 28 09:37:07 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-cb485014-c6f3-4df8-b546-8277c642e8af tempest-VolumeDependencyTests-942945816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-57a389a8-5b8e-4f94-acf9-4d37f1275de1" returned: 0 in 0.271s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:37:07 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-cb485014-c6f3-4df8-b546-8277c642e8af tempest-VolumeDependencyTests-942945816 None] Lock "cinder-quobyte-57a389a8-5b8e-4f94-acf9-4d37f1275de1" released by "delete_volume" :: held 0.755s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:37:08 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-cb485014-c6f3-4df8-b546-8277c642e8af tempest-VolumeDependencyTests-942945816 None] Created reservations ['83894c38-4c29-450b-825f-60cce956e2e6', 'ced41215-ea4a-4dba-b27b-8004a6a62fb0', '9865e05f-ec03-46d8-887c-9918781ff8b1', 'f5f68c5f-a0dc-4daa-be07-2f4c4a402a94'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:37:08 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-cb485014-c6f3-4df8-b546-8277c642e8af tempest-VolumeDependencyTests-942945816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:37:08 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-cb485014-c6f3-4df8-b546-8277c642e8af tempest-VolumeDependencyTests-942945816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:37:08 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-cb485014-c6f3-4df8-b546-8277c642e8af tempest-VolumeDependencyTests-942945816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:37:08 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-cb485014-c6f3-4df8-b546-8277c642e8af tempest-VolumeDependencyTests-942945816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:37:08 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-cb485014-c6f3-4df8-b546-8277c642e8af tempest-VolumeDependencyTests-942945816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:37:08 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-cb485014-c6f3-4df8-b546-8277c642e8af tempest-VolumeDependencyTests-942945816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:37:08 devstack sudo[104080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:37:08 devstack sudo[104080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:37:08 devstack sudo[104080]: pam_unix(sudo:session): session closed for user root Sep 28 09:37:08 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-cb485014-c6f3-4df8-b546-8277c642e8af tempest-VolumeDependencyTests-942945816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.349s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:37:08 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-cb485014-c6f3-4df8-b546-8277c642e8af tempest-VolumeDependencyTests-942945816 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:37:08 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-cb485014-c6f3-4df8-b546-8277c642e8af tempest-VolumeDependencyTests-942945816 None] Deleted volume successfully. Sep 28 09:37:08 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-cb485014-c6f3-4df8-b546-8277c642e8af tempest-VolumeDependencyTests-942945816 None] Lock "cinder-57a389a8-5b8e-4f94-acf9-4d37f1275de1-delete_volume" released by "delete_volume" :: held 1.399s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:37:08 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-ee5aca58-46da-4695-b699-8b7a535910bb tempest-VolumesSnapshotListTestJSON-454019371 None] Acquiring lock "cinder-c7095c98-6619-49cd-9948-9342da35a437-delete_snapshot" by "delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:37:08 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-ee5aca58-46da-4695-b699-8b7a535910bb tempest-VolumesSnapshotListTestJSON-454019371 None] Lock "cinder-c7095c98-6619-49cd-9948-9342da35a437-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:37:08 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-ee5aca58-46da-4695-b699-8b7a535910bb tempest-VolumesSnapshotListTestJSON-454019371 None] Acquiring lock "cinder-quobyte-20681f0d-3f82-4bd0-841c-2b6ac4f29554" by "delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:37:08 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-ee5aca58-46da-4695-b699-8b7a535910bb tempest-VolumesSnapshotListTestJSON-454019371 None] Lock "cinder-quobyte-20681f0d-3f82-4bd0-841c-2b6ac4f29554" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:37:08 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-ee5aca58-46da-4695-b699-8b7a535910bb tempest-VolumesSnapshotListTestJSON-454019371 None] Acquiring lock "cinder-quobyte-c7095c98-6619-49cd-9948-9342da35a437" by "_delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:37:08 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-ee5aca58-46da-4695-b699-8b7a535910bb tempest-VolumesSnapshotListTestJSON-454019371 None] Lock "cinder-quobyte-c7095c98-6619-49cd-9948-9342da35a437" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:37:08 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-ee5aca58-46da-4695-b699-8b7a535910bb tempest-VolumesSnapshotListTestJSON-454019371 None] Deleting offline snapshot c7095c98-6619-49cd-9948-9342da35a437 of volume 20681f0d-3f82-4bd0-841c-2b6ac4f29554 {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 09:37:08 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-ee5aca58-46da-4695-b699-8b7a535910bb tempest-VolumesSnapshotListTestJSON-454019371 None] snapshot_file for this snap is: volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554.c7095c98-6619-49cd-9948-9342da35a437 {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 09:37:08 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[e157994e-1528-439b-806a-3bbfea229a32]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:37:08 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ee5aca58-46da-4695-b699-8b7a535910bb tempest-VolumesSnapshotListTestJSON-454019371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554.c7095c98-6619-49cd-9948-9342da35a437 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:37:08 devstack sudo[104083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554.c7095c98-6619-49cd-9948-9342da35a437 Sep 28 09:37:08 devstack sudo[104083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:37:09 devstack sudo[104083]: pam_unix(sudo:session): session closed for user root Sep 28 09:37:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ee5aca58-46da-4695-b699-8b7a535910bb tempest-VolumesSnapshotListTestJSON-454019371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554.c7095c98-6619-49cd-9948-9342da35a437" returned: 0 in 0.439s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:37:09 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-ee5aca58-46da-4695-b699-8b7a535910bb tempest-VolumesSnapshotListTestJSON-454019371 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86553) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 09:37:09 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[66637128-78c5-4bfc-9e4f-8f56d22785a1]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:37:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ee5aca58-46da-4695-b699-8b7a535910bb tempest-VolumesSnapshotListTestJSON-454019371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554.da5775fa-5f00-45fd-8152-2c4b6ffb2f23 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:37:09 devstack sudo[104089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554.da5775fa-5f00-45fd-8152-2c4b6ffb2f23 Sep 28 09:37:09 devstack sudo[104089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:37:09 devstack sudo[104089]: pam_unix(sudo:session): session closed for user root Sep 28 09:37:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ee5aca58-46da-4695-b699-8b7a535910bb tempest-VolumesSnapshotListTestJSON-454019371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554.da5775fa-5f00-45fd-8152-2c4b6ffb2f23" returned: 0 in 0.521s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:37:09 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-ee5aca58-46da-4695-b699-8b7a535910bb tempest-VolumesSnapshotListTestJSON-454019371 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86553) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 09:37:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ee5aca58-46da-4695-b699-8b7a535910bb tempest-VolumesSnapshotListTestJSON-454019371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554.c7095c98-6619-49cd-9948-9342da35a437 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:37:09 devstack sudo[104094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554.c7095c98-6619-49cd-9948-9342da35a437 Sep 28 09:37:09 devstack sudo[104094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:37:10 devstack sudo[104094]: pam_unix(sudo:session): session closed for user root Sep 28 09:37:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ee5aca58-46da-4695-b699-8b7a535910bb tempest-VolumesSnapshotListTestJSON-454019371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554.c7095c98-6619-49cd-9948-9342da35a437" returned: 0 in 0.685s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:37:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ee5aca58-46da-4695-b699-8b7a535910bb tempest-VolumesSnapshotListTestJSON-454019371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554.c7095c98-6619-49cd-9948-9342da35a437 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:37:10 devstack sudo[104100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554.c7095c98-6619-49cd-9948-9342da35a437 Sep 28 09:37:10 devstack sudo[104100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:37:10 devstack sudo[104100]: pam_unix(sudo:session): session closed for user root Sep 28 09:37:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ee5aca58-46da-4695-b699-8b7a535910bb tempest-VolumesSnapshotListTestJSON-454019371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554.c7095c98-6619-49cd-9948-9342da35a437" returned: 0 in 0.387s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:37:10 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-ee5aca58-46da-4695-b699-8b7a535910bb tempest-VolumesSnapshotListTestJSON-454019371 None] Lock "cinder-quobyte-c7095c98-6619-49cd-9948-9342da35a437" released by "_delete_snapshot" :: held 2.191s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:37:10 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-ee5aca58-46da-4695-b699-8b7a535910bb tempest-VolumesSnapshotListTestJSON-454019371 None] Lock "cinder-quobyte-20681f0d-3f82-4bd0-841c-2b6ac4f29554" released by "delete_snapshot" :: held 2.228s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:37:11 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-ee5aca58-46da-4695-b699-8b7a535910bb tempest-VolumesSnapshotListTestJSON-454019371 None] Created reservations ['6ef7ca05-92fe-4fec-9267-3289c871e581', 'b9f92f36-13dd-4618-b42a-a5ef0964a678', 'f979f234-80f0-42d6-bca1-399008f05d09', '2597757b-fa24-4a1e-9979-bbddd31db38f'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:37:11 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-ee5aca58-46da-4695-b699-8b7a535910bb tempest-VolumesSnapshotListTestJSON-454019371 None] Delete snapshot completed successfully. Sep 28 09:37:11 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-ee5aca58-46da-4695-b699-8b7a535910bb tempest-VolumesSnapshotListTestJSON-454019371 None] Lock "cinder-c7095c98-6619-49cd-9948-9342da35a437-delete_snapshot" released by "delete_snapshot" :: held 2.508s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:37:12 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-13b8b945-8b0c-4e5e-9b3f-68ec5558ef42 tempest-VolumesSnapshotListTestJSON-454019371 None] Acquiring lock "cinder-da5775fa-5f00-45fd-8152-2c4b6ffb2f23-delete_snapshot" by "delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:37:12 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-13b8b945-8b0c-4e5e-9b3f-68ec5558ef42 tempest-VolumesSnapshotListTestJSON-454019371 None] Lock "cinder-da5775fa-5f00-45fd-8152-2c4b6ffb2f23-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:37:12 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-13b8b945-8b0c-4e5e-9b3f-68ec5558ef42 tempest-VolumesSnapshotListTestJSON-454019371 None] Acquiring lock "cinder-quobyte-20681f0d-3f82-4bd0-841c-2b6ac4f29554" by "delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:37:12 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-13b8b945-8b0c-4e5e-9b3f-68ec5558ef42 tempest-VolumesSnapshotListTestJSON-454019371 None] Lock "cinder-quobyte-20681f0d-3f82-4bd0-841c-2b6ac4f29554" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:37:12 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-13b8b945-8b0c-4e5e-9b3f-68ec5558ef42 tempest-VolumesSnapshotListTestJSON-454019371 None] Acquiring lock "cinder-quobyte-da5775fa-5f00-45fd-8152-2c4b6ffb2f23" by "_delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:37:12 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-13b8b945-8b0c-4e5e-9b3f-68ec5558ef42 tempest-VolumesSnapshotListTestJSON-454019371 None] Lock "cinder-quobyte-da5775fa-5f00-45fd-8152-2c4b6ffb2f23" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:37:12 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-13b8b945-8b0c-4e5e-9b3f-68ec5558ef42 tempest-VolumesSnapshotListTestJSON-454019371 None] Deleting offline snapshot da5775fa-5f00-45fd-8152-2c4b6ffb2f23 of volume 20681f0d-3f82-4bd0-841c-2b6ac4f29554 {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 09:37:12 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-13b8b945-8b0c-4e5e-9b3f-68ec5558ef42 tempest-VolumesSnapshotListTestJSON-454019371 None] snapshot_file for this snap is: volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554.da5775fa-5f00-45fd-8152-2c4b6ffb2f23 {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 09:37:12 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b34bf5-0113-408c-92eb-85b2d16560d2]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:37:12 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-13b8b945-8b0c-4e5e-9b3f-68ec5558ef42 tempest-VolumesSnapshotListTestJSON-454019371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554.da5775fa-5f00-45fd-8152-2c4b6ffb2f23 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:37:12 devstack sudo[104106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554.da5775fa-5f00-45fd-8152-2c4b6ffb2f23 Sep 28 09:37:12 devstack sudo[104106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:37:12 devstack sudo[104106]: pam_unix(sudo:session): session closed for user root Sep 28 09:37:12 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-13b8b945-8b0c-4e5e-9b3f-68ec5558ef42 tempest-VolumesSnapshotListTestJSON-454019371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554.da5775fa-5f00-45fd-8152-2c4b6ffb2f23" returned: 0 in 0.613s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:37:12 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-13b8b945-8b0c-4e5e-9b3f-68ec5558ef42 tempest-VolumesSnapshotListTestJSON-454019371 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86553) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 09:37:12 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[8772c156-a263-4e09-ab30-ac81fba93d6c]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:37:12 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-13b8b945-8b0c-4e5e-9b3f-68ec5558ef42 tempest-VolumesSnapshotListTestJSON-454019371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554.988d9ba7-60b6-4466-bd36-e5915ff8ca17 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:37:13 devstack sudo[104118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554.988d9ba7-60b6-4466-bd36-e5915ff8ca17 Sep 28 09:37:13 devstack sudo[104118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:37:13 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-3bac0e37-14e4-445e-b349-902c583819fa req-d593c99f-5657-45ba-a9b2-597b84a380cc tempest-TestServerVolumeAttachmentScenario-522292647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:37:13 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-3bac0e37-14e4-445e-b349-902c583819fa req-d593c99f-5657-45ba-a9b2-597b84a380cc tempest-TestServerVolumeAttachmentScenario-522292647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:37:13 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-3bac0e37-14e4-445e-b349-902c583819fa req-d593c99f-5657-45ba-a9b2-597b84a380cc tempest-TestServerVolumeAttachmentScenario-522292647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:37:13 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [req-3bac0e37-14e4-445e-b349-902c583819fa req-d593c99f-5657-45ba-a9b2-597b84a380cc tempest-TestServerVolumeAttachmentScenario-522292647 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d', 'name': 'volume-70735ee3-680d-460d-85fd-482532d6462e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c3b4645f-27d4-4580-bca8-ab86ae24d045', 'enforce_multipath': True} {{(pid=86553) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 09:37:13 devstack cinder-volume[86553]: INFO cinder.volume.manager [req-3bac0e37-14e4-445e-b349-902c583819fa req-d593c99f-5657-45ba-a9b2-597b84a380cc tempest-TestServerVolumeAttachmentScenario-522292647 None] attachment_update completed successfully. Sep 28 09:37:13 devstack sudo[104118]: pam_unix(sudo:session): session closed for user root Sep 28 09:37:13 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-13b8b945-8b0c-4e5e-9b3f-68ec5558ef42 tempest-VolumesSnapshotListTestJSON-454019371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554.988d9ba7-60b6-4466-bd36-e5915ff8ca17" returned: 0 in 0.642s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:37:13 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-13b8b945-8b0c-4e5e-9b3f-68ec5558ef42 tempest-VolumesSnapshotListTestJSON-454019371 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86553) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 09:37:13 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-13b8b945-8b0c-4e5e-9b3f-68ec5558ef42 tempest-VolumesSnapshotListTestJSON-454019371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554.da5775fa-5f00-45fd-8152-2c4b6ffb2f23 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:37:13 devstack sudo[104126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554.da5775fa-5f00-45fd-8152-2c4b6ffb2f23 Sep 28 09:37:13 devstack sudo[104126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:37:14 devstack sudo[104126]: pam_unix(sudo:session): session closed for user root Sep 28 09:37:14 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-13b8b945-8b0c-4e5e-9b3f-68ec5558ef42 tempest-VolumesSnapshotListTestJSON-454019371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554.da5775fa-5f00-45fd-8152-2c4b6ffb2f23" returned: 0 in 0.522s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:37:14 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-13b8b945-8b0c-4e5e-9b3f-68ec5558ef42 tempest-VolumesSnapshotListTestJSON-454019371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554.da5775fa-5f00-45fd-8152-2c4b6ffb2f23 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:37:14 devstack sudo[104134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554.da5775fa-5f00-45fd-8152-2c4b6ffb2f23 Sep 28 09:37:14 devstack sudo[104134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:37:14 devstack sudo[104134]: pam_unix(sudo:session): session closed for user root Sep 28 09:37:14 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-13b8b945-8b0c-4e5e-9b3f-68ec5558ef42 tempest-VolumesSnapshotListTestJSON-454019371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554.da5775fa-5f00-45fd-8152-2c4b6ffb2f23" returned: 0 in 0.341s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:37:14 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-13b8b945-8b0c-4e5e-9b3f-68ec5558ef42 tempest-VolumesSnapshotListTestJSON-454019371 None] Lock "cinder-quobyte-da5775fa-5f00-45fd-8152-2c4b6ffb2f23" released by "_delete_snapshot" :: held 2.268s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:37:14 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-13b8b945-8b0c-4e5e-9b3f-68ec5558ef42 tempest-VolumesSnapshotListTestJSON-454019371 None] Lock "cinder-quobyte-20681f0d-3f82-4bd0-841c-2b6ac4f29554" released by "delete_snapshot" :: held 2.295s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:37:14 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-13b8b945-8b0c-4e5e-9b3f-68ec5558ef42 tempest-VolumesSnapshotListTestJSON-454019371 None] Created reservations ['12246437-74a0-497d-8b0b-dbe89fbede95', 'e2b71b46-8372-4306-aeca-808b43a4255a', '42d156fc-56f3-495e-9ed6-13136293b16e', '3992d37b-9f13-4725-a733-974b3c3b4d8e'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:37:14 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-13b8b945-8b0c-4e5e-9b3f-68ec5558ef42 tempest-VolumesSnapshotListTestJSON-454019371 None] Delete snapshot completed successfully. Sep 28 09:37:14 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-13b8b945-8b0c-4e5e-9b3f-68ec5558ef42 tempest-VolumesSnapshotListTestJSON-454019371 None] Lock "cinder-da5775fa-5f00-45fd-8152-2c4b6ffb2f23-delete_snapshot" released by "delete_snapshot" :: held 2.507s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:37:15 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-76617e1f-0c6e-4e46-b2e0-88813c3a4d5e tempest-VolumesSnapshotListTestJSON-454019371 None] Acquiring lock "cinder-988d9ba7-60b6-4466-bd36-e5915ff8ca17-delete_snapshot" by "delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:37:15 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-76617e1f-0c6e-4e46-b2e0-88813c3a4d5e tempest-VolumesSnapshotListTestJSON-454019371 None] Lock "cinder-988d9ba7-60b6-4466-bd36-e5915ff8ca17-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:37:15 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-76617e1f-0c6e-4e46-b2e0-88813c3a4d5e tempest-VolumesSnapshotListTestJSON-454019371 None] Acquiring lock "cinder-quobyte-20681f0d-3f82-4bd0-841c-2b6ac4f29554" by "delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:37:15 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-76617e1f-0c6e-4e46-b2e0-88813c3a4d5e tempest-VolumesSnapshotListTestJSON-454019371 None] Lock "cinder-quobyte-20681f0d-3f82-4bd0-841c-2b6ac4f29554" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:37:15 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-76617e1f-0c6e-4e46-b2e0-88813c3a4d5e tempest-VolumesSnapshotListTestJSON-454019371 None] Acquiring lock "cinder-quobyte-988d9ba7-60b6-4466-bd36-e5915ff8ca17" by "_delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:37:15 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-76617e1f-0c6e-4e46-b2e0-88813c3a4d5e tempest-VolumesSnapshotListTestJSON-454019371 None] Lock "cinder-quobyte-988d9ba7-60b6-4466-bd36-e5915ff8ca17" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:37:15 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-76617e1f-0c6e-4e46-b2e0-88813c3a4d5e tempest-VolumesSnapshotListTestJSON-454019371 None] Deleting offline snapshot 988d9ba7-60b6-4466-bd36-e5915ff8ca17 of volume 20681f0d-3f82-4bd0-841c-2b6ac4f29554 {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 09:37:15 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-76617e1f-0c6e-4e46-b2e0-88813c3a4d5e tempest-VolumesSnapshotListTestJSON-454019371 None] snapshot_file for this snap is: volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554.988d9ba7-60b6-4466-bd36-e5915ff8ca17 {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 09:37:15 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6533d0f-ff6c-48cc-9eb5-649bb4486431]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:37:15 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-76617e1f-0c6e-4e46-b2e0-88813c3a4d5e tempest-VolumesSnapshotListTestJSON-454019371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554.988d9ba7-60b6-4466-bd36-e5915ff8ca17 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:37:15 devstack sudo[104170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554.988d9ba7-60b6-4466-bd36-e5915ff8ca17 Sep 28 09:37:15 devstack sudo[104170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:37:16 devstack sudo[104170]: pam_unix(sudo:session): session closed for user root Sep 28 09:37:16 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-76617e1f-0c6e-4e46-b2e0-88813c3a4d5e tempest-VolumesSnapshotListTestJSON-454019371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554.988d9ba7-60b6-4466-bd36-e5915ff8ca17" returned: 0 in 0.467s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:37:16 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-76617e1f-0c6e-4e46-b2e0-88813c3a4d5e tempest-VolumesSnapshotListTestJSON-454019371 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86553) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 09:37:16 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[1160b450-1183-4668-9d89-c1fd5dbc17c3]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:37:16 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-76617e1f-0c6e-4e46-b2e0-88813c3a4d5e tempest-VolumesSnapshotListTestJSON-454019371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:37:16 devstack cinder-volume[86553]: INFO cinder.volume.manager [req-1cbe5b07-f1c1-4501-9ab1-365d1c0cd699 req-5541f898-1ed6-4f44-b5b2-2dd198414435 tempest-TestServerVolumeAttachmentScenario-522292647 None] Terminate volume connection completed successfully. Sep 28 09:37:16 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [req-1cbe5b07-f1c1-4501-9ab1-365d1c0cd699 req-5541f898-1ed6-4f44-b5b2-2dd198414435 tempest-TestServerVolumeAttachmentScenario-522292647 None] Deleting attachment c3b4645f-27d4-4580-bca8-ab86ae24d045. {{(pid=86553) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 09:37:16 devstack sudo[104181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554 Sep 28 09:37:16 devstack sudo[104181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:37:16 devstack sudo[104181]: pam_unix(sudo:session): session closed for user root Sep 28 09:37:16 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-76617e1f-0c6e-4e46-b2e0-88813c3a4d5e tempest-VolumesSnapshotListTestJSON-454019371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554" returned: 0 in 0.445s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:37:16 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-76617e1f-0c6e-4e46-b2e0-88813c3a4d5e tempest-VolumesSnapshotListTestJSON-454019371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554.988d9ba7-60b6-4466-bd36-e5915ff8ca17 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:37:16 devstack sudo[104186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554.988d9ba7-60b6-4466-bd36-e5915ff8ca17 Sep 28 09:37:16 devstack sudo[104186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:37:16 devstack sudo[104186]: pam_unix(sudo:session): session closed for user root Sep 28 09:37:16 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-76617e1f-0c6e-4e46-b2e0-88813c3a4d5e tempest-VolumesSnapshotListTestJSON-454019371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554.988d9ba7-60b6-4466-bd36-e5915ff8ca17" returned: 0 in 0.393s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:37:16 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-76617e1f-0c6e-4e46-b2e0-88813c3a4d5e tempest-VolumesSnapshotListTestJSON-454019371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554.988d9ba7-60b6-4466-bd36-e5915ff8ca17 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:37:16 devstack sudo[104194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554.988d9ba7-60b6-4466-bd36-e5915ff8ca17 Sep 28 09:37:16 devstack sudo[104194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:37:17 devstack sudo[104194]: pam_unix(sudo:session): session closed for user root Sep 28 09:37:17 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-76617e1f-0c6e-4e46-b2e0-88813c3a4d5e tempest-VolumesSnapshotListTestJSON-454019371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554.988d9ba7-60b6-4466-bd36-e5915ff8ca17" returned: 0 in 0.447s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:37:17 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-76617e1f-0c6e-4e46-b2e0-88813c3a4d5e tempest-VolumesSnapshotListTestJSON-454019371 None] Lock "cinder-quobyte-988d9ba7-60b6-4466-bd36-e5915ff8ca17" released by "_delete_snapshot" :: held 1.939s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:37:17 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-76617e1f-0c6e-4e46-b2e0-88813c3a4d5e tempest-VolumesSnapshotListTestJSON-454019371 None] Lock "cinder-quobyte-20681f0d-3f82-4bd0-841c-2b6ac4f29554" released by "delete_snapshot" :: held 1.997s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:37:17 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-76617e1f-0c6e-4e46-b2e0-88813c3a4d5e tempest-VolumesSnapshotListTestJSON-454019371 None] Created reservations ['a196c7cc-b82f-40b1-949d-0f63ebe70572', '21d70de3-442c-4494-9695-7dfcc952a216', '32002192-49ba-4284-9013-b1b3e453458a', 'b96aa317-b5cf-49a3-92ab-e382e0d382f6'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:37:17 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-76617e1f-0c6e-4e46-b2e0-88813c3a4d5e tempest-VolumesSnapshotListTestJSON-454019371 None] Delete snapshot completed successfully. Sep 28 09:37:17 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-76617e1f-0c6e-4e46-b2e0-88813c3a4d5e tempest-VolumesSnapshotListTestJSON-454019371 None] Lock "cinder-988d9ba7-60b6-4466-bd36-e5915ff8ca17-delete_snapshot" released by "delete_snapshot" :: held 2.196s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:37:17 devstack cinder-volume[86553]: INFO cinder.volume.manager [req-4fc375c7-d4b4-431a-8122-6e9f4f3378cc req-6296a377-ff52-4ac5-a0c6-88b98211218f tempest-TestServerVolumeAttachmentScenario-522292647 None] Terminate volume connection completed successfully. Sep 28 09:37:17 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [req-4fc375c7-d4b4-431a-8122-6e9f4f3378cc req-6296a377-ff52-4ac5-a0c6-88b98211218f tempest-TestServerVolumeAttachmentScenario-522292647 None] Deleting attachment 2c1d8c25-3cc0-4da4-ab25-3addc35640c4. {{(pid=86553) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 09:37:18 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-3cb5b84b-954e-492d-808c-cbb3261ef025 tempest-VolumesSnapshotListTestJSON-454019371 None] Acquiring lock "cinder-20681f0d-3f82-4bd0-841c-2b6ac4f29554-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:37:18 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-3cb5b84b-954e-492d-808c-cbb3261ef025 tempest-VolumesSnapshotListTestJSON-454019371 None] Lock "cinder-20681f0d-3f82-4bd0-841c-2b6ac4f29554-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:37:18 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-3cb5b84b-954e-492d-808c-cbb3261ef025 tempest-VolumesSnapshotListTestJSON-454019371 None] Acquiring lock "cinder-quobyte-20681f0d-3f82-4bd0-841c-2b6ac4f29554" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:37:18 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-3cb5b84b-954e-492d-808c-cbb3261ef025 tempest-VolumesSnapshotListTestJSON-454019371 None] Lock "cinder-quobyte-20681f0d-3f82-4bd0-841c-2b6ac4f29554" acquired by "delete_volume" :: waited 0.025s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:37:19 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a923fd0-44a5-4fa0-93f6-c6a9dfdebcfa]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:37:19 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3cb5b84b-954e-492d-808c-cbb3261ef025 tempest-VolumesSnapshotListTestJSON-454019371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:37:19 devstack sudo[104207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554 Sep 28 09:37:19 devstack sudo[104207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:37:19 devstack sudo[104207]: pam_unix(sudo:session): session closed for user root Sep 28 09:37:19 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3cb5b84b-954e-492d-808c-cbb3261ef025 tempest-VolumesSnapshotListTestJSON-454019371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554" returned: 0 in 0.511s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:37:19 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3cb5b84b-954e-492d-808c-cbb3261ef025 tempest-VolumesSnapshotListTestJSON-454019371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:37:19 devstack sudo[104233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554 Sep 28 09:37:19 devstack sudo[104233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:37:19 devstack sudo[104233]: pam_unix(sudo:session): session closed for user root Sep 28 09:37:19 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3cb5b84b-954e-492d-808c-cbb3261ef025 tempest-VolumesSnapshotListTestJSON-454019371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20681f0d-3f82-4bd0-841c-2b6ac4f29554" returned: 0 in 0.280s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:37:19 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-3cb5b84b-954e-492d-808c-cbb3261ef025 tempest-VolumesSnapshotListTestJSON-454019371 None] Lock "cinder-quobyte-20681f0d-3f82-4bd0-841c-2b6ac4f29554" released by "delete_volume" :: held 0.875s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:37:19 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-3cb5b84b-954e-492d-808c-cbb3261ef025 tempest-VolumesSnapshotListTestJSON-454019371 None] Created reservations ['2233f67a-9d3f-4ad6-8f78-87e80211f52c', 'c4cb5ddd-42ad-4cf9-9adc-45eeaeffd240', '47092783-1f9b-499f-ac84-8398645b65d9', 'a2076922-0a77-4201-bcdb-1ccb86d20667'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:37:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-3cb5b84b-954e-492d-808c-cbb3261ef025 tempest-VolumesSnapshotListTestJSON-454019371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:37:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-3cb5b84b-954e-492d-808c-cbb3261ef025 tempest-VolumesSnapshotListTestJSON-454019371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:37:20 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-3cb5b84b-954e-492d-808c-cbb3261ef025 tempest-VolumesSnapshotListTestJSON-454019371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:37:20 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-3cb5b84b-954e-492d-808c-cbb3261ef025 tempest-VolumesSnapshotListTestJSON-454019371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:37:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-3cb5b84b-954e-492d-808c-cbb3261ef025 tempest-VolumesSnapshotListTestJSON-454019371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:37:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3cb5b84b-954e-492d-808c-cbb3261ef025 tempest-VolumesSnapshotListTestJSON-454019371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:37:20 devstack sudo[104237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:37:20 devstack sudo[104237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:37:20 devstack sudo[104237]: pam_unix(sudo:session): session closed for user root Sep 28 09:37:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3cb5b84b-954e-492d-808c-cbb3261ef025 tempest-VolumesSnapshotListTestJSON-454019371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.379s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:37:20 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-3cb5b84b-954e-492d-808c-cbb3261ef025 tempest-VolumesSnapshotListTestJSON-454019371 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:37:20 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-3cb5b84b-954e-492d-808c-cbb3261ef025 tempest-VolumesSnapshotListTestJSON-454019371 None] Deleted volume successfully. Sep 28 09:37:20 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-3cb5b84b-954e-492d-808c-cbb3261ef025 tempest-VolumesSnapshotListTestJSON-454019371 None] Lock "cinder-20681f0d-3f82-4bd0-841c-2b6ac4f29554-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:37:21 devstack cinder-volume[86553]: DEBUG oslo_service.periodic_task [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86553) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 09:37:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:37:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:37:21 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:37:21 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:37:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:37:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:37:21 devstack sudo[104243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:37:21 devstack sudo[104243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:37:21 devstack sudo[104243]: pam_unix(sudo:session): session closed for user root Sep 28 09:37:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.345s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:37:21 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:37:21 devstack cinder-volume[86553]: DEBUG oslo_service.periodic_task [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Running periodic task VolumeManager._thread_info {{(pid=86553) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 09:37:21 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] thread count: 28 {{(pid=86553) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 09:37:21 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] thread info: [<_MainThread(MainThread, started 134684877779072)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86553) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 09:37:24 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-8ee0f5a7-5700-4f83-9603-69b1b3df368a tempest-TestServerVolumeAttachmentScenario-522292647 None] Acquiring lock "cinder-70735ee3-680d-460d-85fd-482532d6462e-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:37:24 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-8ee0f5a7-5700-4f83-9603-69b1b3df368a tempest-TestServerVolumeAttachmentScenario-522292647 None] Lock "cinder-70735ee3-680d-460d-85fd-482532d6462e-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:37:24 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-8ee0f5a7-5700-4f83-9603-69b1b3df368a tempest-TestServerVolumeAttachmentScenario-522292647 None] Acquiring lock "cinder-quobyte-70735ee3-680d-460d-85fd-482532d6462e" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:37:24 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-8ee0f5a7-5700-4f83-9603-69b1b3df368a tempest-TestServerVolumeAttachmentScenario-522292647 None] Lock "cinder-quobyte-70735ee3-680d-460d-85fd-482532d6462e" acquired by "delete_volume" :: waited 0.018s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:37:24 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[d75dd46e-1709-4cd7-9f4a-7253c8152c8c]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:37:24 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-8ee0f5a7-5700-4f83-9603-69b1b3df368a tempest-TestServerVolumeAttachmentScenario-522292647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-70735ee3-680d-460d-85fd-482532d6462e {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:37:24 devstack sudo[104288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-70735ee3-680d-460d-85fd-482532d6462e Sep 28 09:37:24 devstack sudo[104288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:37:24 devstack sudo[104288]: pam_unix(sudo:session): session closed for user root Sep 28 09:37:25 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-8ee0f5a7-5700-4f83-9603-69b1b3df368a tempest-TestServerVolumeAttachmentScenario-522292647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-70735ee3-680d-460d-85fd-482532d6462e" returned: 0 in 0.450s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:37:25 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-8ee0f5a7-5700-4f83-9603-69b1b3df368a tempest-TestServerVolumeAttachmentScenario-522292647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-70735ee3-680d-460d-85fd-482532d6462e {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:37:25 devstack sudo[104294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-70735ee3-680d-460d-85fd-482532d6462e Sep 28 09:37:25 devstack sudo[104294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:37:25 devstack sudo[104294]: pam_unix(sudo:session): session closed for user root Sep 28 09:37:25 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-8ee0f5a7-5700-4f83-9603-69b1b3df368a tempest-TestServerVolumeAttachmentScenario-522292647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-70735ee3-680d-460d-85fd-482532d6462e" returned: 0 in 0.377s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:37:25 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-8ee0f5a7-5700-4f83-9603-69b1b3df368a tempest-TestServerVolumeAttachmentScenario-522292647 None] Lock "cinder-quobyte-70735ee3-680d-460d-85fd-482532d6462e" released by "delete_volume" :: held 0.893s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:37:25 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-8ee0f5a7-5700-4f83-9603-69b1b3df368a tempest-TestServerVolumeAttachmentScenario-522292647 None] Created reservations ['11da48fb-3d79-4145-9985-63ce21e887e4', 'd147cdf7-6370-423c-93d5-7cdd220be6f3', 'd1db63e9-4933-4a70-8008-8c1f131e3ce6', 'b9f32301-417c-43aa-9fb0-bfaee268501d'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:37:25 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-8ee0f5a7-5700-4f83-9603-69b1b3df368a tempest-TestServerVolumeAttachmentScenario-522292647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:37:25 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-8ee0f5a7-5700-4f83-9603-69b1b3df368a tempest-TestServerVolumeAttachmentScenario-522292647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:37:25 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-8ee0f5a7-5700-4f83-9603-69b1b3df368a tempest-TestServerVolumeAttachmentScenario-522292647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:37:25 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-8ee0f5a7-5700-4f83-9603-69b1b3df368a tempest-TestServerVolumeAttachmentScenario-522292647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:37:25 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-8ee0f5a7-5700-4f83-9603-69b1b3df368a tempest-TestServerVolumeAttachmentScenario-522292647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:37:25 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-8ee0f5a7-5700-4f83-9603-69b1b3df368a tempest-TestServerVolumeAttachmentScenario-522292647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:37:25 devstack sudo[104299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:37:25 devstack sudo[104299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:37:26 devstack sudo[104299]: pam_unix(sudo:session): session closed for user root Sep 28 09:37:26 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-8ee0f5a7-5700-4f83-9603-69b1b3df368a tempest-TestServerVolumeAttachmentScenario-522292647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.400s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:37:26 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-8ee0f5a7-5700-4f83-9603-69b1b3df368a tempest-TestServerVolumeAttachmentScenario-522292647 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:37:26 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-8ee0f5a7-5700-4f83-9603-69b1b3df368a tempest-TestServerVolumeAttachmentScenario-522292647 None] Deleted volume successfully. Sep 28 09:37:26 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-8ee0f5a7-5700-4f83-9603-69b1b3df368a tempest-TestServerVolumeAttachmentScenario-522292647 None] Lock "cinder-70735ee3-680d-460d-85fd-482532d6462e-delete_volume" released by "delete_volume" :: held 1.728s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:37:26 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-ee8cbbe1-4ae9-4028-a6f1-a55137b54e94 tempest-TestServerVolumeAttachmentScenario-522292647 None] Acquiring lock "cinder-1aed4847-2eb9-4062-92bd-a26a64e28dea-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:37:26 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-ee8cbbe1-4ae9-4028-a6f1-a55137b54e94 tempest-TestServerVolumeAttachmentScenario-522292647 None] Lock "cinder-1aed4847-2eb9-4062-92bd-a26a64e28dea-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:37:26 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-ee8cbbe1-4ae9-4028-a6f1-a55137b54e94 tempest-TestServerVolumeAttachmentScenario-522292647 None] Acquiring lock "cinder-quobyte-1aed4847-2eb9-4062-92bd-a26a64e28dea" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:37:26 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-ee8cbbe1-4ae9-4028-a6f1-a55137b54e94 tempest-TestServerVolumeAttachmentScenario-522292647 None] Lock "cinder-quobyte-1aed4847-2eb9-4062-92bd-a26a64e28dea" acquired by "delete_volume" :: waited 0.013s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:37:26 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[5430586f-5877-41b5-8cdf-e5cbedc90462]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:37:26 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ee8cbbe1-4ae9-4028-a6f1-a55137b54e94 tempest-TestServerVolumeAttachmentScenario-522292647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1aed4847-2eb9-4062-92bd-a26a64e28dea {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:37:27 devstack sudo[104325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1aed4847-2eb9-4062-92bd-a26a64e28dea Sep 28 09:37:27 devstack sudo[104325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:37:27 devstack sudo[104325]: pam_unix(sudo:session): session closed for user root Sep 28 09:37:27 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ee8cbbe1-4ae9-4028-a6f1-a55137b54e94 tempest-TestServerVolumeAttachmentScenario-522292647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1aed4847-2eb9-4062-92bd-a26a64e28dea" returned: 0 in 0.564s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:37:27 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ee8cbbe1-4ae9-4028-a6f1-a55137b54e94 tempest-TestServerVolumeAttachmentScenario-522292647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1aed4847-2eb9-4062-92bd-a26a64e28dea {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:37:27 devstack sudo[104330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1aed4847-2eb9-4062-92bd-a26a64e28dea Sep 28 09:37:27 devstack sudo[104330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:37:27 devstack sudo[104330]: pam_unix(sudo:session): session closed for user root Sep 28 09:37:27 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ee8cbbe1-4ae9-4028-a6f1-a55137b54e94 tempest-TestServerVolumeAttachmentScenario-522292647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1aed4847-2eb9-4062-92bd-a26a64e28dea" returned: 0 in 0.346s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:37:27 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-ee8cbbe1-4ae9-4028-a6f1-a55137b54e94 tempest-TestServerVolumeAttachmentScenario-522292647 None] Lock "cinder-quobyte-1aed4847-2eb9-4062-92bd-a26a64e28dea" released by "delete_volume" :: held 0.983s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:37:27 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-ee8cbbe1-4ae9-4028-a6f1-a55137b54e94 tempest-TestServerVolumeAttachmentScenario-522292647 None] Created reservations ['4e3ba534-2f2d-4e3e-98a6-4872f43bc9af', 'c620bf3e-44b5-4166-8cf4-d762bc70fa1e', 'bcf4be29-3025-4cd2-8750-381dc2716899', 'a9beeee2-7f76-470f-b998-018f003ce0bd'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:37:28 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ee8cbbe1-4ae9-4028-a6f1-a55137b54e94 tempest-TestServerVolumeAttachmentScenario-522292647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:37:28 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ee8cbbe1-4ae9-4028-a6f1-a55137b54e94 tempest-TestServerVolumeAttachmentScenario-522292647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:37:28 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ee8cbbe1-4ae9-4028-a6f1-a55137b54e94 tempest-TestServerVolumeAttachmentScenario-522292647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:37:28 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ee8cbbe1-4ae9-4028-a6f1-a55137b54e94 tempest-TestServerVolumeAttachmentScenario-522292647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:37:28 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ee8cbbe1-4ae9-4028-a6f1-a55137b54e94 tempest-TestServerVolumeAttachmentScenario-522292647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:37:28 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ee8cbbe1-4ae9-4028-a6f1-a55137b54e94 tempest-TestServerVolumeAttachmentScenario-522292647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:37:28 devstack sudo[104336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:37:28 devstack sudo[104336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:37:28 devstack cinder-volume[86553]: INFO cinder.volume.manager [req-07820908-f79d-4c6c-a716-6dc49e748d12 req-69b044ff-2956-497a-8157-e03e6d675e76 tempest-TestShelveInstance-165027966 None] Terminate volume connection completed successfully. Sep 28 09:37:28 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [req-07820908-f79d-4c6c-a716-6dc49e748d12 req-69b044ff-2956-497a-8157-e03e6d675e76 tempest-TestShelveInstance-165027966 None] Deleting attachment 5cba5bde-dc76-4fdd-ab3e-76768220c64c. {{(pid=86553) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 09:37:28 devstack cinder-volume[86553]: DEBUG cinder.coordination [req-07820908-f79d-4c6c-a716-6dc49e748d12 req-693a03b1-04f7-41ff-a2e8-73afded99868 tempest-TestShelveInstance-165027966 None] Acquiring lock "cinder-57d3d311-43fc-4c70-b1dd-0cf01f63a115-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:37:28 devstack cinder-volume[86553]: DEBUG cinder.coordination [req-07820908-f79d-4c6c-a716-6dc49e748d12 req-693a03b1-04f7-41ff-a2e8-73afded99868 tempest-TestShelveInstance-165027966 None] Lock "cinder-57d3d311-43fc-4c70-b1dd-0cf01f63a115-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:37:28 devstack cinder-volume[86553]: DEBUG cinder.coordination [req-07820908-f79d-4c6c-a716-6dc49e748d12 req-693a03b1-04f7-41ff-a2e8-73afded99868 tempest-TestShelveInstance-165027966 None] Acquiring lock "cinder-quobyte-57d3d311-43fc-4c70-b1dd-0cf01f63a115" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:37:28 devstack cinder-volume[86553]: DEBUG cinder.coordination [req-07820908-f79d-4c6c-a716-6dc49e748d12 req-693a03b1-04f7-41ff-a2e8-73afded99868 tempest-TestShelveInstance-165027966 None] Lock "cinder-quobyte-57d3d311-43fc-4c70-b1dd-0cf01f63a115" acquired by "delete_volume" :: waited 0.022s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:37:28 devstack sudo[104336]: pam_unix(sudo:session): session closed for user root Sep 28 09:37:28 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ee8cbbe1-4ae9-4028-a6f1-a55137b54e94 tempest-TestServerVolumeAttachmentScenario-522292647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.471s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:37:28 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-ee8cbbe1-4ae9-4028-a6f1-a55137b54e94 tempest-TestServerVolumeAttachmentScenario-522292647 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:37:28 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-ee8cbbe1-4ae9-4028-a6f1-a55137b54e94 tempest-TestServerVolumeAttachmentScenario-522292647 None] Deleted volume successfully. Sep 28 09:37:28 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[23013e25-8d9e-4e00-b16d-dbdcd12df530]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:37:28 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [req-07820908-f79d-4c6c-a716-6dc49e748d12 req-693a03b1-04f7-41ff-a2e8-73afded99868 tempest-TestShelveInstance-165027966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-57d3d311-43fc-4c70-b1dd-0cf01f63a115 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:37:28 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-ee8cbbe1-4ae9-4028-a6f1-a55137b54e94 tempest-TestServerVolumeAttachmentScenario-522292647 None] Lock "cinder-1aed4847-2eb9-4062-92bd-a26a64e28dea-delete_volume" released by "delete_volume" :: held 1.806s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:37:28 devstack sudo[104339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-57d3d311-43fc-4c70-b1dd-0cf01f63a115 Sep 28 09:37:28 devstack sudo[104339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:37:29 devstack sudo[104339]: pam_unix(sudo:session): session closed for user root Sep 28 09:37:29 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [req-07820908-f79d-4c6c-a716-6dc49e748d12 req-693a03b1-04f7-41ff-a2e8-73afded99868 tempest-TestShelveInstance-165027966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-57d3d311-43fc-4c70-b1dd-0cf01f63a115" returned: 0 in 0.594s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:37:29 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [req-07820908-f79d-4c6c-a716-6dc49e748d12 req-693a03b1-04f7-41ff-a2e8-73afded99868 tempest-TestShelveInstance-165027966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-57d3d311-43fc-4c70-b1dd-0cf01f63a115 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:37:29 devstack sudo[104344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-57d3d311-43fc-4c70-b1dd-0cf01f63a115 Sep 28 09:37:29 devstack sudo[104344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:37:29 devstack sudo[104344]: pam_unix(sudo:session): session closed for user root Sep 28 09:37:29 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [req-07820908-f79d-4c6c-a716-6dc49e748d12 req-693a03b1-04f7-41ff-a2e8-73afded99868 tempest-TestShelveInstance-165027966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-57d3d311-43fc-4c70-b1dd-0cf01f63a115" returned: 0 in 0.301s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:37:29 devstack cinder-volume[86553]: DEBUG cinder.coordination [req-07820908-f79d-4c6c-a716-6dc49e748d12 req-693a03b1-04f7-41ff-a2e8-73afded99868 tempest-TestShelveInstance-165027966 None] Lock "cinder-quobyte-57d3d311-43fc-4c70-b1dd-0cf01f63a115" released by "delete_volume" :: held 0.971s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:37:29 devstack cinder-volume[86553]: DEBUG cinder.quota [req-07820908-f79d-4c6c-a716-6dc49e748d12 req-693a03b1-04f7-41ff-a2e8-73afded99868 tempest-TestShelveInstance-165027966 None] Created reservations ['b1fdc7ee-2505-43d9-8497-0440ce1d9eff', 'a9fcdff1-a6a2-433d-a618-3e5c61cf4fcc', 'f66a7d3b-1b67-4d7a-a58f-758b11b579de', '2d9f87c6-145b-4ac4-8672-8c5495255602'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:37:29 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-07820908-f79d-4c6c-a716-6dc49e748d12 req-693a03b1-04f7-41ff-a2e8-73afded99868 tempest-TestShelveInstance-165027966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:37:29 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-07820908-f79d-4c6c-a716-6dc49e748d12 req-693a03b1-04f7-41ff-a2e8-73afded99868 tempest-TestShelveInstance-165027966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:37:29 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [req-07820908-f79d-4c6c-a716-6dc49e748d12 req-693a03b1-04f7-41ff-a2e8-73afded99868 tempest-TestShelveInstance-165027966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:37:29 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [req-07820908-f79d-4c6c-a716-6dc49e748d12 req-693a03b1-04f7-41ff-a2e8-73afded99868 tempest-TestShelveInstance-165027966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:37:29 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-07820908-f79d-4c6c-a716-6dc49e748d12 req-693a03b1-04f7-41ff-a2e8-73afded99868 tempest-TestShelveInstance-165027966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:37:29 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [req-07820908-f79d-4c6c-a716-6dc49e748d12 req-693a03b1-04f7-41ff-a2e8-73afded99868 tempest-TestShelveInstance-165027966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:37:29 devstack sudo[104348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:37:29 devstack sudo[104348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:37:29 devstack sudo[104348]: pam_unix(sudo:session): session closed for user root Sep 28 09:37:29 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [req-07820908-f79d-4c6c-a716-6dc49e748d12 req-693a03b1-04f7-41ff-a2e8-73afded99868 tempest-TestShelveInstance-165027966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.278s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:37:29 devstack cinder-volume[86553]: DEBUG cinder.manager [req-07820908-f79d-4c6c-a716-6dc49e748d12 req-693a03b1-04f7-41ff-a2e8-73afded99868 tempest-TestShelveInstance-165027966 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:37:29 devstack cinder-volume[86553]: INFO cinder.volume.manager [req-07820908-f79d-4c6c-a716-6dc49e748d12 req-693a03b1-04f7-41ff-a2e8-73afded99868 tempest-TestShelveInstance-165027966 None] Deleted volume successfully. Sep 28 09:37:30 devstack cinder-volume[86553]: DEBUG cinder.coordination [req-07820908-f79d-4c6c-a716-6dc49e748d12 req-693a03b1-04f7-41ff-a2e8-73afded99868 tempest-TestShelveInstance-165027966 None] Lock "cinder-57d3d311-43fc-4c70-b1dd-0cf01f63a115-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:37:39 devstack cinder-volume[86553]: DEBUG dbcounter [-] [86553] Writing DB stats cinder:SELECT=87,cinder:INSERT=17,cinder:UPDATE=77,cinder:DELETE=2 {{(pid=86553) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 09:37:39 devstack cinder-volume[86553]: DEBUG dbcounter [-] [86553] Writing DB stats cinder:SELECT=57,cinder:UPDATE=77,cinder:DELETE=7,cinder:INSERT=24 {{(pid=86553) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 09:37:46 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-78a0b4ca-504f-47c8-bef9-439d045d0b9c tempest-SnapshotDependencyTests-677054290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:37:46 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-78a0b4ca-504f-47c8-bef9-439d045d0b9c tempest-SnapshotDependencyTests-677054290 None] Flow 'volume_create_manager' (f9125cc6-558b-4060-88b4-a196b677e889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:37:46 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-78a0b4ca-504f-47c8-bef9-439d045d0b9c tempest-SnapshotDependencyTests-677054290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fa0c901-dcb4-4aeb-9ce6-d058c85894fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:37:46 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-78a0b4ca-504f-47c8-bef9-439d045d0b9c tempest-SnapshotDependencyTests-677054290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fa0c901-dcb4-4aeb-9ce6-d058c85894fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:37:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-307595741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6b0ee3d-0a56-476c-8760-241a8d4b57b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef6514c6f1274a048df9242e44ae3f47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:37:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:37:47Z,use_quota=True,user_id='56be22a8ee764f718b9cfeb15e49ae86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:37:46 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-78a0b4ca-504f-47c8-bef9-439d045d0b9c tempest-SnapshotDependencyTests-677054290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb0c89f9-92e4-406d-b000-de2d9a0a9aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:37:46 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-78a0b4ca-504f-47c8-bef9-439d045d0b9c tempest-SnapshotDependencyTests-677054290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb0c89f9-92e4-406d-b000-de2d9a0a9aad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:37:46 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-78a0b4ca-504f-47c8-bef9-439d045d0b9c tempest-SnapshotDependencyTests-677054290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4f52c28-6267-4b92-ae51-1ec7cd67afef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:37:46 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-78a0b4ca-504f-47c8-bef9-439d045d0b9c tempest-SnapshotDependencyTests-677054290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4f52c28-6267-4b92-ae51-1ec7cd67afef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6b0ee3d-0a56-476c-8760-241a8d4b57b4', 'volume_name': 'volume-f6b0ee3d-0a56-476c-8760-241a8d4b57b4', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:37:46 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-78a0b4ca-504f-47c8-bef9-439d045d0b9c tempest-SnapshotDependencyTests-677054290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6380f6b-11c6-426d-917c-9759e4f3c5e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:37:46 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-78a0b4ca-504f-47c8-bef9-439d045d0b9c tempest-SnapshotDependencyTests-677054290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6380f6b-11c6-426d-917c-9759e4f3c5e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:37:46 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-78a0b4ca-504f-47c8-bef9-439d045d0b9c tempest-SnapshotDependencyTests-677054290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12c99c0a-789a-4a62-b306-0898ff8ed245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:37:46 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-78a0b4ca-504f-47c8-bef9-439d045d0b9c tempest-SnapshotDependencyTests-677054290 None] Volume f6b0ee3d-0a56-476c-8760-241a8d4b57b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6b0ee3d-0a56-476c-8760-241a8d4b57b4', 'volume_size': 1} Sep 28 09:37:46 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-78a0b4ca-504f-47c8-bef9-439d045d0b9c tempest-SnapshotDependencyTests-677054290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:37:46 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-78a0b4ca-504f-47c8-bef9-439d045d0b9c tempest-SnapshotDependencyTests-677054290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:37:46 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-78a0b4ca-504f-47c8-bef9-439d045d0b9c tempest-SnapshotDependencyTests-677054290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:37:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-307595741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6b0ee3d-0a56-476c-8760-241a8d4b57b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef6514c6f1274a048df9242e44ae3f47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:37:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:37:47Z,use_quota=True,user_id='56be22a8ee764f718b9cfeb15e49ae86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:37:46 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-78a0b4ca-504f-47c8-bef9-439d045d0b9c tempest-SnapshotDependencyTests-677054290 None] Creating volume f6b0ee3d-0a56-476c-8760-241a8d4b57b4 {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:37:46 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-78a0b4ca-504f-47c8-bef9-439d045d0b9c tempest-SnapshotDependencyTests-677054290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:37:46 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-78a0b4ca-504f-47c8-bef9-439d045d0b9c tempest-SnapshotDependencyTests-677054290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:37:46 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-78a0b4ca-504f-47c8-bef9-439d045d0b9c tempest-SnapshotDependencyTests-677054290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:37:46 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-78a0b4ca-504f-47c8-bef9-439d045d0b9c tempest-SnapshotDependencyTests-677054290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:37:46 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-78a0b4ca-504f-47c8-bef9-439d045d0b9c tempest-SnapshotDependencyTests-677054290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:37:46 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-78a0b4ca-504f-47c8-bef9-439d045d0b9c tempest-SnapshotDependencyTests-677054290 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:37:46 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-78a0b4ca-504f-47c8-bef9-439d045d0b9c tempest-SnapshotDependencyTests-677054290 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:37:46 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-78a0b4ca-504f-47c8-bef9-439d045d0b9c tempest-SnapshotDependencyTests-677054290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f6b0ee3d-0a56-476c-8760-241a8d4b57b4 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:37:46 devstack sudo[104362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f6b0ee3d-0a56-476c-8760-241a8d4b57b4 1073741824 Sep 28 09:37:46 devstack sudo[104362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:37:47 devstack sudo[104362]: pam_unix(sudo:session): session closed for user root Sep 28 09:37:47 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-78a0b4ca-504f-47c8-bef9-439d045d0b9c tempest-SnapshotDependencyTests-677054290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f6b0ee3d-0a56-476c-8760-241a8d4b57b4 1073741824" returned: 0 in 0.549s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:37:47 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-78a0b4ca-504f-47c8-bef9-439d045d0b9c tempest-SnapshotDependencyTests-677054290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f6b0ee3d-0a56-476c-8760-241a8d4b57b4 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:37:47 devstack sudo[104369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f6b0ee3d-0a56-476c-8760-241a8d4b57b4 Sep 28 09:37:47 devstack sudo[104369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:37:47 devstack sudo[104369]: pam_unix(sudo:session): session closed for user root Sep 28 09:37:47 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-78a0b4ca-504f-47c8-bef9-439d045d0b9c tempest-SnapshotDependencyTests-677054290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f6b0ee3d-0a56-476c-8760-241a8d4b57b4" returned: 0 in 0.265s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:37:47 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-78a0b4ca-504f-47c8-bef9-439d045d0b9c tempest-SnapshotDependencyTests-677054290 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:37:47 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-78a0b4ca-504f-47c8-bef9-439d045d0b9c tempest-SnapshotDependencyTests-677054290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:37:47 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-78a0b4ca-504f-47c8-bef9-439d045d0b9c tempest-SnapshotDependencyTests-677054290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12c99c0a-789a-4a62-b306-0898ff8ed245) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6b0ee3d-0a56-476c-8760-241a8d4b57b4', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:37:47 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-78a0b4ca-504f-47c8-bef9-439d045d0b9c tempest-SnapshotDependencyTests-677054290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (558df565-0a36-4057-9dc0-90bf4a14de1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:37:47 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-78a0b4ca-504f-47c8-bef9-439d045d0b9c tempest-SnapshotDependencyTests-677054290 None] Volume volume-f6b0ee3d-0a56-476c-8760-241a8d4b57b4 (f6b0ee3d-0a56-476c-8760-241a8d4b57b4): created successfully Sep 28 09:37:47 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-78a0b4ca-504f-47c8-bef9-439d045d0b9c tempest-SnapshotDependencyTests-677054290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (558df565-0a36-4057-9dc0-90bf4a14de1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:37:47 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-78a0b4ca-504f-47c8-bef9-439d045d0b9c tempest-SnapshotDependencyTests-677054290 None] Flow 'volume_create_manager' (f9125cc6-558b-4060-88b4-a196b677e889) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:37:47 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-78a0b4ca-504f-47c8-bef9-439d045d0b9c tempest-SnapshotDependencyTests-677054290 None] Created volume successfully. Sep 28 09:37:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-1e3b1d43-b2c7-4a5f-8c60-37a8d2f44e0b tempest-SnapshotDependencyTests-677054290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:37:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-1e3b1d43-b2c7-4a5f-8c60-37a8d2f44e0b tempest-SnapshotDependencyTests-677054290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:37:49 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-1e3b1d43-b2c7-4a5f-8c60-37a8d2f44e0b tempest-SnapshotDependencyTests-677054290 None] Creating offline snapshot a9505b41-67e7-4217-bd51-7e7daa8b2c4e of volume f6b0ee3d-0a56-476c-8760-241a8d4b57b4 {{(pid=86553) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 09:37:49 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ed4052-1d34-43fa-9cdb-faeb350a1e80]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:37:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1e3b1d43-b2c7-4a5f-8c60-37a8d2f44e0b tempest-SnapshotDependencyTests-677054290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f6b0ee3d-0a56-476c-8760-241a8d4b57b4 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:37:49 devstack sudo[104373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f6b0ee3d-0a56-476c-8760-241a8d4b57b4 Sep 28 09:37:49 devstack sudo[104373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:37:49 devstack sudo[104373]: pam_unix(sudo:session): session closed for user root Sep 28 09:37:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1e3b1d43-b2c7-4a5f-8c60-37a8d2f44e0b tempest-SnapshotDependencyTests-677054290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f6b0ee3d-0a56-476c-8760-241a8d4b57b4" returned: 0 in 0.537s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:37:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1e3b1d43-b2c7-4a5f-8c60-37a8d2f44e0b tempest-SnapshotDependencyTests-677054290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f6b0ee3d-0a56-476c-8760-241a8d4b57b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f6b0ee3d-0a56-476c-8760-241a8d4b57b4.a9505b41-67e7-4217-bd51-7e7daa8b2c4e 1G {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:37:49 devstack sudo[104378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f6b0ee3d-0a56-476c-8760-241a8d4b57b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f6b0ee3d-0a56-476c-8760-241a8d4b57b4.a9505b41-67e7-4217-bd51-7e7daa8b2c4e 1G Sep 28 09:37:49 devstack sudo[104378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:37:50 devstack sudo[104378]: pam_unix(sudo:session): session closed for user root Sep 28 09:37:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1e3b1d43-b2c7-4a5f-8c60-37a8d2f44e0b tempest-SnapshotDependencyTests-677054290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f6b0ee3d-0a56-476c-8760-241a8d4b57b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f6b0ee3d-0a56-476c-8760-241a8d4b57b4.a9505b41-67e7-4217-bd51-7e7daa8b2c4e 1G" returned: 0 in 0.487s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:37:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1e3b1d43-b2c7-4a5f-8c60-37a8d2f44e0b tempest-SnapshotDependencyTests-677054290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6b0ee3d-0a56-476c-8760-241a8d4b57b4 -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f6b0ee3d-0a56-476c-8760-241a8d4b57b4.a9505b41-67e7-4217-bd51-7e7daa8b2c4e {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:37:50 devstack sudo[104384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6b0ee3d-0a56-476c-8760-241a8d4b57b4 -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f6b0ee3d-0a56-476c-8760-241a8d4b57b4.a9505b41-67e7-4217-bd51-7e7daa8b2c4e Sep 28 09:37:50 devstack sudo[104384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:37:50 devstack sudo[104384]: pam_unix(sudo:session): session closed for user root Sep 28 09:37:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1e3b1d43-b2c7-4a5f-8c60-37a8d2f44e0b tempest-SnapshotDependencyTests-677054290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6b0ee3d-0a56-476c-8760-241a8d4b57b4 -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f6b0ee3d-0a56-476c-8760-241a8d4b57b4.a9505b41-67e7-4217-bd51-7e7daa8b2c4e" returned: 0 in 0.344s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:37:50 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-1e3b1d43-b2c7-4a5f-8c60-37a8d2f44e0b tempest-SnapshotDependencyTests-677054290 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f6b0ee3d-0a56-476c-8760-241a8d4b57b4.a9505b41-67e7-4217-bd51-7e7daa8b2c4e is being set with open permissions: ugo+rw Sep 28 09:37:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1e3b1d43-b2c7-4a5f-8c60-37a8d2f44e0b tempest-SnapshotDependencyTests-677054290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f6b0ee3d-0a56-476c-8760-241a8d4b57b4.a9505b41-67e7-4217-bd51-7e7daa8b2c4e {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:37:50 devstack sudo[104389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f6b0ee3d-0a56-476c-8760-241a8d4b57b4.a9505b41-67e7-4217-bd51-7e7daa8b2c4e Sep 28 09:37:50 devstack sudo[104389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:37:50 devstack sudo[104389]: pam_unix(sudo:session): session closed for user root Sep 28 09:37:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1e3b1d43-b2c7-4a5f-8c60-37a8d2f44e0b tempest-SnapshotDependencyTests-677054290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f6b0ee3d-0a56-476c-8760-241a8d4b57b4.a9505b41-67e7-4217-bd51-7e7daa8b2c4e" returned: 0 in 0.293s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:37:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1e3b1d43-b2c7-4a5f-8c60-37a8d2f44e0b tempest-SnapshotDependencyTests-677054290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f6b0ee3d-0a56-476c-8760-241a8d4b57b4.info {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:37:50 devstack sudo[104392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f6b0ee3d-0a56-476c-8760-241a8d4b57b4.info Sep 28 09:37:50 devstack sudo[104392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:37:51 devstack sudo[104392]: pam_unix(sudo:session): session closed for user root Sep 28 09:37:51 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1e3b1d43-b2c7-4a5f-8c60-37a8d2f44e0b tempest-SnapshotDependencyTests-677054290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f6b0ee3d-0a56-476c-8760-241a8d4b57b4.info" returned: 0 in 0.316s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:37:51 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-1e3b1d43-b2c7-4a5f-8c60-37a8d2f44e0b tempest-SnapshotDependencyTests-677054290 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f6b0ee3d-0a56-476c-8760-241a8d4b57b4.info is being set with open permissions: ugo+rw Sep 28 09:37:51 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1e3b1d43-b2c7-4a5f-8c60-37a8d2f44e0b tempest-SnapshotDependencyTests-677054290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f6b0ee3d-0a56-476c-8760-241a8d4b57b4.info {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:37:51 devstack sudo[104395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f6b0ee3d-0a56-476c-8760-241a8d4b57b4.info Sep 28 09:37:51 devstack sudo[104395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:37:51 devstack sudo[104395]: pam_unix(sudo:session): session closed for user root Sep 28 09:37:51 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1e3b1d43-b2c7-4a5f-8c60-37a8d2f44e0b tempest-SnapshotDependencyTests-677054290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f6b0ee3d-0a56-476c-8760-241a8d4b57b4.info" returned: 0 in 0.323s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:37:51 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-1e3b1d43-b2c7-4a5f-8c60-37a8d2f44e0b tempest-SnapshotDependencyTests-677054290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.413s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:37:51 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-1e3b1d43-b2c7-4a5f-8c60-37a8d2f44e0b tempest-SnapshotDependencyTests-677054290 None] Create snapshot completed successfully Sep 28 09:37:52 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-b194a77b-aae9-49ee-8e74-e5086fdb6a95 tempest-SnapshotDependencyTests-677054290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:37:52 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b194a77b-aae9-49ee-8e74-e5086fdb6a95 tempest-SnapshotDependencyTests-677054290 None] Flow 'volume_create_manager' (81783267-d3ec-45a8-9c11-30cfabf0ea25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:37:52 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b194a77b-aae9-49ee-8e74-e5086fdb6a95 tempest-SnapshotDependencyTests-677054290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1489f52-4876-495b-8f96-41f5a2c0decc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:37:52 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b194a77b-aae9-49ee-8e74-e5086fdb6a95 tempest-SnapshotDependencyTests-677054290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1489f52-4876-495b-8f96-41f5a2c0decc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:37:52Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ab01306-9ef9-4f07-86ad-37a70e132318,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef6514c6f1274a048df9242e44ae3f47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:37:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a9505b41-67e7-4217-bd51-7e7daa8b2c4e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:37:53Z,use_quota=True,user_id='56be22a8ee764f718b9cfeb15e49ae86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:37:53 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b194a77b-aae9-49ee-8e74-e5086fdb6a95 tempest-SnapshotDependencyTests-677054290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f58b5f9-164a-4e3a-a454-203cfff1eec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:37:53 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b194a77b-aae9-49ee-8e74-e5086fdb6a95 tempest-SnapshotDependencyTests-677054290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f58b5f9-164a-4e3a-a454-203cfff1eec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:37:53 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b194a77b-aae9-49ee-8e74-e5086fdb6a95 tempest-SnapshotDependencyTests-677054290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ae95940-e9a9-438c-a21c-c345c5459f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:37:53 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b194a77b-aae9-49ee-8e74-e5086fdb6a95 tempest-SnapshotDependencyTests-677054290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ae95940-e9a9-438c-a21c-c345c5459f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0ab01306-9ef9-4f07-86ad-37a70e132318', 'volume_name': 'volume-0ab01306-9ef9-4f07-86ad-37a70e132318', 'volume_size': 1, 'snapshot_id': 'a9505b41-67e7-4217-bd51-7e7daa8b2c4e'}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:37:53 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b194a77b-aae9-49ee-8e74-e5086fdb6a95 tempest-SnapshotDependencyTests-677054290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be44bb36-05f4-4c96-bc2c-26684380b3c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:37:53 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b194a77b-aae9-49ee-8e74-e5086fdb6a95 tempest-SnapshotDependencyTests-677054290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be44bb36-05f4-4c96-bc2c-26684380b3c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:37:53 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b194a77b-aae9-49ee-8e74-e5086fdb6a95 tempest-SnapshotDependencyTests-677054290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b10b1fb1-0441-45ff-96ac-5d8e3caf2df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:37:53 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-b194a77b-aae9-49ee-8e74-e5086fdb6a95 tempest-SnapshotDependencyTests-677054290 None] Volume 0ab01306-9ef9-4f07-86ad-37a70e132318: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0ab01306-9ef9-4f07-86ad-37a70e132318', 'volume_size': 1, 'snapshot_id': 'a9505b41-67e7-4217-bd51-7e7daa8b2c4e'} Sep 28 09:37:53 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-b194a77b-aae9-49ee-8e74-e5086fdb6a95 tempest-SnapshotDependencyTests-677054290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:37:53 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-b194a77b-aae9-49ee-8e74-e5086fdb6a95 tempest-SnapshotDependencyTests-677054290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:37:53 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-b194a77b-aae9-49ee-8e74-e5086fdb6a95 tempest-SnapshotDependencyTests-677054290 None] Acquiring lock "cinder-quobyte-a9505b41-67e7-4217-bd51-7e7daa8b2c4e-0ab01306-9ef9-4f07-86ad-37a70e132318" by "_create_volume_from_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:37:53 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-b194a77b-aae9-49ee-8e74-e5086fdb6a95 tempest-SnapshotDependencyTests-677054290 None] Lock "cinder-quobyte-a9505b41-67e7-4217-bd51-7e7daa8b2c4e-0ab01306-9ef9-4f07-86ad-37a70e132318" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:37:53 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-b194a77b-aae9-49ee-8e74-e5086fdb6a95 tempest-SnapshotDependencyTests-677054290 None] Creating volume 0ab01306-9ef9-4f07-86ad-37a70e132318 from snapshot a9505b41-67e7-4217-bd51-7e7daa8b2c4e {{(pid=86553) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 09:37:53 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-b194a77b-aae9-49ee-8e74-e5086fdb6a95 tempest-SnapshotDependencyTests-677054290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:37:53 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-b194a77b-aae9-49ee-8e74-e5086fdb6a95 tempest-SnapshotDependencyTests-677054290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:37:53 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-b194a77b-aae9-49ee-8e74-e5086fdb6a95 tempest-SnapshotDependencyTests-677054290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:37:53 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-b194a77b-aae9-49ee-8e74-e5086fdb6a95 tempest-SnapshotDependencyTests-677054290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:37:53 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-b194a77b-aae9-49ee-8e74-e5086fdb6a95 tempest-SnapshotDependencyTests-677054290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:37:53 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-b194a77b-aae9-49ee-8e74-e5086fdb6a95 tempest-SnapshotDependencyTests-677054290 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:37:53 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-b194a77b-aae9-49ee-8e74-e5086fdb6a95 tempest-SnapshotDependencyTests-677054290 None] Acquiring lock "cinder-quobyte-0ab01306-9ef9-4f07-86ad-37a70e132318" by "_copy_volume_from_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:37:53 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-b194a77b-aae9-49ee-8e74-e5086fdb6a95 tempest-SnapshotDependencyTests-677054290 None] Lock "cinder-quobyte-0ab01306-9ef9-4f07-86ad-37a70e132318" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:37:53 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-b194a77b-aae9-49ee-8e74-e5086fdb6a95 tempest-SnapshotDependencyTests-677054290 None] snapshot: a9505b41-67e7-4217-bd51-7e7daa8b2c4e, volume: 0ab01306-9ef9-4f07-86ad-37a70e132318, {{(pid=86553) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 09:37:53 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-b194a77b-aae9-49ee-8e74-e5086fdb6a95 tempest-SnapshotDependencyTests-677054290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:37:53 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-b194a77b-aae9-49ee-8e74-e5086fdb6a95 tempest-SnapshotDependencyTests-677054290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:37:53 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-b194a77b-aae9-49ee-8e74-e5086fdb6a95 tempest-SnapshotDependencyTests-677054290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:37:53 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-b194a77b-aae9-49ee-8e74-e5086fdb6a95 tempest-SnapshotDependencyTests-677054290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:37:53 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-b194a77b-aae9-49ee-8e74-e5086fdb6a95 tempest-SnapshotDependencyTests-677054290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:37:53 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc55444-8be2-4d7d-a014-f1778a00979d]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:37:53 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b194a77b-aae9-49ee-8e74-e5086fdb6a95 tempest-SnapshotDependencyTests-677054290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f6b0ee3d-0a56-476c-8760-241a8d4b57b4.a9505b41-67e7-4217-bd51-7e7daa8b2c4e {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:37:53 devstack sudo[104399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f6b0ee3d-0a56-476c-8760-241a8d4b57b4.a9505b41-67e7-4217-bd51-7e7daa8b2c4e Sep 28 09:37:53 devstack sudo[104399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:37:53 devstack sudo[104399]: pam_unix(sudo:session): session closed for user root Sep 28 09:37:53 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b194a77b-aae9-49ee-8e74-e5086fdb6a95 tempest-SnapshotDependencyTests-677054290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f6b0ee3d-0a56-476c-8760-241a8d4b57b4.a9505b41-67e7-4217-bd51-7e7daa8b2c4e" returned: 0 in 0.486s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:37:53 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-b194a77b-aae9-49ee-8e74-e5086fdb6a95 tempest-SnapshotDependencyTests-677054290 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6b0ee3d-0a56-476c-8760-241a8d4b57b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86553) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 09:37:53 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d6c7936-1257-4178-9760-ed3c268a5dcc]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:37:53 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b194a77b-aae9-49ee-8e74-e5086fdb6a95 tempest-SnapshotDependencyTests-677054290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f6b0ee3d-0a56-476c-8760-241a8d4b57b4 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:37:53 devstack sudo[104405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f6b0ee3d-0a56-476c-8760-241a8d4b57b4 Sep 28 09:37:53 devstack sudo[104405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:37:54 devstack sudo[104405]: pam_unix(sudo:session): session closed for user root Sep 28 09:37:54 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b194a77b-aae9-49ee-8e74-e5086fdb6a95 tempest-SnapshotDependencyTests-677054290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f6b0ee3d-0a56-476c-8760-241a8d4b57b4" returned: 0 in 0.568s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:37:54 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-b194a77b-aae9-49ee-8e74-e5086fdb6a95 tempest-SnapshotDependencyTests-677054290 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f6b0ee3d-0a56-476c-8760-241a8d4b57b4 {{(pid=86553) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 09:37:54 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-b194a77b-aae9-49ee-8e74-e5086fdb6a95 tempest-SnapshotDependencyTests-677054290 None] Creating direct copy from snapshot {{(pid=86553) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 09:37:54 devstack cinder-volume[86553]: DEBUG cinder.utils [None req-b194a77b-aae9-49ee-8e74-e5086fdb6a95 tempest-SnapshotDependencyTests-677054290 None] Path /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-0ab01306-9ef9-4f07-86ad-37a70e132318 not found in is_blk_device check {{(pid=86553) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 09:37:54 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b194a77b-aae9-49ee-8e74-e5086fdb6a95 tempest-SnapshotDependencyTests-677054290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f6b0ee3d-0a56-476c-8760-241a8d4b57b4 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-0ab01306-9ef9-4f07-86ad-37a70e132318 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:37:54 devstack sudo[104411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f6b0ee3d-0a56-476c-8760-241a8d4b57b4 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-0ab01306-9ef9-4f07-86ad-37a70e132318 Sep 28 09:37:54 devstack sudo[104411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:00 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-21fbed53-1d73-4a9d-bcf8-073ee7a708da tempest-TestStampPattern-708957854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:38:00 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-21fbed53-1d73-4a9d-bcf8-073ee7a708da tempest-TestStampPattern-708957854 None] Flow 'volume_create_manager' (c4b204ef-7e59-48b9-8bae-d53cdde5aa82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:38:00 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-21fbed53-1d73-4a9d-bcf8-073ee7a708da tempest-TestStampPattern-708957854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f66ff50f-e5d1-4bda-b13f-6f2ecd125fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:00 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-21fbed53-1d73-4a9d-bcf8-073ee7a708da tempest-TestStampPattern-708957854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f66ff50f-e5d1-4bda-b13f-6f2ecd125fd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:37:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-507147971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8848ae3-33f7-4d6a-98ec-13d3d4d35dbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db4af088e25c49ae8289bcaf8acf0e68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:38:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:38:00Z,use_quota=True,user_id='2537de10964c48f685376d89e5bebdf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:00 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-21fbed53-1d73-4a9d-bcf8-073ee7a708da tempest-TestStampPattern-708957854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c6b879f-956f-4a67-bbdb-42040ec26cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:00 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-21fbed53-1d73-4a9d-bcf8-073ee7a708da tempest-TestStampPattern-708957854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c6b879f-956f-4a67-bbdb-42040ec26cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:00 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-21fbed53-1d73-4a9d-bcf8-073ee7a708da tempest-TestStampPattern-708957854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d62a6cac-f26b-45d8-b889-81bf1a588880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:00 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-21fbed53-1d73-4a9d-bcf8-073ee7a708da tempest-TestStampPattern-708957854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d62a6cac-f26b-45d8-b889-81bf1a588880) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8848ae3-33f7-4d6a-98ec-13d3d4d35dbd', 'volume_name': 'volume-f8848ae3-33f7-4d6a-98ec-13d3d4d35dbd', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:00 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-21fbed53-1d73-4a9d-bcf8-073ee7a708da tempest-TestStampPattern-708957854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55277e24-f03f-4d10-bc10-f13d87610c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:00 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-21fbed53-1d73-4a9d-bcf8-073ee7a708da tempest-TestStampPattern-708957854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55277e24-f03f-4d10-bc10-f13d87610c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:00 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-21fbed53-1d73-4a9d-bcf8-073ee7a708da tempest-TestStampPattern-708957854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f00b741-2cb5-4961-b15a-339fa2cdf704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:00 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-21fbed53-1d73-4a9d-bcf8-073ee7a708da tempest-TestStampPattern-708957854 None] Volume f8848ae3-33f7-4d6a-98ec-13d3d4d35dbd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8848ae3-33f7-4d6a-98ec-13d3d4d35dbd', 'volume_size': 1} Sep 28 09:38:00 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-21fbed53-1d73-4a9d-bcf8-073ee7a708da tempest-TestStampPattern-708957854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:38:03 devstack sudo[104411]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:03 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b194a77b-aae9-49ee-8e74-e5086fdb6a95 tempest-SnapshotDependencyTests-677054290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f6b0ee3d-0a56-476c-8760-241a8d4b57b4 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-0ab01306-9ef9-4f07-86ad-37a70e132318" returned: 0 in 9.513s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:03 devstack cinder-volume[86553]: DEBUG cinder.image.image_utils [None req-b194a77b-aae9-49ee-8e74-e5086fdb6a95 tempest-SnapshotDependencyTests-677054290 None] Image conversion details: src /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f6b0ee3d-0a56-476c-8760-241a8d4b57b4, size 1024.00 MB, duration 9.52 sec, destination /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-0ab01306-9ef9-4f07-86ad-37a70e132318 {{(pid=86553) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 09:38:03 devstack cinder-volume[86553]: INFO cinder.image.image_utils [None req-b194a77b-aae9-49ee-8e74-e5086fdb6a95 tempest-SnapshotDependencyTests-677054290 None] Converted 1024.00 MB image at 107.62 MB/s Sep 28 09:38:03 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-b194a77b-aae9-49ee-8e74-e5086fdb6a95 tempest-SnapshotDependencyTests-677054290 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-0ab01306-9ef9-4f07-86ad-37a70e132318 is being set with open permissions: ugo+rw Sep 28 09:38:03 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b194a77b-aae9-49ee-8e74-e5086fdb6a95 tempest-SnapshotDependencyTests-677054290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-0ab01306-9ef9-4f07-86ad-37a70e132318 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:03 devstack sudo[104432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-0ab01306-9ef9-4f07-86ad-37a70e132318 Sep 28 09:38:03 devstack sudo[104432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:04 devstack sudo[104432]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:04 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b194a77b-aae9-49ee-8e74-e5086fdb6a95 tempest-SnapshotDependencyTests-677054290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-0ab01306-9ef9-4f07-86ad-37a70e132318" returned: 0 in 0.369s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:04 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-b194a77b-aae9-49ee-8e74-e5086fdb6a95 tempest-SnapshotDependencyTests-677054290 None] Lock "cinder-quobyte-0ab01306-9ef9-4f07-86ad-37a70e132318" released by "_copy_volume_from_snapshot" :: held 11.094s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:38:04 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-b194a77b-aae9-49ee-8e74-e5086fdb6a95 tempest-SnapshotDependencyTests-677054290 None] Lock "cinder-quobyte-a9505b41-67e7-4217-bd51-7e7daa8b2c4e-0ab01306-9ef9-4f07-86ad-37a70e132318" released by "_create_volume_from_snapshot" :: held 11.198s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:38:04 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-b194a77b-aae9-49ee-8e74-e5086fdb6a95 tempest-SnapshotDependencyTests-677054290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.234s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:38:04 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-21fbed53-1d73-4a9d-bcf8-073ee7a708da tempest-TestStampPattern-708957854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.058s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:38:04 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-21fbed53-1d73-4a9d-bcf8-073ee7a708da tempest-TestStampPattern-708957854 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:37:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-507147971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8848ae3-33f7-4d6a-98ec-13d3d4d35dbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db4af088e25c49ae8289bcaf8acf0e68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:38:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:38:00Z,use_quota=True,user_id='2537de10964c48f685376d89e5bebdf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:38:04 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-21fbed53-1d73-4a9d-bcf8-073ee7a708da tempest-TestStampPattern-708957854 None] Creating volume f8848ae3-33f7-4d6a-98ec-13d3d4d35dbd {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:38:04 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-21fbed53-1d73-4a9d-bcf8-073ee7a708da tempest-TestStampPattern-708957854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:38:04 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-21fbed53-1d73-4a9d-bcf8-073ee7a708da tempest-TestStampPattern-708957854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:38:04 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-21fbed53-1d73-4a9d-bcf8-073ee7a708da tempest-TestStampPattern-708957854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:38:04 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-21fbed53-1d73-4a9d-bcf8-073ee7a708da tempest-TestStampPattern-708957854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:38:04 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-21fbed53-1d73-4a9d-bcf8-073ee7a708da tempest-TestStampPattern-708957854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:38:04 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-21fbed53-1d73-4a9d-bcf8-073ee7a708da tempest-TestStampPattern-708957854 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:38:04 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-21fbed53-1d73-4a9d-bcf8-073ee7a708da tempest-TestStampPattern-708957854 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:38:04 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-21fbed53-1d73-4a9d-bcf8-073ee7a708da tempest-TestStampPattern-708957854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f8848ae3-33f7-4d6a-98ec-13d3d4d35dbd 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:04 devstack sudo[104436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f8848ae3-33f7-4d6a-98ec-13d3d4d35dbd 1073741824 Sep 28 09:38:04 devstack sudo[104436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:04 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b194a77b-aae9-49ee-8e74-e5086fdb6a95 tempest-SnapshotDependencyTests-677054290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b10b1fb1-0441-45ff-96ac-5d8e3caf2df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ab01306-9ef9-4f07-86ad-37a70e132318', 'volume_size': 1, 'snapshot_id': 'a9505b41-67e7-4217-bd51-7e7daa8b2c4e'}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:04 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b194a77b-aae9-49ee-8e74-e5086fdb6a95 tempest-SnapshotDependencyTests-677054290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad52d572-768c-483f-aa00-546e6435e676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:04 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-b194a77b-aae9-49ee-8e74-e5086fdb6a95 tempest-SnapshotDependencyTests-677054290 None] Volume volume-0ab01306-9ef9-4f07-86ad-37a70e132318 (0ab01306-9ef9-4f07-86ad-37a70e132318): created successfully Sep 28 09:38:04 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b194a77b-aae9-49ee-8e74-e5086fdb6a95 tempest-SnapshotDependencyTests-677054290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad52d572-768c-483f-aa00-546e6435e676) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:04 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b194a77b-aae9-49ee-8e74-e5086fdb6a95 tempest-SnapshotDependencyTests-677054290 None] Flow 'volume_create_manager' (81783267-d3ec-45a8-9c11-30cfabf0ea25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:38:04 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-b194a77b-aae9-49ee-8e74-e5086fdb6a95 tempest-SnapshotDependencyTests-677054290 None] Created volume successfully. Sep 28 09:38:04 devstack sudo[104436]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:04 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-21fbed53-1d73-4a9d-bcf8-073ee7a708da tempest-TestStampPattern-708957854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f8848ae3-33f7-4d6a-98ec-13d3d4d35dbd 1073741824" returned: 0 in 0.606s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:04 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-21fbed53-1d73-4a9d-bcf8-073ee7a708da tempest-TestStampPattern-708957854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f8848ae3-33f7-4d6a-98ec-13d3d4d35dbd {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:04 devstack sudo[104442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f8848ae3-33f7-4d6a-98ec-13d3d4d35dbd Sep 28 09:38:04 devstack sudo[104442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:05 devstack sudo[104442]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:05 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-21fbed53-1d73-4a9d-bcf8-073ee7a708da tempest-TestStampPattern-708957854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f8848ae3-33f7-4d6a-98ec-13d3d4d35dbd" returned: 0 in 0.350s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:05 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-21fbed53-1d73-4a9d-bcf8-073ee7a708da tempest-TestStampPattern-708957854 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:38:05 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-21fbed53-1d73-4a9d-bcf8-073ee7a708da tempest-TestStampPattern-708957854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:38:05 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-21fbed53-1d73-4a9d-bcf8-073ee7a708da tempest-TestStampPattern-708957854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f00b741-2cb5-4961-b15a-339fa2cdf704) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8848ae3-33f7-4d6a-98ec-13d3d4d35dbd', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:05 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-21fbed53-1d73-4a9d-bcf8-073ee7a708da tempest-TestStampPattern-708957854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65a5c5fe-f5d4-4614-911e-db102e262242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:05 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-21fbed53-1d73-4a9d-bcf8-073ee7a708da tempest-TestStampPattern-708957854 None] Volume volume-f8848ae3-33f7-4d6a-98ec-13d3d4d35dbd (f8848ae3-33f7-4d6a-98ec-13d3d4d35dbd): created successfully Sep 28 09:38:05 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-21fbed53-1d73-4a9d-bcf8-073ee7a708da tempest-TestStampPattern-708957854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65a5c5fe-f5d4-4614-911e-db102e262242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:05 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-21fbed53-1d73-4a9d-bcf8-073ee7a708da tempest-TestStampPattern-708957854 None] Flow 'volume_create_manager' (c4b204ef-7e59-48b9-8bae-d53cdde5aa82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:38:05 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-21fbed53-1d73-4a9d-bcf8-073ee7a708da tempest-TestStampPattern-708957854 None] Created volume successfully. Sep 28 09:38:05 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-14ffd322-aff4-4f8a-851a-1a4e74841a0c tempest-SnapshotDependencyTests-677054290 None] Acquiring lock "cinder-a9505b41-67e7-4217-bd51-7e7daa8b2c4e-delete_snapshot" by "delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:38:05 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-14ffd322-aff4-4f8a-851a-1a4e74841a0c tempest-SnapshotDependencyTests-677054290 None] Lock "cinder-a9505b41-67e7-4217-bd51-7e7daa8b2c4e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:38:05 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-14ffd322-aff4-4f8a-851a-1a4e74841a0c tempest-SnapshotDependencyTests-677054290 None] Acquiring lock "cinder-quobyte-f6b0ee3d-0a56-476c-8760-241a8d4b57b4" by "delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:38:05 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-14ffd322-aff4-4f8a-851a-1a4e74841a0c tempest-SnapshotDependencyTests-677054290 None] Lock "cinder-quobyte-f6b0ee3d-0a56-476c-8760-241a8d4b57b4" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:38:05 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-14ffd322-aff4-4f8a-851a-1a4e74841a0c tempest-SnapshotDependencyTests-677054290 None] Acquiring lock "cinder-quobyte-a9505b41-67e7-4217-bd51-7e7daa8b2c4e" by "_delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:38:05 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-14ffd322-aff4-4f8a-851a-1a4e74841a0c tempest-SnapshotDependencyTests-677054290 None] Lock "cinder-quobyte-a9505b41-67e7-4217-bd51-7e7daa8b2c4e" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:38:05 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-14ffd322-aff4-4f8a-851a-1a4e74841a0c tempest-SnapshotDependencyTests-677054290 None] Deleting offline snapshot a9505b41-67e7-4217-bd51-7e7daa8b2c4e of volume f6b0ee3d-0a56-476c-8760-241a8d4b57b4 {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 09:38:05 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-14ffd322-aff4-4f8a-851a-1a4e74841a0c tempest-SnapshotDependencyTests-677054290 None] snapshot_file for this snap is: volume-f6b0ee3d-0a56-476c-8760-241a8d4b57b4.a9505b41-67e7-4217-bd51-7e7daa8b2c4e {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 09:38:05 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[5739bb11-1b13-47c1-b47f-c42dfb6488e9]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:38:05 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-14ffd322-aff4-4f8a-851a-1a4e74841a0c tempest-SnapshotDependencyTests-677054290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f6b0ee3d-0a56-476c-8760-241a8d4b57b4.a9505b41-67e7-4217-bd51-7e7daa8b2c4e {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:05 devstack sudo[104451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f6b0ee3d-0a56-476c-8760-241a8d4b57b4.a9505b41-67e7-4217-bd51-7e7daa8b2c4e Sep 28 09:38:05 devstack sudo[104451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:06 devstack sudo[104451]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-14ffd322-aff4-4f8a-851a-1a4e74841a0c tempest-SnapshotDependencyTests-677054290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f6b0ee3d-0a56-476c-8760-241a8d4b57b4.a9505b41-67e7-4217-bd51-7e7daa8b2c4e" returned: 0 in 0.643s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:06 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-14ffd322-aff4-4f8a-851a-1a4e74841a0c tempest-SnapshotDependencyTests-677054290 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6b0ee3d-0a56-476c-8760-241a8d4b57b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86553) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 09:38:06 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee9c50b-0d90-49aa-90d9-c42e7e7026aa]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:38:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-14ffd322-aff4-4f8a-851a-1a4e74841a0c tempest-SnapshotDependencyTests-677054290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f6b0ee3d-0a56-476c-8760-241a8d4b57b4 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:06 devstack sudo[104469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f6b0ee3d-0a56-476c-8760-241a8d4b57b4 Sep 28 09:38:06 devstack sudo[104469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:07 devstack sudo[104469]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:07 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-14ffd322-aff4-4f8a-851a-1a4e74841a0c tempest-SnapshotDependencyTests-677054290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f6b0ee3d-0a56-476c-8760-241a8d4b57b4" returned: 0 in 0.752s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:07 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-14ffd322-aff4-4f8a-851a-1a4e74841a0c tempest-SnapshotDependencyTests-677054290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f6b0ee3d-0a56-476c-8760-241a8d4b57b4.a9505b41-67e7-4217-bd51-7e7daa8b2c4e {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:07 devstack sudo[104474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f6b0ee3d-0a56-476c-8760-241a8d4b57b4.a9505b41-67e7-4217-bd51-7e7daa8b2c4e Sep 28 09:38:07 devstack sudo[104474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:07 devstack sudo[104474]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:07 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-14ffd322-aff4-4f8a-851a-1a4e74841a0c tempest-SnapshotDependencyTests-677054290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f6b0ee3d-0a56-476c-8760-241a8d4b57b4.a9505b41-67e7-4217-bd51-7e7daa8b2c4e" returned: 0 in 0.504s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:07 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-14ffd322-aff4-4f8a-851a-1a4e74841a0c tempest-SnapshotDependencyTests-677054290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f6b0ee3d-0a56-476c-8760-241a8d4b57b4.a9505b41-67e7-4217-bd51-7e7daa8b2c4e {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:07 devstack sudo[104480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f6b0ee3d-0a56-476c-8760-241a8d4b57b4.a9505b41-67e7-4217-bd51-7e7daa8b2c4e Sep 28 09:38:07 devstack sudo[104480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:08 devstack sudo[104480]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:08 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-14ffd322-aff4-4f8a-851a-1a4e74841a0c tempest-SnapshotDependencyTests-677054290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f6b0ee3d-0a56-476c-8760-241a8d4b57b4.a9505b41-67e7-4217-bd51-7e7daa8b2c4e" returned: 0 in 0.381s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:08 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-14ffd322-aff4-4f8a-851a-1a4e74841a0c tempest-SnapshotDependencyTests-677054290 None] Lock "cinder-quobyte-a9505b41-67e7-4217-bd51-7e7daa8b2c4e" released by "_delete_snapshot" :: held 2.457s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:38:08 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-14ffd322-aff4-4f8a-851a-1a4e74841a0c tempest-SnapshotDependencyTests-677054290 None] Lock "cinder-quobyte-f6b0ee3d-0a56-476c-8760-241a8d4b57b4" released by "delete_snapshot" :: held 2.505s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:38:08 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-14ffd322-aff4-4f8a-851a-1a4e74841a0c tempest-SnapshotDependencyTests-677054290 None] Created reservations ['aca69ca3-2132-4e1a-9cfc-40cad5c94fb4', '8b8b0158-c866-4993-ad23-38e6a800d738', 'a55be359-7e91-421a-a5c6-bccd13b09043', '48e57700-1fa1-4adc-a516-195b74414bae'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:38:08 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-b29e7221-c16d-4fd3-8539-f17bdb3abb58 tempest-VolumeAndVolumeTypeFromImageTest-1552104858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:38:08 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b29e7221-c16d-4fd3-8539-f17bdb3abb58 tempest-VolumeAndVolumeTypeFromImageTest-1552104858 None] Flow 'volume_create_manager' (939c15f0-786a-432c-8da6-693831f604e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:38:08 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b29e7221-c16d-4fd3-8539-f17bdb3abb58 tempest-VolumeAndVolumeTypeFromImageTest-1552104858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae7a9a78-6bb1-4a2c-b8b1-d0691251b871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:08 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b29e7221-c16d-4fd3-8539-f17bdb3abb58 tempest-VolumeAndVolumeTypeFromImageTest-1552104858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae7a9a78-6bb1-4a2c-b8b1-d0691251b871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:38:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bb46c84-5334-4b32-bf17-1af90d63728f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60d813257a2c41f88215cde2fe835df6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:38:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:38:08Z,use_quota=True,user_id='57f6f4e9f86a413d838e71e3fcc283e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a94166a-86e7-46e5-93d6-93337d272e4f),volume_type_id=9a94166a-86e7-46e5-93d6-93337d272e4f)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:08 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b29e7221-c16d-4fd3-8539-f17bdb3abb58 tempest-VolumeAndVolumeTypeFromImageTest-1552104858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51dbab07-4cee-4fc8-b494-25cce02bbc53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:08 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b29e7221-c16d-4fd3-8539-f17bdb3abb58 tempest-VolumeAndVolumeTypeFromImageTest-1552104858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51dbab07-4cee-4fc8-b494-25cce02bbc53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:08 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b29e7221-c16d-4fd3-8539-f17bdb3abb58 tempest-VolumeAndVolumeTypeFromImageTest-1552104858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12478ffc-d991-4f44-bfae-7d65f436dcee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:08 devstack cinder-volume[86553]: DEBUG cinder.image.glance [None req-b29e7221-c16d-4fd3-8539-f17bdb3abb58 tempest-VolumeAndVolumeTypeFromImageTest-1552104858 None] Creating Keystone auth plugin from conf {{(pid=86553) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 09:38:08 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-14ffd322-aff4-4f8a-851a-1a4e74841a0c tempest-SnapshotDependencyTests-677054290 None] Delete snapshot completed successfully. Sep 28 09:38:08 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-14ffd322-aff4-4f8a-851a-1a4e74841a0c tempest-SnapshotDependencyTests-677054290 None] Lock "cinder-a9505b41-67e7-4217-bd51-7e7daa8b2c4e-delete_snapshot" released by "delete_snapshot" :: held 2.765s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:38:08 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b29e7221-c16d-4fd3-8539-f17bdb3abb58 tempest-VolumeAndVolumeTypeFromImageTest-1552104858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12478ffc-d991-4f44-bfae-7d65f436dcee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9bb46c84-5334-4b32-bf17-1af90d63728f', 'volume_name': 'volume-9bb46c84-5334-4b32-bf17-1af90d63728f', 'volume_size': 1, 'image_id': '1f86c16f-e5e3-4dee-bfd2-93fe80d012e8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1f86c16f-e5e3-4dee-bfd2-93fe80d012e8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fbb454cef7d861444501e80f5737ad5d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '60d813257a2c41f88215cde2fe835df6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ef0a9f858d0110399bdabeec127849f6ba546d9b7ce832b7ec94a354ee02d5c73ab539186efd3a16c799031a05aa369c85bf5fd6e345336925461fbd819d0951', 'id': '1f86c16f-e5e3-4dee-bfd2-93fe80d012e8', 'created_at': datetime.datetime(2026, 9, 28, 7, 38, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 7, 38, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1f86c16f-e5e3-4dee-bfd2-93fe80d012e8/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:08 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b29e7221-c16d-4fd3-8539-f17bdb3abb58 tempest-VolumeAndVolumeTypeFromImageTest-1552104858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f02395e0-9462-437d-aa30-5b9ff142203f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:08 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b29e7221-c16d-4fd3-8539-f17bdb3abb58 tempest-VolumeAndVolumeTypeFromImageTest-1552104858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f02395e0-9462-437d-aa30-5b9ff142203f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:08 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b29e7221-c16d-4fd3-8539-f17bdb3abb58 tempest-VolumeAndVolumeTypeFromImageTest-1552104858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ec12680-26be-41be-8f60-0ba83b4fa689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:08 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-b29e7221-c16d-4fd3-8539-f17bdb3abb58 tempest-VolumeAndVolumeTypeFromImageTest-1552104858 None] Volume 9bb46c84-5334-4b32-bf17-1af90d63728f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9bb46c84-5334-4b32-bf17-1af90d63728f', 'volume_size': 1, 'image_id': '1f86c16f-e5e3-4dee-bfd2-93fe80d012e8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1f86c16f-e5e3-4dee-bfd2-93fe80d012e8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fbb454cef7d861444501e80f5737ad5d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '60d813257a2c41f88215cde2fe835df6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ef0a9f858d0110399bdabeec127849f6ba546d9b7ce832b7ec94a354ee02d5c73ab539186efd3a16c799031a05aa369c85bf5fd6e345336925461fbd819d0951', 'id': '1f86c16f-e5e3-4dee-bfd2-93fe80d012e8', 'created_at': datetime.datetime(2026, 9, 28, 7, 38, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 7, 38, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1f86c16f-e5e3-4dee-bfd2-93fe80d012e8/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 28 09:38:08 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-b29e7221-c16d-4fd3-8539-f17bdb3abb58 tempest-VolumeAndVolumeTypeFromImageTest-1552104858 None] Trying to clone 9bb46c84-5334-4b32-bf17-1af90d63728f from image 1f86c16f-e5e3-4dee-bfd2-93fe80d012e8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1f86c16f-e5e3-4dee-bfd2-93fe80d012e8', 'metadata': {}}]). {{(pid=86553) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 09:38:08 devstack cinder-volume[86553]: DEBUG cinder.image.image_utils [None req-b29e7221-c16d-4fd3-8539-f17bdb3abb58 tempest-VolumeAndVolumeTypeFromImageTest-1552104858 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1f86c16f-e5e3-4dee-bfd2-93fe80d012e8_fvu1xll5devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86553) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 09:38:08 devstack cinder-volume[86553]: INFO cinder.image.image_utils [None req-b29e7221-c16d-4fd3-8539-f17bdb3abb58 tempest-VolumeAndVolumeTypeFromImageTest-1552104858 None] Image download 0.00 MB at 0.00 MB/s Sep 28 09:38:08 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-c083cdb3-3575-4d5e-91a3-152d3766a439 tempest-SnapshotDependencyTests-677054290 None] Acquiring lock "cinder-f6b0ee3d-0a56-476c-8760-241a8d4b57b4-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:38:08 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-c083cdb3-3575-4d5e-91a3-152d3766a439 tempest-SnapshotDependencyTests-677054290 None] Lock "cinder-f6b0ee3d-0a56-476c-8760-241a8d4b57b4-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:38:08 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b7d631-5830-453e-82b0-ca6af04a487e]: (4, 'raw') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:38:08 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b29e7221-c16d-4fd3-8539-f17bdb3abb58 tempest-VolumeAndVolumeTypeFromImageTest-1552104858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1f86c16f-e5e3-4dee-bfd2-93fe80d012e8_fvu1xll5devstack@QuobyteHD {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:09 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-c083cdb3-3575-4d5e-91a3-152d3766a439 tempest-SnapshotDependencyTests-677054290 None] Acquiring lock "cinder-quobyte-f6b0ee3d-0a56-476c-8760-241a8d4b57b4" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:38:09 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-c083cdb3-3575-4d5e-91a3-152d3766a439 tempest-SnapshotDependencyTests-677054290 None] Lock "cinder-quobyte-f6b0ee3d-0a56-476c-8760-241a8d4b57b4" acquired by "delete_volume" :: waited 0.032s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:38:09 devstack sudo[104485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1f86c16f-e5e3-4dee-bfd2-93fe80d012e8_fvu1xll5devstack@QuobyteHD Sep 28 09:38:09 devstack sudo[104485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:09 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[a15e72ba-9ace-47aa-9854-fc3fbcb2e536]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:38:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c083cdb3-3575-4d5e-91a3-152d3766a439 tempest-SnapshotDependencyTests-677054290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f6b0ee3d-0a56-476c-8760-241a8d4b57b4 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:09 devstack sudo[104487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f6b0ee3d-0a56-476c-8760-241a8d4b57b4 Sep 28 09:38:09 devstack sudo[104487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:09 devstack sudo[104485]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b29e7221-c16d-4fd3-8539-f17bdb3abb58 tempest-VolumeAndVolumeTypeFromImageTest-1552104858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1f86c16f-e5e3-4dee-bfd2-93fe80d012e8_fvu1xll5devstack@QuobyteHD" returned: 0 in 0.531s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b29e7221-c16d-4fd3-8539-f17bdb3abb58 tempest-VolumeAndVolumeTypeFromImageTest-1552104858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f86c16f-e5e3-4dee-bfd2-93fe80d012e8_fvu1xll5devstack@QuobyteHD {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:09 devstack sudo[104491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f86c16f-e5e3-4dee-bfd2-93fe80d012e8_fvu1xll5devstack@QuobyteHD Sep 28 09:38:09 devstack sudo[104491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:09 devstack sudo[104487]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c083cdb3-3575-4d5e-91a3-152d3766a439 tempest-SnapshotDependencyTests-677054290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f6b0ee3d-0a56-476c-8760-241a8d4b57b4" returned: 0 in 0.518s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c083cdb3-3575-4d5e-91a3-152d3766a439 tempest-SnapshotDependencyTests-677054290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f6b0ee3d-0a56-476c-8760-241a8d4b57b4 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:09 devstack sudo[104496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f6b0ee3d-0a56-476c-8760-241a8d4b57b4 Sep 28 09:38:09 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-a203d55d-1dfc-4e73-80a3-3295cd0cfcb3 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:38:09 devstack sudo[104496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:09 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-a203d55d-1dfc-4e73-80a3-3295cd0cfcb3 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Flow 'volume_create_manager' (be60a2ba-097b-41aa-815b-b2ab27cbf315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:38:09 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-a203d55d-1dfc-4e73-80a3-3295cd0cfcb3 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fa65000-c17d-4f67-9b83-4aa11fee88f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:09 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-a203d55d-1dfc-4e73-80a3-3295cd0cfcb3 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fa65000-c17d-4f67-9b83-4aa11fee88f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:38:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2144004609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a88704c-3dbb-427e-9d2c-e8f39729f744,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3942022ccea0490bb02753e6a8be65c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:38:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:38:10Z,use_quota=True,user_id='4d5345b288bf46579a45b3cb1ee74eb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:09 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-a203d55d-1dfc-4e73-80a3-3295cd0cfcb3 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62482dc5-a52b-403d-84b7-5a060151f887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:09 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-a203d55d-1dfc-4e73-80a3-3295cd0cfcb3 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62482dc5-a52b-403d-84b7-5a060151f887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:09 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-a203d55d-1dfc-4e73-80a3-3295cd0cfcb3 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0c98829-9a71-44a9-801b-55a7e188cb50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:09 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-a203d55d-1dfc-4e73-80a3-3295cd0cfcb3 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0c98829-9a71-44a9-801b-55a7e188cb50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a88704c-3dbb-427e-9d2c-e8f39729f744', 'volume_name': 'volume-1a88704c-3dbb-427e-9d2c-e8f39729f744', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:09 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-a203d55d-1dfc-4e73-80a3-3295cd0cfcb3 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (194edba0-fc7b-458d-84bb-4e85f5251f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:09 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-a203d55d-1dfc-4e73-80a3-3295cd0cfcb3 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (194edba0-fc7b-458d-84bb-4e85f5251f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:10 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-a203d55d-1dfc-4e73-80a3-3295cd0cfcb3 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8322e7b-ef9f-47e1-8513-838dbe91e04c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:10 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-a203d55d-1dfc-4e73-80a3-3295cd0cfcb3 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Volume 1a88704c-3dbb-427e-9d2c-e8f39729f744: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a88704c-3dbb-427e-9d2c-e8f39729f744', 'volume_size': 1} Sep 28 09:38:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-a203d55d-1dfc-4e73-80a3-3295cd0cfcb3 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:38:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-a203d55d-1dfc-4e73-80a3-3295cd0cfcb3 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:38:10 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-a203d55d-1dfc-4e73-80a3-3295cd0cfcb3 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:38:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2144004609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a88704c-3dbb-427e-9d2c-e8f39729f744,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3942022ccea0490bb02753e6a8be65c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:38:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:38:10Z,use_quota=True,user_id='4d5345b288bf46579a45b3cb1ee74eb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:38:10 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-a203d55d-1dfc-4e73-80a3-3295cd0cfcb3 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Creating volume 1a88704c-3dbb-427e-9d2c-e8f39729f744 {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:38:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-a203d55d-1dfc-4e73-80a3-3295cd0cfcb3 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:38:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-a203d55d-1dfc-4e73-80a3-3295cd0cfcb3 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:38:10 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-a203d55d-1dfc-4e73-80a3-3295cd0cfcb3 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:38:10 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-a203d55d-1dfc-4e73-80a3-3295cd0cfcb3 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:38:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-a203d55d-1dfc-4e73-80a3-3295cd0cfcb3 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:38:10 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-a203d55d-1dfc-4e73-80a3-3295cd0cfcb3 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:38:10 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-a203d55d-1dfc-4e73-80a3-3295cd0cfcb3 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:38:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a203d55d-1dfc-4e73-80a3-3295cd0cfcb3 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1a88704c-3dbb-427e-9d2c-e8f39729f744 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:10 devstack sudo[104516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1a88704c-3dbb-427e-9d2c-e8f39729f744 1073741824 Sep 28 09:38:10 devstack sudo[104516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:10 devstack sudo[104491]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b29e7221-c16d-4fd3-8539-f17bdb3abb58 tempest-VolumeAndVolumeTypeFromImageTest-1552104858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f86c16f-e5e3-4dee-bfd2-93fe80d012e8_fvu1xll5devstack@QuobyteHD" returned: 1 in 0.752s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b29e7221-c16d-4fd3-8539-f17bdb3abb58 tempest-VolumeAndVolumeTypeFromImageTest-1552104858 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f86c16f-e5e3-4dee-bfd2-93fe80d012e8_fvu1xll5devstack@QuobyteHD' failed. Not Retrying. {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 09:38:10 devstack cinder-volume[86553]: DEBUG cinder.image.image_utils [None req-b29e7221-c16d-4fd3-8539-f17bdb3abb58 tempest-VolumeAndVolumeTypeFromImageTest-1552104858 None] Temporary image 1f86c16f-e5e3-4dee-bfd2-93fe80d012e8 is fetched for user 57f6f4e9f86a413d838e71e3fcc283e5. {{(pid=86553) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 09:38:10 devstack sudo[104496]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c083cdb3-3575-4d5e-91a3-152d3766a439 tempest-SnapshotDependencyTests-677054290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f6b0ee3d-0a56-476c-8760-241a8d4b57b4" returned: 0 in 0.659s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:10 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-c083cdb3-3575-4d5e-91a3-152d3766a439 tempest-SnapshotDependencyTests-677054290 None] Lock "cinder-quobyte-f6b0ee3d-0a56-476c-8760-241a8d4b57b4" released by "delete_volume" :: held 1.312s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:38:10 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[83efe20c-e56f-4891-95c6-e66ad7ed903c]: (4, 'raw') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:38:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b29e7221-c16d-4fd3-8539-f17bdb3abb58 tempest-VolumeAndVolumeTypeFromImageTest-1552104858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1f86c16f-e5e3-4dee-bfd2-93fe80d012e8_fvu1xll5devstack@QuobyteHD {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:10 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-c083cdb3-3575-4d5e-91a3-152d3766a439 tempest-SnapshotDependencyTests-677054290 None] Created reservations ['65a5c650-971f-4551-9dee-6a1f016fcf26', '7ffe61f4-d3ce-471c-b750-9c0995472078', '19caa6e7-53c9-4ca1-a882-fbc37dc11889', '3379d842-b6cf-4dcd-82c9-c67197067fc4'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:38:10 devstack sudo[104544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1f86c16f-e5e3-4dee-bfd2-93fe80d012e8_fvu1xll5devstack@QuobyteHD Sep 28 09:38:10 devstack sudo[104544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-c083cdb3-3575-4d5e-91a3-152d3766a439 tempest-SnapshotDependencyTests-677054290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:38:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-c083cdb3-3575-4d5e-91a3-152d3766a439 tempest-SnapshotDependencyTests-677054290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:38:10 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-c083cdb3-3575-4d5e-91a3-152d3766a439 tempest-SnapshotDependencyTests-677054290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:38:10 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-c083cdb3-3575-4d5e-91a3-152d3766a439 tempest-SnapshotDependencyTests-677054290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:38:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-c083cdb3-3575-4d5e-91a3-152d3766a439 tempest-SnapshotDependencyTests-677054290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:38:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c083cdb3-3575-4d5e-91a3-152d3766a439 tempest-SnapshotDependencyTests-677054290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:10 devstack sudo[104557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:38:10 devstack sudo[104557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:10 devstack sudo[104516]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a203d55d-1dfc-4e73-80a3-3295cd0cfcb3 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1a88704c-3dbb-427e-9d2c-e8f39729f744 1073741824" returned: 0 in 0.937s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:11 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a203d55d-1dfc-4e73-80a3-3295cd0cfcb3 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1a88704c-3dbb-427e-9d2c-e8f39729f744 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:11 devstack sudo[104557]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:11 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c083cdb3-3575-4d5e-91a3-152d3766a439 tempest-SnapshotDependencyTests-677054290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.406s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:11 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-c083cdb3-3575-4d5e-91a3-152d3766a439 tempest-SnapshotDependencyTests-677054290 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:38:11 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-c083cdb3-3575-4d5e-91a3-152d3766a439 tempest-SnapshotDependencyTests-677054290 None] Deleted volume successfully. Sep 28 09:38:11 devstack sudo[104544]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:11 devstack sudo[104573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1a88704c-3dbb-427e-9d2c-e8f39729f744 Sep 28 09:38:11 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b29e7221-c16d-4fd3-8539-f17bdb3abb58 tempest-VolumeAndVolumeTypeFromImageTest-1552104858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1f86c16f-e5e3-4dee-bfd2-93fe80d012e8_fvu1xll5devstack@QuobyteHD" returned: 0 in 0.664s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:11 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b29e7221-c16d-4fd3-8539-f17bdb3abb58 tempest-VolumeAndVolumeTypeFromImageTest-1552104858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f86c16f-e5e3-4dee-bfd2-93fe80d012e8_fvu1xll5devstack@QuobyteHD {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:11 devstack sudo[104573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:11 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-c083cdb3-3575-4d5e-91a3-152d3766a439 tempest-SnapshotDependencyTests-677054290 None] Lock "cinder-f6b0ee3d-0a56-476c-8760-241a8d4b57b4-delete_volume" released by "delete_volume" :: held 2.296s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:38:11 devstack sudo[104575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f86c16f-e5e3-4dee-bfd2-93fe80d012e8_fvu1xll5devstack@QuobyteHD Sep 28 09:38:11 devstack sudo[104575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:11 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-4919d1c6-02f6-497e-8a79-3b8af40c6788 tempest-SnapshotDependencyTests-677054290 None] Acquiring lock "cinder-0ab01306-9ef9-4f07-86ad-37a70e132318-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:38:11 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-4919d1c6-02f6-497e-8a79-3b8af40c6788 tempest-SnapshotDependencyTests-677054290 None] Lock "cinder-0ab01306-9ef9-4f07-86ad-37a70e132318-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:38:11 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-4919d1c6-02f6-497e-8a79-3b8af40c6788 tempest-SnapshotDependencyTests-677054290 None] Acquiring lock "cinder-quobyte-0ab01306-9ef9-4f07-86ad-37a70e132318" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:38:11 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-4919d1c6-02f6-497e-8a79-3b8af40c6788 tempest-SnapshotDependencyTests-677054290 None] Lock "cinder-quobyte-0ab01306-9ef9-4f07-86ad-37a70e132318" acquired by "delete_volume" :: waited 0.035s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:38:11 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[81923e66-bd5c-492a-b478-486cf87a4e08]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:38:11 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-4919d1c6-02f6-497e-8a79-3b8af40c6788 tempest-SnapshotDependencyTests-677054290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-0ab01306-9ef9-4f07-86ad-37a70e132318 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:11 devstack sudo[104573]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:11 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a203d55d-1dfc-4e73-80a3-3295cd0cfcb3 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1a88704c-3dbb-427e-9d2c-e8f39729f744" returned: 0 in 0.566s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:11 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-a203d55d-1dfc-4e73-80a3-3295cd0cfcb3 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] <== create_volume: return (1615ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:38:11 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-a203d55d-1dfc-4e73-80a3-3295cd0cfcb3 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.619s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:38:11 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-a203d55d-1dfc-4e73-80a3-3295cd0cfcb3 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8322e7b-ef9f-47e1-8513-838dbe91e04c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a88704c-3dbb-427e-9d2c-e8f39729f744', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:11 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-a203d55d-1dfc-4e73-80a3-3295cd0cfcb3 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4aaabc4-3bd7-4664-a805-74a217694714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:11 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-a203d55d-1dfc-4e73-80a3-3295cd0cfcb3 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Volume volume-1a88704c-3dbb-427e-9d2c-e8f39729f744 (1a88704c-3dbb-427e-9d2c-e8f39729f744): created successfully Sep 28 09:38:11 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-a203d55d-1dfc-4e73-80a3-3295cd0cfcb3 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4aaabc4-3bd7-4664-a805-74a217694714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:11 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-a203d55d-1dfc-4e73-80a3-3295cd0cfcb3 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Flow 'volume_create_manager' (be60a2ba-097b-41aa-815b-b2ab27cbf315) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:38:11 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-a203d55d-1dfc-4e73-80a3-3295cd0cfcb3 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Created volume successfully. Sep 28 09:38:11 devstack sudo[104591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-0ab01306-9ef9-4f07-86ad-37a70e132318 Sep 28 09:38:11 devstack sudo[104591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:11 devstack sudo[104575]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:11 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b29e7221-c16d-4fd3-8539-f17bdb3abb58 tempest-VolumeAndVolumeTypeFromImageTest-1552104858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f86c16f-e5e3-4dee-bfd2-93fe80d012e8_fvu1xll5devstack@QuobyteHD" returned: 1 in 0.646s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:11 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b29e7221-c16d-4fd3-8539-f17bdb3abb58 tempest-VolumeAndVolumeTypeFromImageTest-1552104858 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f86c16f-e5e3-4dee-bfd2-93fe80d012e8_fvu1xll5devstack@QuobyteHD' failed. Not Retrying. {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 09:38:11 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-b29e7221-c16d-4fd3-8539-f17bdb3abb58 tempest-VolumeAndVolumeTypeFromImageTest-1552104858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:38:11 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-b29e7221-c16d-4fd3-8539-f17bdb3abb58 tempest-VolumeAndVolumeTypeFromImageTest-1552104858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:38:11 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-b29e7221-c16d-4fd3-8539-f17bdb3abb58 tempest-VolumeAndVolumeTypeFromImageTest-1552104858 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:38:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bb46c84-5334-4b32-bf17-1af90d63728f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60d813257a2c41f88215cde2fe835df6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:38:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:38:08Z,use_quota=True,user_id='57f6f4e9f86a413d838e71e3fcc283e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a94166a-86e7-46e5-93d6-93337d272e4f),volume_type_id=9a94166a-86e7-46e5-93d6-93337d272e4f)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:38:11 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-b29e7221-c16d-4fd3-8539-f17bdb3abb58 tempest-VolumeAndVolumeTypeFromImageTest-1552104858 None] Creating volume 9bb46c84-5334-4b32-bf17-1af90d63728f {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:38:11 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-b29e7221-c16d-4fd3-8539-f17bdb3abb58 tempest-VolumeAndVolumeTypeFromImageTest-1552104858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:38:11 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-b29e7221-c16d-4fd3-8539-f17bdb3abb58 tempest-VolumeAndVolumeTypeFromImageTest-1552104858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:38:11 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-b29e7221-c16d-4fd3-8539-f17bdb3abb58 tempest-VolumeAndVolumeTypeFromImageTest-1552104858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:38:11 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-b29e7221-c16d-4fd3-8539-f17bdb3abb58 tempest-VolumeAndVolumeTypeFromImageTest-1552104858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:38:11 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-b29e7221-c16d-4fd3-8539-f17bdb3abb58 tempest-VolumeAndVolumeTypeFromImageTest-1552104858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:38:11 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-b29e7221-c16d-4fd3-8539-f17bdb3abb58 tempest-VolumeAndVolumeTypeFromImageTest-1552104858 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:38:11 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-b29e7221-c16d-4fd3-8539-f17bdb3abb58 tempest-VolumeAndVolumeTypeFromImageTest-1552104858 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:38:11 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b29e7221-c16d-4fd3-8539-f17bdb3abb58 tempest-VolumeAndVolumeTypeFromImageTest-1552104858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9bb46c84-5334-4b32-bf17-1af90d63728f 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:11 devstack sudo[104607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9bb46c84-5334-4b32-bf17-1af90d63728f 1073741824 Sep 28 09:38:11 devstack sudo[104607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:12 devstack sudo[104591]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:12 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-4919d1c6-02f6-497e-8a79-3b8af40c6788 tempest-SnapshotDependencyTests-677054290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-0ab01306-9ef9-4f07-86ad-37a70e132318" returned: 0 in 0.480s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:12 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-4919d1c6-02f6-497e-8a79-3b8af40c6788 tempest-SnapshotDependencyTests-677054290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-0ab01306-9ef9-4f07-86ad-37a70e132318 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:12 devstack sudo[104616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-0ab01306-9ef9-4f07-86ad-37a70e132318 Sep 28 09:38:12 devstack sudo[104616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:12 devstack sudo[104607]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:12 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b29e7221-c16d-4fd3-8539-f17bdb3abb58 tempest-VolumeAndVolumeTypeFromImageTest-1552104858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9bb46c84-5334-4b32-bf17-1af90d63728f 1073741824" returned: 0 in 0.516s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:12 devstack sudo[104616]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:12 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-4919d1c6-02f6-497e-8a79-3b8af40c6788 tempest-SnapshotDependencyTests-677054290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-0ab01306-9ef9-4f07-86ad-37a70e132318" returned: 0 in 0.278s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:12 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-4919d1c6-02f6-497e-8a79-3b8af40c6788 tempest-SnapshotDependencyTests-677054290 None] Lock "cinder-quobyte-0ab01306-9ef9-4f07-86ad-37a70e132318" released by "delete_volume" :: held 0.830s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:38:12 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b29e7221-c16d-4fd3-8539-f17bdb3abb58 tempest-VolumeAndVolumeTypeFromImageTest-1552104858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9bb46c84-5334-4b32-bf17-1af90d63728f {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:12 devstack sudo[104620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9bb46c84-5334-4b32-bf17-1af90d63728f Sep 28 09:38:12 devstack sudo[104620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:12 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-4919d1c6-02f6-497e-8a79-3b8af40c6788 tempest-SnapshotDependencyTests-677054290 None] Created reservations ['ac3f53c7-e00b-4382-8bc0-32a76946db35', '128eb501-e7da-48d3-8d6f-2db516cec618', 'd35e250f-1a8d-43f3-8db4-93798f21d646', 'ada5ae72-ac19-4770-9cf1-569192c85414'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:38:12 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-4919d1c6-02f6-497e-8a79-3b8af40c6788 tempest-SnapshotDependencyTests-677054290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:38:12 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-4919d1c6-02f6-497e-8a79-3b8af40c6788 tempest-SnapshotDependencyTests-677054290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:38:12 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-4919d1c6-02f6-497e-8a79-3b8af40c6788 tempest-SnapshotDependencyTests-677054290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:38:12 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-4919d1c6-02f6-497e-8a79-3b8af40c6788 tempest-SnapshotDependencyTests-677054290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:38:12 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-4919d1c6-02f6-497e-8a79-3b8af40c6788 tempest-SnapshotDependencyTests-677054290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:38:12 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-4919d1c6-02f6-497e-8a79-3b8af40c6788 tempest-SnapshotDependencyTests-677054290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:12 devstack sudo[104622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:38:12 devstack sudo[104622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:12 devstack sudo[104620]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:12 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b29e7221-c16d-4fd3-8539-f17bdb3abb58 tempest-VolumeAndVolumeTypeFromImageTest-1552104858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9bb46c84-5334-4b32-bf17-1af90d63728f" returned: 0 in 0.367s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:12 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-b29e7221-c16d-4fd3-8539-f17bdb3abb58 tempest-VolumeAndVolumeTypeFromImageTest-1552104858 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:38:12 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-b29e7221-c16d-4fd3-8539-f17bdb3abb58 tempest-VolumeAndVolumeTypeFromImageTest-1552104858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:38:12 devstack cinder-volume[86553]: DEBUG cinder.volume.volume_utils [None req-b29e7221-c16d-4fd3-8539-f17bdb3abb58 tempest-VolumeAndVolumeTypeFromImageTest-1552104858 None] Attempting download of 1f86c16f-e5e3-4dee-bfd2-93fe80d012e8 ((None, [{'url': 'file:///opt/stack/data/glance/images/1f86c16f-e5e3-4dee-bfd2-93fe80d012e8', 'metadata': {}}])) to volume 9bb46c84-5334-4b32-bf17-1af90d63728f. {{(pid=86553) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 09:38:12 devstack sudo[104622]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:13 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef246e9-8197-4a36-b55a-a07f2a07b321]: (4, 'raw') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:38:13 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b29e7221-c16d-4fd3-8539-f17bdb3abb58 tempest-VolumeAndVolumeTypeFromImageTest-1552104858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1f86c16f-e5e3-4dee-bfd2-93fe80d012e8_butndu22 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:13 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-4919d1c6-02f6-497e-8a79-3b8af40c6788 tempest-SnapshotDependencyTests-677054290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.539s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:13 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-4919d1c6-02f6-497e-8a79-3b8af40c6788 tempest-SnapshotDependencyTests-677054290 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:38:13 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-4919d1c6-02f6-497e-8a79-3b8af40c6788 tempest-SnapshotDependencyTests-677054290 None] Deleted volume successfully. Sep 28 09:38:13 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-4919d1c6-02f6-497e-8a79-3b8af40c6788 tempest-SnapshotDependencyTests-677054290 None] Lock "cinder-0ab01306-9ef9-4f07-86ad-37a70e132318-delete_volume" released by "delete_volume" :: held 1.757s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:38:13 devstack sudo[104628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1f86c16f-e5e3-4dee-bfd2-93fe80d012e8_butndu22 Sep 28 09:38:13 devstack sudo[104628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:13 devstack sudo[104628]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:13 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b29e7221-c16d-4fd3-8539-f17bdb3abb58 tempest-VolumeAndVolumeTypeFromImageTest-1552104858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1f86c16f-e5e3-4dee-bfd2-93fe80d012e8_butndu22" returned: 0 in 0.736s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:13 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b29e7221-c16d-4fd3-8539-f17bdb3abb58 tempest-VolumeAndVolumeTypeFromImageTest-1552104858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1f86c16f-e5e3-4dee-bfd2-93fe80d012e8_butndu22 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:13 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-95e58156-40e9-4c45-8d31-092408814d26 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:38:13 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-95e58156-40e9-4c45-8d31-092408814d26 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Flow 'volume_create_manager' (055d5bd6-3e59-475f-8a77-c695a85355fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:38:13 devstack sudo[104632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1f86c16f-e5e3-4dee-bfd2-93fe80d012e8_butndu22 Sep 28 09:38:13 devstack sudo[104632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:13 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-95e58156-40e9-4c45-8d31-092408814d26 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55a0eff9-3f71-48d1-b074-cf64d2e7fba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:13 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-95e58156-40e9-4c45-8d31-092408814d26 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55a0eff9-3f71-48d1-b074-cf64d2e7fba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:38:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1822406120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e444684-f857-4b70-889a-1ffb683b1cf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3942022ccea0490bb02753e6a8be65c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:38:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:38:14Z,use_quota=True,user_id='4d5345b288bf46579a45b3cb1ee74eb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:13 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-95e58156-40e9-4c45-8d31-092408814d26 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f091f78-c9f4-42af-a64a-f79e14343b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:13 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-95e58156-40e9-4c45-8d31-092408814d26 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f091f78-c9f4-42af-a64a-f79e14343b8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:14 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-95e58156-40e9-4c45-8d31-092408814d26 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34a8de7d-e02d-4ebe-83a2-9e3f71564c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:14 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-95e58156-40e9-4c45-8d31-092408814d26 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34a8de7d-e02d-4ebe-83a2-9e3f71564c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e444684-f857-4b70-889a-1ffb683b1cf6', 'volume_name': 'volume-5e444684-f857-4b70-889a-1ffb683b1cf6', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:14 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-95e58156-40e9-4c45-8d31-092408814d26 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55b845c0-612c-4ac2-b806-bedf3d453f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:14 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-95e58156-40e9-4c45-8d31-092408814d26 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55b845c0-612c-4ac2-b806-bedf3d453f25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:14 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-95e58156-40e9-4c45-8d31-092408814d26 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32f2e870-b240-4eda-9d31-511b4057c054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:14 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-95e58156-40e9-4c45-8d31-092408814d26 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Volume 5e444684-f857-4b70-889a-1ffb683b1cf6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e444684-f857-4b70-889a-1ffb683b1cf6', 'volume_size': 1} Sep 28 09:38:14 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-95e58156-40e9-4c45-8d31-092408814d26 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:38:14 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-95e58156-40e9-4c45-8d31-092408814d26 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:38:14 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-95e58156-40e9-4c45-8d31-092408814d26 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:38:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1822406120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e444684-f857-4b70-889a-1ffb683b1cf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3942022ccea0490bb02753e6a8be65c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:38:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:38:14Z,use_quota=True,user_id='4d5345b288bf46579a45b3cb1ee74eb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:38:14 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-95e58156-40e9-4c45-8d31-092408814d26 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Creating volume 5e444684-f857-4b70-889a-1ffb683b1cf6 {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:38:14 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-95e58156-40e9-4c45-8d31-092408814d26 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:38:14 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-95e58156-40e9-4c45-8d31-092408814d26 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:38:14 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-95e58156-40e9-4c45-8d31-092408814d26 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:38:14 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-95e58156-40e9-4c45-8d31-092408814d26 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:38:14 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-95e58156-40e9-4c45-8d31-092408814d26 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:38:14 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-95e58156-40e9-4c45-8d31-092408814d26 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:38:14 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-95e58156-40e9-4c45-8d31-092408814d26 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:38:14 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-95e58156-40e9-4c45-8d31-092408814d26 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-5e444684-f857-4b70-889a-1ffb683b1cf6 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:14 devstack sudo[104634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-5e444684-f857-4b70-889a-1ffb683b1cf6 1073741824 Sep 28 09:38:14 devstack sudo[104634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:14 devstack sudo[104632]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:14 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b29e7221-c16d-4fd3-8539-f17bdb3abb58 tempest-VolumeAndVolumeTypeFromImageTest-1552104858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1f86c16f-e5e3-4dee-bfd2-93fe80d012e8_butndu22" returned: 1 in 0.540s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:14 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b29e7221-c16d-4fd3-8539-f17bdb3abb58 tempest-VolumeAndVolumeTypeFromImageTest-1552104858 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1f86c16f-e5e3-4dee-bfd2-93fe80d012e8_butndu22' failed. Not Retrying. {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 09:38:14 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[9246ce8d-e14c-46e7-8cda-d4f4c1424d65]: (4, 'raw') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:38:14 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b29e7221-c16d-4fd3-8539-f17bdb3abb58 tempest-VolumeAndVolumeTypeFromImageTest-1552104858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1f86c16f-e5e3-4dee-bfd2-93fe80d012e8_fvu1xll5devstack@QuobyteHD {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:14 devstack sudo[104638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1f86c16f-e5e3-4dee-bfd2-93fe80d012e8_fvu1xll5devstack@QuobyteHD Sep 28 09:38:14 devstack sudo[104638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:14 devstack sudo[104638]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:14 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b29e7221-c16d-4fd3-8539-f17bdb3abb58 tempest-VolumeAndVolumeTypeFromImageTest-1552104858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1f86c16f-e5e3-4dee-bfd2-93fe80d012e8_fvu1xll5devstack@QuobyteHD" returned: 0 in 0.569s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:14 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b29e7221-c16d-4fd3-8539-f17bdb3abb58 tempest-VolumeAndVolumeTypeFromImageTest-1552104858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f86c16f-e5e3-4dee-bfd2-93fe80d012e8_fvu1xll5devstack@QuobyteHD {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:14 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9e1dcd0-ec74-4ab7-8f61-8ad42dc2afbe tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:38:14 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-d9e1dcd0-ec74-4ab7-8f61-8ad42dc2afbe tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Flow 'volume_create_manager' (5a5af1c8-0f0e-4686-ac15-65e9b427452a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:38:15 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-d9e1dcd0-ec74-4ab7-8f61-8ad42dc2afbe tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2180cc73-8c77-4f26-bb3c-c61adb52e22b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:15 devstack sudo[104634]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:15 devstack sudo[104646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f86c16f-e5e3-4dee-bfd2-93fe80d012e8_fvu1xll5devstack@QuobyteHD Sep 28 09:38:15 devstack sudo[104646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:15 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-95e58156-40e9-4c45-8d31-092408814d26 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-5e444684-f857-4b70-889a-1ffb683b1cf6 1073741824" returned: 0 in 1.099s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:15 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-d9e1dcd0-ec74-4ab7-8f61-8ad42dc2afbe tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2180cc73-8c77-4f26-bb3c-c61adb52e22b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:38:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1616327653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30fe1b43-0bee-432f-afda-a9278693caa2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3942022ccea0490bb02753e6a8be65c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:38:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:38:15Z,use_quota=True,user_id='4d5345b288bf46579a45b3cb1ee74eb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:15 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-d9e1dcd0-ec74-4ab7-8f61-8ad42dc2afbe tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12809200-4ead-433b-80ce-5c9a01f4dec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:15 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-d9e1dcd0-ec74-4ab7-8f61-8ad42dc2afbe tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12809200-4ead-433b-80ce-5c9a01f4dec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:15 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-d9e1dcd0-ec74-4ab7-8f61-8ad42dc2afbe tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e0fe1c9-4292-4f47-82c9-9d29d4a9a9f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:15 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-d9e1dcd0-ec74-4ab7-8f61-8ad42dc2afbe tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e0fe1c9-4292-4f47-82c9-9d29d4a9a9f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30fe1b43-0bee-432f-afda-a9278693caa2', 'volume_name': 'volume-30fe1b43-0bee-432f-afda-a9278693caa2', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:15 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-d9e1dcd0-ec74-4ab7-8f61-8ad42dc2afbe tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c71f7838-3935-4708-b418-930b2e1317f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:15 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-d9e1dcd0-ec74-4ab7-8f61-8ad42dc2afbe tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c71f7838-3935-4708-b418-930b2e1317f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:15 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-d9e1dcd0-ec74-4ab7-8f61-8ad42dc2afbe tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (463f1f04-0b47-49c9-9062-8dd77dd9bbed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:15 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-d9e1dcd0-ec74-4ab7-8f61-8ad42dc2afbe tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Volume 30fe1b43-0bee-432f-afda-a9278693caa2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30fe1b43-0bee-432f-afda-a9278693caa2', 'volume_size': 1} Sep 28 09:38:15 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-d9e1dcd0-ec74-4ab7-8f61-8ad42dc2afbe tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:38:15 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-95e58156-40e9-4c45-8d31-092408814d26 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-5e444684-f857-4b70-889a-1ffb683b1cf6 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:15 devstack sudo[104648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-5e444684-f857-4b70-889a-1ffb683b1cf6 Sep 28 09:38:15 devstack sudo[104648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:15 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7808ece-fd8b-414f-8841-878e17ec64dd tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:38:15 devstack sudo[104646]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:15 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e7808ece-fd8b-414f-8841-878e17ec64dd tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Flow 'volume_create_manager' (3d96de31-3af9-484d-83ee-58c9cc567207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:38:15 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e7808ece-fd8b-414f-8841-878e17ec64dd tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (468b143e-c73d-4f8b-ad70-e49cb9453534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:15 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b29e7221-c16d-4fd3-8539-f17bdb3abb58 tempest-VolumeAndVolumeTypeFromImageTest-1552104858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f86c16f-e5e3-4dee-bfd2-93fe80d012e8_fvu1xll5devstack@QuobyteHD" returned: 1 in 0.979s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:15 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b29e7221-c16d-4fd3-8539-f17bdb3abb58 tempest-VolumeAndVolumeTypeFromImageTest-1552104858 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f86c16f-e5e3-4dee-bfd2-93fe80d012e8_fvu1xll5devstack@QuobyteHD' failed. Not Retrying. {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 09:38:15 devstack cinder-volume[86553]: DEBUG cinder.image.image_utils [None req-b29e7221-c16d-4fd3-8539-f17bdb3abb58 tempest-VolumeAndVolumeTypeFromImageTest-1552104858 None] 1f86c16f-e5e3-4dee-bfd2-93fe80d012e8 was raw, converting to qcow2 {{(pid=86553) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 09:38:15 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b29e7221-c16d-4fd3-8539-f17bdb3abb58 tempest-VolumeAndVolumeTypeFromImageTest-1552104858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1f86c16f-e5e3-4dee-bfd2-93fe80d012e8_fvu1xll5devstack@QuobyteHD /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9bb46c84-5334-4b32-bf17-1af90d63728f {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:15 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e7808ece-fd8b-414f-8841-878e17ec64dd tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (468b143e-c73d-4f8b-ad70-e49cb9453534) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:38:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1766098346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ea53125-4c75-4cc9-b0a1-29ae8c9567fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3942022ccea0490bb02753e6a8be65c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:38:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:38:16Z,use_quota=True,user_id='4d5345b288bf46579a45b3cb1ee74eb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:15 devstack sudo[104648]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:15 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e7808ece-fd8b-414f-8841-878e17ec64dd tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6e7f977-eba8-49aa-8330-9a76decf6817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:16 devstack sudo[104655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1f86c16f-e5e3-4dee-bfd2-93fe80d012e8_fvu1xll5devstack@QuobyteHD /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9bb46c84-5334-4b32-bf17-1af90d63728f Sep 28 09:38:16 devstack sudo[104655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:16 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e7808ece-fd8b-414f-8841-878e17ec64dd tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6e7f977-eba8-49aa-8330-9a76decf6817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:16 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e7808ece-fd8b-414f-8841-878e17ec64dd tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcc1af0b-6e34-49ac-843b-c8d76c54a5a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:16 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e7808ece-fd8b-414f-8841-878e17ec64dd tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcc1af0b-6e34-49ac-843b-c8d76c54a5a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ea53125-4c75-4cc9-b0a1-29ae8c9567fe', 'volume_name': 'volume-3ea53125-4c75-4cc9-b0a1-29ae8c9567fe', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:16 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e7808ece-fd8b-414f-8841-878e17ec64dd tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95275020-3d0b-4af9-8258-73a469f73ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:16 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e7808ece-fd8b-414f-8841-878e17ec64dd tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95275020-3d0b-4af9-8258-73a469f73ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:16 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e7808ece-fd8b-414f-8841-878e17ec64dd tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20b4f023-32d3-4c26-8f3f-a47d100a1fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:16 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-e7808ece-fd8b-414f-8841-878e17ec64dd tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Volume 3ea53125-4c75-4cc9-b0a1-29ae8c9567fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ea53125-4c75-4cc9-b0a1-29ae8c9567fe', 'volume_size': 1} Sep 28 09:38:16 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-e7808ece-fd8b-414f-8841-878e17ec64dd tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:38:16 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-95e58156-40e9-4c45-8d31-092408814d26 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-5e444684-f857-4b70-889a-1ffb683b1cf6" returned: 0 in 0.794s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:16 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-95e58156-40e9-4c45-8d31-092408814d26 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] <== create_volume: return (2058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:38:16 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-95e58156-40e9-4c45-8d31-092408814d26 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.061s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:38:16 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-d9e1dcd0-ec74-4ab7-8f61-8ad42dc2afbe tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.876s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:38:16 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-d9e1dcd0-ec74-4ab7-8f61-8ad42dc2afbe tempest-CreateVolumesFromSourceVolumeTest-729336995 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:38:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1616327653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30fe1b43-0bee-432f-afda-a9278693caa2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3942022ccea0490bb02753e6a8be65c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:38:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:38:15Z,use_quota=True,user_id='4d5345b288bf46579a45b3cb1ee74eb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:38:16 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-d9e1dcd0-ec74-4ab7-8f61-8ad42dc2afbe tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Creating volume 30fe1b43-0bee-432f-afda-a9278693caa2 {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:38:16 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-d9e1dcd0-ec74-4ab7-8f61-8ad42dc2afbe tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:38:16 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-d9e1dcd0-ec74-4ab7-8f61-8ad42dc2afbe tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:38:16 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-d9e1dcd0-ec74-4ab7-8f61-8ad42dc2afbe tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:38:16 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-d9e1dcd0-ec74-4ab7-8f61-8ad42dc2afbe tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:38:16 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-d9e1dcd0-ec74-4ab7-8f61-8ad42dc2afbe tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:38:16 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-d9e1dcd0-ec74-4ab7-8f61-8ad42dc2afbe tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:38:16 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-d9e1dcd0-ec74-4ab7-8f61-8ad42dc2afbe tempest-CreateVolumesFromSourceVolumeTest-729336995 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:38:16 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-d9e1dcd0-ec74-4ab7-8f61-8ad42dc2afbe tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-30fe1b43-0bee-432f-afda-a9278693caa2 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:16 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-95e58156-40e9-4c45-8d31-092408814d26 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32f2e870-b240-4eda-9d31-511b4057c054) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e444684-f857-4b70-889a-1ffb683b1cf6', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:16 devstack sudo[104657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-30fe1b43-0bee-432f-afda-a9278693caa2 1073741824 Sep 28 09:38:16 devstack sudo[104657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:16 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-95e58156-40e9-4c45-8d31-092408814d26 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8db8fffb-0ab6-4309-b2f4-fac2c67dd22c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:16 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-95e58156-40e9-4c45-8d31-092408814d26 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Volume volume-5e444684-f857-4b70-889a-1ffb683b1cf6 (5e444684-f857-4b70-889a-1ffb683b1cf6): created successfully Sep 28 09:38:16 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-95e58156-40e9-4c45-8d31-092408814d26 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8db8fffb-0ab6-4309-b2f4-fac2c67dd22c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:16 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-95e58156-40e9-4c45-8d31-092408814d26 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Flow 'volume_create_manager' (055d5bd6-3e59-475f-8a77-c695a85355fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:38:16 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-95e58156-40e9-4c45-8d31-092408814d26 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Created volume successfully. Sep 28 09:38:16 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c601e13-e65b-414f-9303-590d8629069c tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:38:16 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-6c601e13-e65b-414f-9303-590d8629069c tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Flow 'volume_create_manager' (ef335aec-0607-4991-8e29-90c43959905b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:38:16 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-6c601e13-e65b-414f-9303-590d8629069c tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1008ed37-2eb8-4bfe-a62f-5aad76359180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:16 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-6c601e13-e65b-414f-9303-590d8629069c tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1008ed37-2eb8-4bfe-a62f-5aad76359180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:38:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1017381080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8682be18-c9f5-4776-b581-910316119542,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3942022ccea0490bb02753e6a8be65c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:38:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:38:17Z,use_quota=True,user_id='4d5345b288bf46579a45b3cb1ee74eb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:16 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-6c601e13-e65b-414f-9303-590d8629069c tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7e66291-8b39-485e-b8d5-5481046fc281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:16 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-6c601e13-e65b-414f-9303-590d8629069c tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7e66291-8b39-485e-b8d5-5481046fc281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:16 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-6c601e13-e65b-414f-9303-590d8629069c tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7013cea1-9f9c-49ae-8e54-18c1b4d60151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:16 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-6c601e13-e65b-414f-9303-590d8629069c tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7013cea1-9f9c-49ae-8e54-18c1b4d60151) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8682be18-c9f5-4776-b581-910316119542', 'volume_name': 'volume-8682be18-c9f5-4776-b581-910316119542', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:16 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-6c601e13-e65b-414f-9303-590d8629069c tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dddb691-2223-4a1c-9af4-7a448cdd7f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:16 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-6c601e13-e65b-414f-9303-590d8629069c tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dddb691-2223-4a1c-9af4-7a448cdd7f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:16 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-6c601e13-e65b-414f-9303-590d8629069c tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75a4d1b8-dcec-470b-956a-a1c461c8f467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:16 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-6c601e13-e65b-414f-9303-590d8629069c tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Volume 8682be18-c9f5-4776-b581-910316119542: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8682be18-c9f5-4776-b581-910316119542', 'volume_size': 1} Sep 28 09:38:16 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-6c601e13-e65b-414f-9303-590d8629069c tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:38:17 devstack sudo[104655]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:17 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b29e7221-c16d-4fd3-8539-f17bdb3abb58 tempest-VolumeAndVolumeTypeFromImageTest-1552104858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1f86c16f-e5e3-4dee-bfd2-93fe80d012e8_fvu1xll5devstack@QuobyteHD /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9bb46c84-5334-4b32-bf17-1af90d63728f" returned: 0 in 1.295s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:17 devstack cinder-volume[86553]: DEBUG cinder.image.image_utils [None req-b29e7221-c16d-4fd3-8539-f17bdb3abb58 tempest-VolumeAndVolumeTypeFromImageTest-1552104858 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1f86c16f-e5e3-4dee-bfd2-93fe80d012e8_fvu1xll5devstack@QuobyteHD, size 0.00 MB, duration 1.30 sec, destination /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9bb46c84-5334-4b32-bf17-1af90d63728f {{(pid=86553) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 09:38:17 devstack cinder-volume[86553]: INFO cinder.image.image_utils [None req-b29e7221-c16d-4fd3-8539-f17bdb3abb58 tempest-VolumeAndVolumeTypeFromImageTest-1552104858 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 09:38:17 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b29e7221-c16d-4fd3-8539-f17bdb3abb58 tempest-VolumeAndVolumeTypeFromImageTest-1552104858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9bb46c84-5334-4b32-bf17-1af90d63728f 1G {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:17 devstack sudo[104657]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:17 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-d9e1dcd0-ec74-4ab7-8f61-8ad42dc2afbe tempest-CreateVolumesFromSourceVolumeTest-729336995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-30fe1b43-0bee-432f-afda-a9278693caa2 1073741824" returned: 0 in 1.070s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:17 devstack sudo[104666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9bb46c84-5334-4b32-bf17-1af90d63728f 1G Sep 28 09:38:17 devstack sudo[104666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:17 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-d9e1dcd0-ec74-4ab7-8f61-8ad42dc2afbe tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-30fe1b43-0bee-432f-afda-a9278693caa2 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:17 devstack sudo[104668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-30fe1b43-0bee-432f-afda-a9278693caa2 Sep 28 09:38:17 devstack sudo[104668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:17 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9084a9a-345c-4382-a64a-a5af46675400 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:38:17 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e9084a9a-345c-4382-a64a-a5af46675400 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Flow 'volume_create_manager' (0313dee9-a949-4ba4-a9ea-f1a6448a6d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:38:17 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e9084a9a-345c-4382-a64a-a5af46675400 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf929709-3037-4e9e-b8a5-e6731629bbbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:17 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e9084a9a-345c-4382-a64a-a5af46675400 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf929709-3037-4e9e-b8a5-e6731629bbbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:38:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-733040467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0998a984-b6b3-426a-a03a-a3656762381b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3942022ccea0490bb02753e6a8be65c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:38:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:38:17Z,use_quota=True,user_id='4d5345b288bf46579a45b3cb1ee74eb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:17 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e9084a9a-345c-4382-a64a-a5af46675400 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44112692-aaa2-4f31-bb83-15b3cb0318b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:17 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e9084a9a-345c-4382-a64a-a5af46675400 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44112692-aaa2-4f31-bb83-15b3cb0318b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:17 devstack sudo[104668]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:17 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e9084a9a-345c-4382-a64a-a5af46675400 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f439108-7728-43e7-a0c5-003dce459b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:17 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e9084a9a-345c-4382-a64a-a5af46675400 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f439108-7728-43e7-a0c5-003dce459b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0998a984-b6b3-426a-a03a-a3656762381b', 'volume_name': 'volume-0998a984-b6b3-426a-a03a-a3656762381b', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:17 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e9084a9a-345c-4382-a64a-a5af46675400 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0052e2e-0c5d-4779-8b6e-7db356d33e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:17 devstack sudo[104666]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:17 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e9084a9a-345c-4382-a64a-a5af46675400 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0052e2e-0c5d-4779-8b6e-7db356d33e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:17 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e9084a9a-345c-4382-a64a-a5af46675400 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4058f656-50f3-494c-807b-da538ce17236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:17 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-e9084a9a-345c-4382-a64a-a5af46675400 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Volume 0998a984-b6b3-426a-a03a-a3656762381b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0998a984-b6b3-426a-a03a-a3656762381b', 'volume_size': 1} Sep 28 09:38:17 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-e9084a9a-345c-4382-a64a-a5af46675400 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:38:17 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-d9e1dcd0-ec74-4ab7-8f61-8ad42dc2afbe tempest-CreateVolumesFromSourceVolumeTest-729336995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-30fe1b43-0bee-432f-afda-a9278693caa2" returned: 0 in 0.461s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:17 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-d9e1dcd0-ec74-4ab7-8f61-8ad42dc2afbe tempest-CreateVolumesFromSourceVolumeTest-729336995 None] <== create_volume: return (1622ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:38:17 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-d9e1dcd0-ec74-4ab7-8f61-8ad42dc2afbe tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.626s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:38:17 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b29e7221-c16d-4fd3-8539-f17bdb3abb58 tempest-VolumeAndVolumeTypeFromImageTest-1552104858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9bb46c84-5334-4b32-bf17-1af90d63728f 1G" returned: 0 in 0.546s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:17 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-e7808ece-fd8b-414f-8841-878e17ec64dd tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.658s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:38:17 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-e7808ece-fd8b-414f-8841-878e17ec64dd tempest-CreateVolumesFromSourceVolumeTest-729336995 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:38:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1766098346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ea53125-4c75-4cc9-b0a1-29ae8c9567fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3942022ccea0490bb02753e6a8be65c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:38:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:38:16Z,use_quota=True,user_id='4d5345b288bf46579a45b3cb1ee74eb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:38:17 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-e7808ece-fd8b-414f-8841-878e17ec64dd tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Creating volume 3ea53125-4c75-4cc9-b0a1-29ae8c9567fe {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:38:17 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-e7808ece-fd8b-414f-8841-878e17ec64dd tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:38:17 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-e7808ece-fd8b-414f-8841-878e17ec64dd tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:38:17 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-e7808ece-fd8b-414f-8841-878e17ec64dd tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:38:17 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-e7808ece-fd8b-414f-8841-878e17ec64dd tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:38:17 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-e7808ece-fd8b-414f-8841-878e17ec64dd tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:38:17 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-e7808ece-fd8b-414f-8841-878e17ec64dd tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:38:17 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-e7808ece-fd8b-414f-8841-878e17ec64dd tempest-CreateVolumesFromSourceVolumeTest-729336995 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:38:17 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e7808ece-fd8b-414f-8841-878e17ec64dd tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ea53125-4c75-4cc9-b0a1-29ae8c9567fe 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:17 devstack cinder-volume[86553]: DEBUG cinder.volume.volume_utils [None req-b29e7221-c16d-4fd3-8539-f17bdb3abb58 tempest-VolumeAndVolumeTypeFromImageTest-1552104858 None] Downloaded image 1f86c16f-e5e3-4dee-bfd2-93fe80d012e8 ((None, [{'url': 'file:///opt/stack/data/glance/images/1f86c16f-e5e3-4dee-bfd2-93fe80d012e8', 'metadata': {}}])) to volume 9bb46c84-5334-4b32-bf17-1af90d63728f successfully. {{(pid=86553) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 09:38:17 devstack cinder-volume[86553]: DEBUG cinder.image.image_utils [None req-b29e7221-c16d-4fd3-8539-f17bdb3abb58 tempest-VolumeAndVolumeTypeFromImageTest-1552104858 None] Temporary image 1f86c16f-e5e3-4dee-bfd2-93fe80d012e8 for user 57f6f4e9f86a413d838e71e3fcc283e5 is deleted. {{(pid=86553) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 09:38:17 devstack cinder-volume[86553]: DEBUG cinder.volume.volume_utils [None req-b29e7221-c16d-4fd3-8539-f17bdb3abb58 tempest-VolumeAndVolumeTypeFromImageTest-1552104858 None] Marking volume 9bb46c84-5334-4b32-bf17-1af90d63728f as bootable. {{(pid=86553) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 09:38:17 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-b29e7221-c16d-4fd3-8539-f17bdb3abb58 tempest-VolumeAndVolumeTypeFromImageTest-1552104858 None] Copying metadata from image 1f86c16f-e5e3-4dee-bfd2-93fe80d012e8 to 9bb46c84-5334-4b32-bf17-1af90d63728f. {{(pid=86553) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 09:38:17 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-b29e7221-c16d-4fd3-8539-f17bdb3abb58 tempest-VolumeAndVolumeTypeFromImageTest-1552104858 None] Creating volume glance metadata for volume 9bb46c84-5334-4b32-bf17-1af90d63728f backed by image 1f86c16f-e5e3-4dee-bfd2-93fe80d012e8 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '1f86c16f-e5e3-4dee-bfd2-93fe80d012e8', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'fbb454cef7d861444501e80f5737ad5d', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86553) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 09:38:17 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-d9e1dcd0-ec74-4ab7-8f61-8ad42dc2afbe tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (463f1f04-0b47-49c9-9062-8dd77dd9bbed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30fe1b43-0bee-432f-afda-a9278693caa2', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:17 devstack sudo[104675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ea53125-4c75-4cc9-b0a1-29ae8c9567fe 1073741824 Sep 28 09:38:17 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-d9e1dcd0-ec74-4ab7-8f61-8ad42dc2afbe tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc9b3156-201c-4dcf-9ecb-c46889b807eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:17 devstack sudo[104675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:17 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-d9e1dcd0-ec74-4ab7-8f61-8ad42dc2afbe tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Volume volume-30fe1b43-0bee-432f-afda-a9278693caa2 (30fe1b43-0bee-432f-afda-a9278693caa2): created successfully Sep 28 09:38:17 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-d9e1dcd0-ec74-4ab7-8f61-8ad42dc2afbe tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc9b3156-201c-4dcf-9ecb-c46889b807eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:17 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-d9e1dcd0-ec74-4ab7-8f61-8ad42dc2afbe tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Flow 'volume_create_manager' (5a5af1c8-0f0e-4686-ac15-65e9b427452a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:38:17 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-d9e1dcd0-ec74-4ab7-8f61-8ad42dc2afbe tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Created volume successfully. Sep 28 09:38:17 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b29e7221-c16d-4fd3-8539-f17bdb3abb58 tempest-VolumeAndVolumeTypeFromImageTest-1552104858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ec12680-26be-41be-8f60-0ba83b4fa689) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bb46c84-5334-4b32-bf17-1af90d63728f', 'volume_size': 1, 'image_id': '1f86c16f-e5e3-4dee-bfd2-93fe80d012e8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1f86c16f-e5e3-4dee-bfd2-93fe80d012e8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fbb454cef7d861444501e80f5737ad5d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '60d813257a2c41f88215cde2fe835df6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ef0a9f858d0110399bdabeec127849f6ba546d9b7ce832b7ec94a354ee02d5c73ab539186efd3a16c799031a05aa369c85bf5fd6e345336925461fbd819d0951', 'id': '1f86c16f-e5e3-4dee-bfd2-93fe80d012e8', 'created_at': datetime.datetime(2026, 9, 28, 7, 38, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 7, 38, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1f86c16f-e5e3-4dee-bfd2-93fe80d012e8/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:17 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b29e7221-c16d-4fd3-8539-f17bdb3abb58 tempest-VolumeAndVolumeTypeFromImageTest-1552104858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de98882d-17b8-484b-816c-4cc54899b4b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:17 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-b29e7221-c16d-4fd3-8539-f17bdb3abb58 tempest-VolumeAndVolumeTypeFromImageTest-1552104858 None] Volume volume-9bb46c84-5334-4b32-bf17-1af90d63728f (9bb46c84-5334-4b32-bf17-1af90d63728f): created successfully Sep 28 09:38:18 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b29e7221-c16d-4fd3-8539-f17bdb3abb58 tempest-VolumeAndVolumeTypeFromImageTest-1552104858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de98882d-17b8-484b-816c-4cc54899b4b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:18 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b29e7221-c16d-4fd3-8539-f17bdb3abb58 tempest-VolumeAndVolumeTypeFromImageTest-1552104858 None] Flow 'volume_create_manager' (939c15f0-786a-432c-8da6-693831f604e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:38:18 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-b29e7221-c16d-4fd3-8539-f17bdb3abb58 tempest-VolumeAndVolumeTypeFromImageTest-1552104858 None] Created volume successfully. Sep 28 09:38:18 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-30fb357a-6f0d-46d4-af58-51182d84ac17 tempest-VolumeAndVolumeTypeFromImageTest-1552104858 None] Acquiring lock "cinder-9bb46c84-5334-4b32-bf17-1af90d63728f-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:38:18 devstack sudo[104675]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:18 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e7808ece-fd8b-414f-8841-878e17ec64dd tempest-CreateVolumesFromSourceVolumeTest-729336995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ea53125-4c75-4cc9-b0a1-29ae8c9567fe 1073741824" returned: 0 in 0.938s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:18 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-30fb357a-6f0d-46d4-af58-51182d84ac17 tempest-VolumeAndVolumeTypeFromImageTest-1552104858 None] Lock "cinder-9bb46c84-5334-4b32-bf17-1af90d63728f-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:38:18 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e7808ece-fd8b-414f-8841-878e17ec64dd tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ea53125-4c75-4cc9-b0a1-29ae8c9567fe {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:18 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-30fb357a-6f0d-46d4-af58-51182d84ac17 tempest-VolumeAndVolumeTypeFromImageTest-1552104858 None] Acquiring lock "cinder-quobyte-9bb46c84-5334-4b32-bf17-1af90d63728f" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:38:18 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-30fb357a-6f0d-46d4-af58-51182d84ac17 tempest-VolumeAndVolumeTypeFromImageTest-1552104858 None] Lock "cinder-quobyte-9bb46c84-5334-4b32-bf17-1af90d63728f" acquired by "delete_volume" :: waited 0.024s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:38:18 devstack sudo[104683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ea53125-4c75-4cc9-b0a1-29ae8c9567fe Sep 28 09:38:18 devstack sudo[104683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:18 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4bd6df5-c89e-45d9-9ae4-5884fc59d1e0]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:38:18 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-30fb357a-6f0d-46d4-af58-51182d84ac17 tempest-VolumeAndVolumeTypeFromImageTest-1552104858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9bb46c84-5334-4b32-bf17-1af90d63728f {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:19 devstack sudo[104685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9bb46c84-5334-4b32-bf17-1af90d63728f Sep 28 09:38:19 devstack sudo[104685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:19 devstack sudo[104683]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:19 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e7808ece-fd8b-414f-8841-878e17ec64dd tempest-CreateVolumesFromSourceVolumeTest-729336995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ea53125-4c75-4cc9-b0a1-29ae8c9567fe" returned: 0 in 0.433s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:19 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-e7808ece-fd8b-414f-8841-878e17ec64dd tempest-CreateVolumesFromSourceVolumeTest-729336995 None] <== create_volume: return (1455ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:38:19 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-e7808ece-fd8b-414f-8841-878e17ec64dd tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.460s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:38:19 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-6c601e13-e65b-414f-9303-590d8629069c tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.229s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:38:19 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-6c601e13-e65b-414f-9303-590d8629069c tempest-CreateVolumesFromSourceVolumeTest-729336995 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:38:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1017381080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8682be18-c9f5-4776-b581-910316119542,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3942022ccea0490bb02753e6a8be65c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:38:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:38:17Z,use_quota=True,user_id='4d5345b288bf46579a45b3cb1ee74eb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:38:19 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-6c601e13-e65b-414f-9303-590d8629069c tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Creating volume 8682be18-c9f5-4776-b581-910316119542 {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:38:19 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-6c601e13-e65b-414f-9303-590d8629069c tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:38:19 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-6c601e13-e65b-414f-9303-590d8629069c tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:38:19 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-6c601e13-e65b-414f-9303-590d8629069c tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:38:19 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-6c601e13-e65b-414f-9303-590d8629069c tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:38:19 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-6c601e13-e65b-414f-9303-590d8629069c tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:38:19 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-6c601e13-e65b-414f-9303-590d8629069c tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:38:19 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-6c601e13-e65b-414f-9303-590d8629069c tempest-CreateVolumesFromSourceVolumeTest-729336995 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:38:19 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-6c601e13-e65b-414f-9303-590d8629069c tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-8682be18-c9f5-4776-b581-910316119542 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:19 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e7808ece-fd8b-414f-8841-878e17ec64dd tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20b4f023-32d3-4c26-8f3f-a47d100a1fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ea53125-4c75-4cc9-b0a1-29ae8c9567fe', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:19 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e7808ece-fd8b-414f-8841-878e17ec64dd tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f4210bf-a34c-42e3-a06e-a932d1ab32bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:19 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-e7808ece-fd8b-414f-8841-878e17ec64dd tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Volume volume-3ea53125-4c75-4cc9-b0a1-29ae8c9567fe (3ea53125-4c75-4cc9-b0a1-29ae8c9567fe): created successfully Sep 28 09:38:19 devstack sudo[104688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-8682be18-c9f5-4776-b581-910316119542 1073741824 Sep 28 09:38:19 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e7808ece-fd8b-414f-8841-878e17ec64dd tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f4210bf-a34c-42e3-a06e-a932d1ab32bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:19 devstack sudo[104688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:19 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e7808ece-fd8b-414f-8841-878e17ec64dd tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Flow 'volume_create_manager' (3d96de31-3af9-484d-83ee-58c9cc567207) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:38:19 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-e7808ece-fd8b-414f-8841-878e17ec64dd tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Created volume successfully. Sep 28 09:38:19 devstack sudo[104685]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:19 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-30fb357a-6f0d-46d4-af58-51182d84ac17 tempest-VolumeAndVolumeTypeFromImageTest-1552104858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9bb46c84-5334-4b32-bf17-1af90d63728f" returned: 0 in 0.594s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:19 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-30fb357a-6f0d-46d4-af58-51182d84ac17 tempest-VolumeAndVolumeTypeFromImageTest-1552104858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9bb46c84-5334-4b32-bf17-1af90d63728f {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:19 devstack sudo[104694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9bb46c84-5334-4b32-bf17-1af90d63728f Sep 28 09:38:19 devstack sudo[104694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:19 devstack sudo[104694]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:19 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-30fb357a-6f0d-46d4-af58-51182d84ac17 tempest-VolumeAndVolumeTypeFromImageTest-1552104858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9bb46c84-5334-4b32-bf17-1af90d63728f" returned: 0 in 0.420s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:19 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-30fb357a-6f0d-46d4-af58-51182d84ac17 tempest-VolumeAndVolumeTypeFromImageTest-1552104858 None] Lock "cinder-quobyte-9bb46c84-5334-4b32-bf17-1af90d63728f" released by "delete_volume" :: held 1.091s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:38:20 devstack cinder-volume[86553]: WARNING cinder.quota [None req-30fb357a-6f0d-46d4-af58-51182d84ac17 tempest-VolumeAndVolumeTypeFromImageTest-1552104858 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 28 09:38:20 devstack cinder-volume[86553]: WARNING cinder.quota [None req-30fb357a-6f0d-46d4-af58-51182d84ac17 tempest-VolumeAndVolumeTypeFromImageTest-1552104858 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 28 09:38:20 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-30fb357a-6f0d-46d4-af58-51182d84ac17 tempest-VolumeAndVolumeTypeFromImageTest-1552104858 None] Created reservations ['d1f6d6c2-b33d-4834-8a29-a74f3669dd78', '93f89325-f779-45e1-aab8-9bea11c14581', 'feb7ec85-bef7-4dd3-bea2-1bc3d41140e6', 'f857a709-8089-4fb3-8366-920b18dddd3a'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:38:20 devstack sudo[104688]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-6c601e13-e65b-414f-9303-590d8629069c tempest-CreateVolumesFromSourceVolumeTest-729336995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-8682be18-c9f5-4776-b581-910316119542 1073741824" returned: 0 in 1.037s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-30fb357a-6f0d-46d4-af58-51182d84ac17 tempest-VolumeAndVolumeTypeFromImageTest-1552104858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:38:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-30fb357a-6f0d-46d4-af58-51182d84ac17 tempest-VolumeAndVolumeTypeFromImageTest-1552104858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:38:20 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-30fb357a-6f0d-46d4-af58-51182d84ac17 tempest-VolumeAndVolumeTypeFromImageTest-1552104858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:38:20 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-30fb357a-6f0d-46d4-af58-51182d84ac17 tempest-VolumeAndVolumeTypeFromImageTest-1552104858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:38:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-30fb357a-6f0d-46d4-af58-51182d84ac17 tempest-VolumeAndVolumeTypeFromImageTest-1552104858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:38:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-30fb357a-6f0d-46d4-af58-51182d84ac17 tempest-VolumeAndVolumeTypeFromImageTest-1552104858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-6c601e13-e65b-414f-9303-590d8629069c tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-8682be18-c9f5-4776-b581-910316119542 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:20 devstack sudo[104701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:38:20 devstack sudo[104701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:20 devstack sudo[104703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-8682be18-c9f5-4776-b581-910316119542 Sep 28 09:38:20 devstack sudo[104703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:20 devstack sudo[104703]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-6c601e13-e65b-414f-9303-590d8629069c tempest-CreateVolumesFromSourceVolumeTest-729336995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-8682be18-c9f5-4776-b581-910316119542" returned: 0 in 0.412s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:20 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-6c601e13-e65b-414f-9303-590d8629069c tempest-CreateVolumesFromSourceVolumeTest-729336995 None] <== create_volume: return (1562ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:38:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-6c601e13-e65b-414f-9303-590d8629069c tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.565s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:38:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-e9084a9a-345c-4382-a64a-a5af46675400 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.049s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:38:20 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-e9084a9a-345c-4382-a64a-a5af46675400 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:38:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-733040467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0998a984-b6b3-426a-a03a-a3656762381b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3942022ccea0490bb02753e6a8be65c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:38:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:38:17Z,use_quota=True,user_id='4d5345b288bf46579a45b3cb1ee74eb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:38:20 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-e9084a9a-345c-4382-a64a-a5af46675400 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Creating volume 0998a984-b6b3-426a-a03a-a3656762381b {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:38:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-e9084a9a-345c-4382-a64a-a5af46675400 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:38:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-e9084a9a-345c-4382-a64a-a5af46675400 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:38:20 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-e9084a9a-345c-4382-a64a-a5af46675400 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:38:20 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-e9084a9a-345c-4382-a64a-a5af46675400 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:38:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-e9084a9a-345c-4382-a64a-a5af46675400 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:38:20 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-e9084a9a-345c-4382-a64a-a5af46675400 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:38:20 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-e9084a9a-345c-4382-a64a-a5af46675400 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:38:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e9084a9a-345c-4382-a64a-a5af46675400 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-0998a984-b6b3-426a-a03a-a3656762381b 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:20 devstack sudo[104701]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:20 devstack sudo[104708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-0998a984-b6b3-426a-a03a-a3656762381b 1073741824 Sep 28 09:38:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-30fb357a-6f0d-46d4-af58-51182d84ac17 tempest-VolumeAndVolumeTypeFromImageTest-1552104858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.526s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:20 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-30fb357a-6f0d-46d4-af58-51182d84ac17 tempest-VolumeAndVolumeTypeFromImageTest-1552104858 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:38:20 devstack sudo[104708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:20 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-30fb357a-6f0d-46d4-af58-51182d84ac17 tempest-VolumeAndVolumeTypeFromImageTest-1552104858 None] Deleted volume successfully. Sep 28 09:38:20 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-6c601e13-e65b-414f-9303-590d8629069c tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75a4d1b8-dcec-470b-956a-a1c461c8f467) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8682be18-c9f5-4776-b581-910316119542', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:20 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-6c601e13-e65b-414f-9303-590d8629069c tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ce3fdaf-f5b1-436c-b5e6-64becda627f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:20 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-6c601e13-e65b-414f-9303-590d8629069c tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Volume volume-8682be18-c9f5-4776-b581-910316119542 (8682be18-c9f5-4776-b581-910316119542): created successfully Sep 28 09:38:20 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-6c601e13-e65b-414f-9303-590d8629069c tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ce3fdaf-f5b1-436c-b5e6-64becda627f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:20 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-6c601e13-e65b-414f-9303-590d8629069c tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Flow 'volume_create_manager' (ef335aec-0607-4991-8e29-90c43959905b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:38:20 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-30fb357a-6f0d-46d4-af58-51182d84ac17 tempest-VolumeAndVolumeTypeFromImageTest-1552104858 None] Lock "cinder-9bb46c84-5334-4b32-bf17-1af90d63728f-delete_volume" released by "delete_volume" :: held 2.252s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:38:21 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-6c601e13-e65b-414f-9303-590d8629069c tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Created volume successfully. Sep 28 09:38:21 devstack cinder-volume[86553]: DEBUG oslo_service.periodic_task [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86553) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 09:38:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:38:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:38:21 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:38:21 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:38:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:38:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:21 devstack sudo[104708]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e9084a9a-345c-4382-a64a-a5af46675400 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-0998a984-b6b3-426a-a03a-a3656762381b 1073741824" returned: 0 in 0.832s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:21 devstack sudo[104715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:38:21 devstack sudo[104715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e9084a9a-345c-4382-a64a-a5af46675400 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-0998a984-b6b3-426a-a03a-a3656762381b {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:21 devstack sudo[104717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-0998a984-b6b3-426a-a03a-a3656762381b Sep 28 09:38:21 devstack sudo[104717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:21 devstack sudo[104715]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.367s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:21 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:38:21 devstack cinder-volume[86553]: DEBUG oslo_service.periodic_task [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Running periodic task VolumeManager._thread_info {{(pid=86553) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 09:38:21 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] thread count: 28 {{(pid=86553) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 09:38:21 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] thread info: [<_MainThread(MainThread, started 134684877779072)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86553) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 09:38:22 devstack sudo[104717]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:22 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e9084a9a-345c-4382-a64a-a5af46675400 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-0998a984-b6b3-426a-a03a-a3656762381b" returned: 0 in 0.527s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:22 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-e9084a9a-345c-4382-a64a-a5af46675400 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] <== create_volume: return (1451ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:38:22 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-e9084a9a-345c-4382-a64a-a5af46675400 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.456s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:38:22 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e9084a9a-345c-4382-a64a-a5af46675400 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4058f656-50f3-494c-807b-da538ce17236) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0998a984-b6b3-426a-a03a-a3656762381b', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:22 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e9084a9a-345c-4382-a64a-a5af46675400 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1871012-aa2f-45d3-b463-72db06f1f22f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:22 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-e9084a9a-345c-4382-a64a-a5af46675400 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Volume volume-0998a984-b6b3-426a-a03a-a3656762381b (0998a984-b6b3-426a-a03a-a3656762381b): created successfully Sep 28 09:38:22 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e9084a9a-345c-4382-a64a-a5af46675400 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1871012-aa2f-45d3-b463-72db06f1f22f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:22 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e9084a9a-345c-4382-a64a-a5af46675400 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Flow 'volume_create_manager' (0313dee9-a949-4ba4-a9ea-f1a6448a6d54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:38:22 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-e9084a9a-345c-4382-a64a-a5af46675400 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Created volume successfully. Sep 28 09:38:23 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-9c02209d-073a-4168-9950-e2e216c876aa tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Acquiring lock "cinder-0998a984-b6b3-426a-a03a-a3656762381b-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:38:23 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-9c02209d-073a-4168-9950-e2e216c876aa tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Lock "cinder-0998a984-b6b3-426a-a03a-a3656762381b-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:38:23 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-9c02209d-073a-4168-9950-e2e216c876aa tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Acquiring lock "cinder-quobyte-0998a984-b6b3-426a-a03a-a3656762381b" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:38:23 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-9c02209d-073a-4168-9950-e2e216c876aa tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Lock "cinder-quobyte-0998a984-b6b3-426a-a03a-a3656762381b" acquired by "delete_volume" :: waited 0.048s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:38:23 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[a90a4a7a-a738-4fa2-aac4-325e505bd15a]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:38:23 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-9c02209d-073a-4168-9950-e2e216c876aa tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-0998a984-b6b3-426a-a03a-a3656762381b {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:24 devstack sudo[104737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-0998a984-b6b3-426a-a03a-a3656762381b Sep 28 09:38:24 devstack sudo[104737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:24 devstack sudo[104737]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:24 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-9c02209d-073a-4168-9950-e2e216c876aa tempest-CreateVolumesFromSourceVolumeTest-729336995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-0998a984-b6b3-426a-a03a-a3656762381b" returned: 0 in 0.793s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:24 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-9c02209d-073a-4168-9950-e2e216c876aa tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-0998a984-b6b3-426a-a03a-a3656762381b {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:24 devstack sudo[104771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-0998a984-b6b3-426a-a03a-a3656762381b Sep 28 09:38:24 devstack sudo[104771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:25 devstack sudo[104771]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:25 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-9c02209d-073a-4168-9950-e2e216c876aa tempest-CreateVolumesFromSourceVolumeTest-729336995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-0998a984-b6b3-426a-a03a-a3656762381b" returned: 0 in 0.390s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:25 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-9c02209d-073a-4168-9950-e2e216c876aa tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Lock "cinder-quobyte-0998a984-b6b3-426a-a03a-a3656762381b" released by "delete_volume" :: held 1.323s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:38:25 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-9c02209d-073a-4168-9950-e2e216c876aa tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Created reservations ['919a1572-ae83-4dd4-88bf-dfd260f6ab4a', 'd9e2666e-847b-45da-a8a4-3589afc37e6b', 'ff4f27de-e5f8-4536-bf94-65b085f6ba05', '52d82f45-d229-445b-b65c-57d6814c45fe'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:38:25 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-9c02209d-073a-4168-9950-e2e216c876aa tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:38:25 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-9c02209d-073a-4168-9950-e2e216c876aa tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:38:25 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-9c02209d-073a-4168-9950-e2e216c876aa tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:38:25 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-9c02209d-073a-4168-9950-e2e216c876aa tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:38:25 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-9c02209d-073a-4168-9950-e2e216c876aa tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:38:25 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-9c02209d-073a-4168-9950-e2e216c876aa tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:25 devstack sudo[104775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:38:25 devstack sudo[104775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:25 devstack sudo[104775]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:25 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-9c02209d-073a-4168-9950-e2e216c876aa tempest-CreateVolumesFromSourceVolumeTest-729336995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.447s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:25 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-9c02209d-073a-4168-9950-e2e216c876aa tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:38:25 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-9c02209d-073a-4168-9950-e2e216c876aa tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Deleted volume successfully. Sep 28 09:38:25 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-9c02209d-073a-4168-9950-e2e216c876aa tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Lock "cinder-0998a984-b6b3-426a-a03a-a3656762381b-delete_volume" released by "delete_volume" :: held 2.229s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:38:25 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-1aa33bc2-2b78-4705-88bb-b146b6138d0e tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Acquiring lock "cinder-8682be18-c9f5-4776-b581-910316119542-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:38:25 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-1aa33bc2-2b78-4705-88bb-b146b6138d0e tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Lock "cinder-8682be18-c9f5-4776-b581-910316119542-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:38:25 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-1aa33bc2-2b78-4705-88bb-b146b6138d0e tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Acquiring lock "cinder-quobyte-8682be18-c9f5-4776-b581-910316119542" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:38:25 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-1aa33bc2-2b78-4705-88bb-b146b6138d0e tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Lock "cinder-quobyte-8682be18-c9f5-4776-b581-910316119542" acquired by "delete_volume" :: waited 0.020s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:38:25 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[712b5cf1-d9a0-43a5-b198-d572043168f9]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:38:25 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1aa33bc2-2b78-4705-88bb-b146b6138d0e tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-8682be18-c9f5-4776-b581-910316119542 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:26 devstack sudo[104795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-8682be18-c9f5-4776-b581-910316119542 Sep 28 09:38:26 devstack sudo[104795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:26 devstack sudo[104795]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:26 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1aa33bc2-2b78-4705-88bb-b146b6138d0e tempest-CreateVolumesFromSourceVolumeTest-729336995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-8682be18-c9f5-4776-b581-910316119542" returned: 0 in 0.413s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:26 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1aa33bc2-2b78-4705-88bb-b146b6138d0e tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-8682be18-c9f5-4776-b581-910316119542 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:26 devstack sudo[104800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-8682be18-c9f5-4776-b581-910316119542 Sep 28 09:38:26 devstack sudo[104800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:26 devstack sudo[104800]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:26 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1aa33bc2-2b78-4705-88bb-b146b6138d0e tempest-CreateVolumesFromSourceVolumeTest-729336995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-8682be18-c9f5-4776-b581-910316119542" returned: 0 in 0.267s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:26 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-1aa33bc2-2b78-4705-88bb-b146b6138d0e tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Lock "cinder-quobyte-8682be18-c9f5-4776-b581-910316119542" released by "delete_volume" :: held 0.742s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:38:26 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-1aa33bc2-2b78-4705-88bb-b146b6138d0e tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Created reservations ['7dd982f7-b5db-43f9-b1ff-bcac0aa8af2e', 'd148f073-b30e-4bff-b75f-6a9d6ee57284', '755fe795-0e0c-40cf-bb47-e9305cfdea15', 'e8ecb72c-97f0-4ab8-b0db-d62c077324ba'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:38:26 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-1aa33bc2-2b78-4705-88bb-b146b6138d0e tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:38:26 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-1aa33bc2-2b78-4705-88bb-b146b6138d0e tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:38:26 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-1aa33bc2-2b78-4705-88bb-b146b6138d0e tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:38:26 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-1aa33bc2-2b78-4705-88bb-b146b6138d0e tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:38:26 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-1aa33bc2-2b78-4705-88bb-b146b6138d0e tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:38:26 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1aa33bc2-2b78-4705-88bb-b146b6138d0e tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:26 devstack sudo[104803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:38:26 devstack sudo[104803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:27 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-95db625a-9edd-4709-a495-d422ad92592e tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Acquiring lock "cinder-3ea53125-4c75-4cc9-b0a1-29ae8c9567fe-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:38:27 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-95db625a-9edd-4709-a495-d422ad92592e tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Lock "cinder-3ea53125-4c75-4cc9-b0a1-29ae8c9567fe-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:38:27 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-95db625a-9edd-4709-a495-d422ad92592e tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Acquiring lock "cinder-quobyte-3ea53125-4c75-4cc9-b0a1-29ae8c9567fe" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:38:27 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-95db625a-9edd-4709-a495-d422ad92592e tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Lock "cinder-quobyte-3ea53125-4c75-4cc9-b0a1-29ae8c9567fe" acquired by "delete_volume" :: waited 0.034s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:38:27 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[205d0bbb-f862-43a0-9934-65ad1e5da790]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:38:27 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-95db625a-9edd-4709-a495-d422ad92592e tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ea53125-4c75-4cc9-b0a1-29ae8c9567fe {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:27 devstack sudo[104803]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:27 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1aa33bc2-2b78-4705-88bb-b146b6138d0e tempest-CreateVolumesFromSourceVolumeTest-729336995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.442s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:27 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-1aa33bc2-2b78-4705-88bb-b146b6138d0e tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:38:27 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-1aa33bc2-2b78-4705-88bb-b146b6138d0e tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Deleted volume successfully. Sep 28 09:38:27 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-1aa33bc2-2b78-4705-88bb-b146b6138d0e tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Lock "cinder-8682be18-c9f5-4776-b581-910316119542-delete_volume" released by "delete_volume" :: held 1.473s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:38:27 devstack sudo[104806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ea53125-4c75-4cc9-b0a1-29ae8c9567fe Sep 28 09:38:27 devstack sudo[104806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:27 devstack sudo[104806]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:27 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-95db625a-9edd-4709-a495-d422ad92592e tempest-CreateVolumesFromSourceVolumeTest-729336995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ea53125-4c75-4cc9-b0a1-29ae8c9567fe" returned: 0 in 0.444s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:27 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-95db625a-9edd-4709-a495-d422ad92592e tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ea53125-4c75-4cc9-b0a1-29ae8c9567fe {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:27 devstack sudo[104811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ea53125-4c75-4cc9-b0a1-29ae8c9567fe Sep 28 09:38:27 devstack sudo[104811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:27 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-9376e940-2d4a-4292-952b-181ff4de1c02 tempest-CreateVolumesFromImageTest-1946594272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:38:28 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-9376e940-2d4a-4292-952b-181ff4de1c02 tempest-CreateVolumesFromImageTest-1946594272 None] Flow 'volume_create_manager' (0e0d1d3d-a7c6-4351-9eed-117317b2fa95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:38:28 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-9376e940-2d4a-4292-952b-181ff4de1c02 tempest-CreateVolumesFromImageTest-1946594272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a9b1438-5641-4a71-b71d-a61645154ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:28 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-9376e940-2d4a-4292-952b-181ff4de1c02 tempest-CreateVolumesFromImageTest-1946594272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a9b1438-5641-4a71-b71d-a61645154ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:38:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1570898107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae91d86f-12e8-4b7c-9c50-233a6e3c9cc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74cd94f310a84494ab0b627a285e98aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:38:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:38:28Z,use_quota=True,user_id='322af0b602e94b378e1289aa063c8d9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:28 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-9376e940-2d4a-4292-952b-181ff4de1c02 tempest-CreateVolumesFromImageTest-1946594272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a70700e5-0d84-4008-8171-7de67c7cedcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:28 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-9376e940-2d4a-4292-952b-181ff4de1c02 tempest-CreateVolumesFromImageTest-1946594272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a70700e5-0d84-4008-8171-7de67c7cedcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:28 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-9376e940-2d4a-4292-952b-181ff4de1c02 tempest-CreateVolumesFromImageTest-1946594272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53569269-acd0-4bf2-ba58-62875baf5107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:28 devstack sudo[104811]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:28 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-9376e940-2d4a-4292-952b-181ff4de1c02 tempest-CreateVolumesFromImageTest-1946594272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53569269-acd0-4bf2-ba58-62875baf5107) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae91d86f-12e8-4b7c-9c50-233a6e3c9cc8', 'volume_name': 'volume-ae91d86f-12e8-4b7c-9c50-233a6e3c9cc8', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:28 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-9376e940-2d4a-4292-952b-181ff4de1c02 tempest-CreateVolumesFromImageTest-1946594272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (475b2cc8-855c-4e5f-ad4c-21bfbcc91e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:28 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-9376e940-2d4a-4292-952b-181ff4de1c02 tempest-CreateVolumesFromImageTest-1946594272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (475b2cc8-855c-4e5f-ad4c-21bfbcc91e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:28 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-9376e940-2d4a-4292-952b-181ff4de1c02 tempest-CreateVolumesFromImageTest-1946594272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30892a7e-5c75-46bb-a023-8b4e6c30f11b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:28 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-9376e940-2d4a-4292-952b-181ff4de1c02 tempest-CreateVolumesFromImageTest-1946594272 None] Volume ae91d86f-12e8-4b7c-9c50-233a6e3c9cc8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae91d86f-12e8-4b7c-9c50-233a6e3c9cc8', 'volume_size': 1} Sep 28 09:38:28 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-9376e940-2d4a-4292-952b-181ff4de1c02 tempest-CreateVolumesFromImageTest-1946594272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:38:28 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-9376e940-2d4a-4292-952b-181ff4de1c02 tempest-CreateVolumesFromImageTest-1946594272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:38:28 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-9376e940-2d4a-4292-952b-181ff4de1c02 tempest-CreateVolumesFromImageTest-1946594272 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:38:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1570898107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae91d86f-12e8-4b7c-9c50-233a6e3c9cc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74cd94f310a84494ab0b627a285e98aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:38:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:38:28Z,use_quota=True,user_id='322af0b602e94b378e1289aa063c8d9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:38:28 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-9376e940-2d4a-4292-952b-181ff4de1c02 tempest-CreateVolumesFromImageTest-1946594272 None] Creating volume ae91d86f-12e8-4b7c-9c50-233a6e3c9cc8 {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:38:28 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-9376e940-2d4a-4292-952b-181ff4de1c02 tempest-CreateVolumesFromImageTest-1946594272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:38:28 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-9376e940-2d4a-4292-952b-181ff4de1c02 tempest-CreateVolumesFromImageTest-1946594272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:38:28 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-9376e940-2d4a-4292-952b-181ff4de1c02 tempest-CreateVolumesFromImageTest-1946594272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:38:28 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-9376e940-2d4a-4292-952b-181ff4de1c02 tempest-CreateVolumesFromImageTest-1946594272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:38:28 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-9376e940-2d4a-4292-952b-181ff4de1c02 tempest-CreateVolumesFromImageTest-1946594272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:38:28 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-9376e940-2d4a-4292-952b-181ff4de1c02 tempest-CreateVolumesFromImageTest-1946594272 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:38:28 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-9376e940-2d4a-4292-952b-181ff4de1c02 tempest-CreateVolumesFromImageTest-1946594272 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:38:28 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-9376e940-2d4a-4292-952b-181ff4de1c02 tempest-CreateVolumesFromImageTest-1946594272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-ae91d86f-12e8-4b7c-9c50-233a6e3c9cc8 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:28 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-95db625a-9edd-4709-a495-d422ad92592e tempest-CreateVolumesFromSourceVolumeTest-729336995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3ea53125-4c75-4cc9-b0a1-29ae8c9567fe" returned: 0 in 0.431s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:28 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-95db625a-9edd-4709-a495-d422ad92592e tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Lock "cinder-quobyte-3ea53125-4c75-4cc9-b0a1-29ae8c9567fe" released by "delete_volume" :: held 0.942s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:38:28 devstack sudo[104816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-ae91d86f-12e8-4b7c-9c50-233a6e3c9cc8 1073741824 Sep 28 09:38:28 devstack sudo[104816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:28 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-95db625a-9edd-4709-a495-d422ad92592e tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Created reservations ['0c1a2157-432b-4f8a-8292-d0c8e510d6b4', '862609b4-2507-40d9-a995-57314d7e37cf', '6330988d-59d3-46fa-aa49-017576f6f0c3', 'e036d5ea-fe86-4db9-af62-3d07a68e96b7'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:38:28 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-95db625a-9edd-4709-a495-d422ad92592e tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:38:28 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-95db625a-9edd-4709-a495-d422ad92592e tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:38:28 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-95db625a-9edd-4709-a495-d422ad92592e tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:38:28 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-95db625a-9edd-4709-a495-d422ad92592e tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:38:28 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-95db625a-9edd-4709-a495-d422ad92592e tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:38:28 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-95db625a-9edd-4709-a495-d422ad92592e tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:28 devstack sudo[104818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:38:28 devstack sudo[104818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:28 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-074ae0ef-cbee-4dea-96d5-8e087410854c tempest-CreateVolumesFromImageTest-1946594272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:38:28 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-074ae0ef-cbee-4dea-96d5-8e087410854c tempest-CreateVolumesFromImageTest-1946594272 None] Flow 'volume_create_manager' (6b942d3d-d03e-4b6e-a10d-308f69f2cf22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:38:28 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-074ae0ef-cbee-4dea-96d5-8e087410854c tempest-CreateVolumesFromImageTest-1946594272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ba5683f-bf60-4d04-b480-db8700788e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:28 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-074ae0ef-cbee-4dea-96d5-8e087410854c tempest-CreateVolumesFromImageTest-1946594272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ba5683f-bf60-4d04-b480-db8700788e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:38:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-578509733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=010567c5-98c7-460b-907d-05bc05ae23c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74cd94f310a84494ab0b627a285e98aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:38:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:38:28Z,use_quota=True,user_id='322af0b602e94b378e1289aa063c8d9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:28 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-074ae0ef-cbee-4dea-96d5-8e087410854c tempest-CreateVolumesFromImageTest-1946594272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80f30855-c01e-4d84-84f3-137983eb7967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:28 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-074ae0ef-cbee-4dea-96d5-8e087410854c tempest-CreateVolumesFromImageTest-1946594272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80f30855-c01e-4d84-84f3-137983eb7967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:28 devstack sudo[104818]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:28 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-074ae0ef-cbee-4dea-96d5-8e087410854c tempest-CreateVolumesFromImageTest-1946594272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7148751-71a5-4fb2-bd4f-d825a567c8b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:28 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-074ae0ef-cbee-4dea-96d5-8e087410854c tempest-CreateVolumesFromImageTest-1946594272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7148751-71a5-4fb2-bd4f-d825a567c8b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '010567c5-98c7-460b-907d-05bc05ae23c5', 'volume_name': 'volume-010567c5-98c7-460b-907d-05bc05ae23c5', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:28 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-074ae0ef-cbee-4dea-96d5-8e087410854c tempest-CreateVolumesFromImageTest-1946594272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1d051e8-5b9c-4f8a-9f1c-3a47479f4c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:28 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-074ae0ef-cbee-4dea-96d5-8e087410854c tempest-CreateVolumesFromImageTest-1946594272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1d051e8-5b9c-4f8a-9f1c-3a47479f4c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:28 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-074ae0ef-cbee-4dea-96d5-8e087410854c tempest-CreateVolumesFromImageTest-1946594272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0e282c2-8d51-415c-b1c1-dabc1dda4d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:28 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-074ae0ef-cbee-4dea-96d5-8e087410854c tempest-CreateVolumesFromImageTest-1946594272 None] Volume 010567c5-98c7-460b-907d-05bc05ae23c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-010567c5-98c7-460b-907d-05bc05ae23c5', 'volume_size': 1} Sep 28 09:38:28 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-074ae0ef-cbee-4dea-96d5-8e087410854c tempest-CreateVolumesFromImageTest-1946594272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:38:28 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-95db625a-9edd-4709-a495-d422ad92592e tempest-CreateVolumesFromSourceVolumeTest-729336995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.337s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:28 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-95db625a-9edd-4709-a495-d422ad92592e tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:38:28 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-95db625a-9edd-4709-a495-d422ad92592e tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Deleted volume successfully. Sep 28 09:38:28 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-95db625a-9edd-4709-a495-d422ad92592e tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Lock "cinder-3ea53125-4c75-4cc9-b0a1-29ae8c9567fe-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:38:28 devstack sudo[104816]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:28 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-9376e940-2d4a-4292-952b-181ff4de1c02 tempest-CreateVolumesFromImageTest-1946594272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-ae91d86f-12e8-4b7c-9c50-233a6e3c9cc8 1073741824" returned: 0 in 0.733s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:28 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-9376e940-2d4a-4292-952b-181ff4de1c02 tempest-CreateVolumesFromImageTest-1946594272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-ae91d86f-12e8-4b7c-9c50-233a6e3c9cc8 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:28 devstack sudo[104825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-ae91d86f-12e8-4b7c-9c50-233a6e3c9cc8 Sep 28 09:38:28 devstack sudo[104825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:29 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ff3b94a-fd68-4a79-bbe3-f5c107d61066 tempest-CreateVolumesFromImageTest-1946594272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:38:29 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7ff3b94a-fd68-4a79-bbe3-f5c107d61066 tempest-CreateVolumesFromImageTest-1946594272 None] Flow 'volume_create_manager' (42e085fc-a40a-43c3-b57c-44af717993ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:38:29 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7ff3b94a-fd68-4a79-bbe3-f5c107d61066 tempest-CreateVolumesFromImageTest-1946594272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64fa0c15-5a6f-4a32-8dee-372a97cd7d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:29 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7ff3b94a-fd68-4a79-bbe3-f5c107d61066 tempest-CreateVolumesFromImageTest-1946594272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64fa0c15-5a6f-4a32-8dee-372a97cd7d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:38:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1549398787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=178c67c6-8870-4e13-9ffb-bf3d2746ac11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74cd94f310a84494ab0b627a285e98aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:38:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:38:29Z,use_quota=True,user_id='322af0b602e94b378e1289aa063c8d9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:29 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7ff3b94a-fd68-4a79-bbe3-f5c107d61066 tempest-CreateVolumesFromImageTest-1946594272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6a2d588-e74c-460c-aa1c-aa37e56e7b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:29 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7ff3b94a-fd68-4a79-bbe3-f5c107d61066 tempest-CreateVolumesFromImageTest-1946594272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6a2d588-e74c-460c-aa1c-aa37e56e7b78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:29 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7ff3b94a-fd68-4a79-bbe3-f5c107d61066 tempest-CreateVolumesFromImageTest-1946594272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ef423cb-7f93-4875-8aa8-79ec6e85ec85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:29 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7ff3b94a-fd68-4a79-bbe3-f5c107d61066 tempest-CreateVolumesFromImageTest-1946594272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ef423cb-7f93-4875-8aa8-79ec6e85ec85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '178c67c6-8870-4e13-9ffb-bf3d2746ac11', 'volume_name': 'volume-178c67c6-8870-4e13-9ffb-bf3d2746ac11', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:29 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7ff3b94a-fd68-4a79-bbe3-f5c107d61066 tempest-CreateVolumesFromImageTest-1946594272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42f496b9-c7d3-4f32-8c04-291da7eb194a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:29 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7ff3b94a-fd68-4a79-bbe3-f5c107d61066 tempest-CreateVolumesFromImageTest-1946594272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42f496b9-c7d3-4f32-8c04-291da7eb194a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:29 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7ff3b94a-fd68-4a79-bbe3-f5c107d61066 tempest-CreateVolumesFromImageTest-1946594272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17877a1d-79b6-4d8f-85df-94204b532485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:29 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-7ff3b94a-fd68-4a79-bbe3-f5c107d61066 tempest-CreateVolumesFromImageTest-1946594272 None] Volume 178c67c6-8870-4e13-9ffb-bf3d2746ac11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-178c67c6-8870-4e13-9ffb-bf3d2746ac11', 'volume_size': 1} Sep 28 09:38:29 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-7ff3b94a-fd68-4a79-bbe3-f5c107d61066 tempest-CreateVolumesFromImageTest-1946594272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:38:29 devstack sudo[104825]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:29 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-9376e940-2d4a-4292-952b-181ff4de1c02 tempest-CreateVolumesFromImageTest-1946594272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-ae91d86f-12e8-4b7c-9c50-233a6e3c9cc8" returned: 0 in 0.374s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:29 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-9376e940-2d4a-4292-952b-181ff4de1c02 tempest-CreateVolumesFromImageTest-1946594272 None] <== create_volume: return (1161ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:38:29 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-9376e940-2d4a-4292-952b-181ff4de1c02 tempest-CreateVolumesFromImageTest-1946594272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.165s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:38:29 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-074ae0ef-cbee-4dea-96d5-8e087410854c tempest-CreateVolumesFromImageTest-1946594272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.598s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:38:29 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-074ae0ef-cbee-4dea-96d5-8e087410854c tempest-CreateVolumesFromImageTest-1946594272 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:38:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-578509733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=010567c5-98c7-460b-907d-05bc05ae23c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74cd94f310a84494ab0b627a285e98aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:38:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:38:28Z,use_quota=True,user_id='322af0b602e94b378e1289aa063c8d9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:38:29 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-074ae0ef-cbee-4dea-96d5-8e087410854c tempest-CreateVolumesFromImageTest-1946594272 None] Creating volume 010567c5-98c7-460b-907d-05bc05ae23c5 {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:38:29 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-074ae0ef-cbee-4dea-96d5-8e087410854c tempest-CreateVolumesFromImageTest-1946594272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:38:29 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-074ae0ef-cbee-4dea-96d5-8e087410854c tempest-CreateVolumesFromImageTest-1946594272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:38:29 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-074ae0ef-cbee-4dea-96d5-8e087410854c tempest-CreateVolumesFromImageTest-1946594272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:38:29 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-074ae0ef-cbee-4dea-96d5-8e087410854c tempest-CreateVolumesFromImageTest-1946594272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:38:29 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-074ae0ef-cbee-4dea-96d5-8e087410854c tempest-CreateVolumesFromImageTest-1946594272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:38:29 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-074ae0ef-cbee-4dea-96d5-8e087410854c tempest-CreateVolumesFromImageTest-1946594272 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:38:29 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-074ae0ef-cbee-4dea-96d5-8e087410854c tempest-CreateVolumesFromImageTest-1946594272 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:38:29 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-074ae0ef-cbee-4dea-96d5-8e087410854c tempest-CreateVolumesFromImageTest-1946594272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-010567c5-98c7-460b-907d-05bc05ae23c5 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:29 devstack sudo[104828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-010567c5-98c7-460b-907d-05bc05ae23c5 1073741824 Sep 28 09:38:29 devstack sudo[104828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:29 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-9376e940-2d4a-4292-952b-181ff4de1c02 tempest-CreateVolumesFromImageTest-1946594272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30892a7e-5c75-46bb-a023-8b4e6c30f11b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae91d86f-12e8-4b7c-9c50-233a6e3c9cc8', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:29 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-9376e940-2d4a-4292-952b-181ff4de1c02 tempest-CreateVolumesFromImageTest-1946594272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a0b2233-279c-4471-8d73-427604db2c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:29 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-2333e792-5f59-42ad-8dd7-d6751bfeaa0a tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Acquiring lock "cinder-30fe1b43-0bee-432f-afda-a9278693caa2-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:38:29 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-9376e940-2d4a-4292-952b-181ff4de1c02 tempest-CreateVolumesFromImageTest-1946594272 None] Volume volume-ae91d86f-12e8-4b7c-9c50-233a6e3c9cc8 (ae91d86f-12e8-4b7c-9c50-233a6e3c9cc8): created successfully Sep 28 09:38:29 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-9376e940-2d4a-4292-952b-181ff4de1c02 tempest-CreateVolumesFromImageTest-1946594272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a0b2233-279c-4471-8d73-427604db2c38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:29 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-9376e940-2d4a-4292-952b-181ff4de1c02 tempest-CreateVolumesFromImageTest-1946594272 None] Flow 'volume_create_manager' (0e0d1d3d-a7c6-4351-9eed-117317b2fa95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:38:29 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-2333e792-5f59-42ad-8dd7-d6751bfeaa0a tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Lock "cinder-30fe1b43-0bee-432f-afda-a9278693caa2-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:38:29 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-9376e940-2d4a-4292-952b-181ff4de1c02 tempest-CreateVolumesFromImageTest-1946594272 None] Created volume successfully. Sep 28 09:38:29 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-d72edd2a-9e7f-49bf-8996-2f5418ee6f36 tempest-CreateVolumesFromImageTest-1946594272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:38:29 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-d72edd2a-9e7f-49bf-8996-2f5418ee6f36 tempest-CreateVolumesFromImageTest-1946594272 None] Flow 'volume_create_manager' (a8e06d56-02a6-41a6-94bf-093d20f174a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:38:29 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-d72edd2a-9e7f-49bf-8996-2f5418ee6f36 tempest-CreateVolumesFromImageTest-1946594272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f22411f-a796-4fc4-9bc8-64a65c9ad56e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:29 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-2333e792-5f59-42ad-8dd7-d6751bfeaa0a tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Acquiring lock "cinder-quobyte-30fe1b43-0bee-432f-afda-a9278693caa2" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:38:29 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-d72edd2a-9e7f-49bf-8996-2f5418ee6f36 tempest-CreateVolumesFromImageTest-1946594272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f22411f-a796-4fc4-9bc8-64a65c9ad56e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:38:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-147536523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d195ea2-b8f6-4a5c-97bf-5140ebeab3e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74cd94f310a84494ab0b627a285e98aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:38:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:38:29Z,use_quota=True,user_id='322af0b602e94b378e1289aa063c8d9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:29 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-d72edd2a-9e7f-49bf-8996-2f5418ee6f36 tempest-CreateVolumesFromImageTest-1946594272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (310b9a11-92c4-4bd3-bf8b-085badb473c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:29 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-d72edd2a-9e7f-49bf-8996-2f5418ee6f36 tempest-CreateVolumesFromImageTest-1946594272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (310b9a11-92c4-4bd3-bf8b-085badb473c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:29 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-d72edd2a-9e7f-49bf-8996-2f5418ee6f36 tempest-CreateVolumesFromImageTest-1946594272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d1670c6-014d-4f3e-b213-b9d003eece82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:29 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-d72edd2a-9e7f-49bf-8996-2f5418ee6f36 tempest-CreateVolumesFromImageTest-1946594272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d1670c6-014d-4f3e-b213-b9d003eece82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d195ea2-b8f6-4a5c-97bf-5140ebeab3e0', 'volume_name': 'volume-7d195ea2-b8f6-4a5c-97bf-5140ebeab3e0', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:29 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-d72edd2a-9e7f-49bf-8996-2f5418ee6f36 tempest-CreateVolumesFromImageTest-1946594272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42803dd0-b18b-4665-9712-54f80d69726d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:29 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-d72edd2a-9e7f-49bf-8996-2f5418ee6f36 tempest-CreateVolumesFromImageTest-1946594272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42803dd0-b18b-4665-9712-54f80d69726d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:29 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-d72edd2a-9e7f-49bf-8996-2f5418ee6f36 tempest-CreateVolumesFromImageTest-1946594272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96e90bd0-7e49-4753-8fac-38cca4237ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:29 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-d72edd2a-9e7f-49bf-8996-2f5418ee6f36 tempest-CreateVolumesFromImageTest-1946594272 None] Volume 7d195ea2-b8f6-4a5c-97bf-5140ebeab3e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d195ea2-b8f6-4a5c-97bf-5140ebeab3e0', 'volume_size': 1} Sep 28 09:38:29 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-d72edd2a-9e7f-49bf-8996-2f5418ee6f36 tempest-CreateVolumesFromImageTest-1946594272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:38:29 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-2333e792-5f59-42ad-8dd7-d6751bfeaa0a tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Lock "cinder-quobyte-30fe1b43-0bee-432f-afda-a9278693caa2" acquired by "delete_volume" :: waited 0.072s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:38:29 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[e27d0b1a-28bc-47c8-b323-afda3b8f3633]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:38:29 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2333e792-5f59-42ad-8dd7-d6751bfeaa0a tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-30fe1b43-0bee-432f-afda-a9278693caa2 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:29 devstack sudo[104834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-30fe1b43-0bee-432f-afda-a9278693caa2 Sep 28 09:38:29 devstack sudo[104834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:29 devstack sudo[104828]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:29 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-074ae0ef-cbee-4dea-96d5-8e087410854c tempest-CreateVolumesFromImageTest-1946594272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-010567c5-98c7-460b-907d-05bc05ae23c5 1073741824" returned: 0 in 0.694s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-074ae0ef-cbee-4dea-96d5-8e087410854c tempest-CreateVolumesFromImageTest-1946594272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-010567c5-98c7-460b-907d-05bc05ae23c5 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:30 devstack sudo[104837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-010567c5-98c7-460b-907d-05bc05ae23c5 Sep 28 09:38:30 devstack sudo[104837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:30 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-41f7fb3e-a9a1-4752-9f85-57d4836a42c6 tempest-CreateVolumesFromImageTest-1946594272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:38:30 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-41f7fb3e-a9a1-4752-9f85-57d4836a42c6 tempest-CreateVolumesFromImageTest-1946594272 None] Flow 'volume_create_manager' (14dc1fd8-344d-4e0f-ab0b-0f6fab645809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:38:30 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-41f7fb3e-a9a1-4752-9f85-57d4836a42c6 tempest-CreateVolumesFromImageTest-1946594272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10445759-3eab-48f2-b656-dbddfe12dad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:30 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-41f7fb3e-a9a1-4752-9f85-57d4836a42c6 tempest-CreateVolumesFromImageTest-1946594272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10445759-3eab-48f2-b656-dbddfe12dad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:38:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1842289433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fae5f881-546c-4a1d-bcf6-3c08349f70fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74cd94f310a84494ab0b627a285e98aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:38:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:38:30Z,use_quota=True,user_id='322af0b602e94b378e1289aa063c8d9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:30 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-41f7fb3e-a9a1-4752-9f85-57d4836a42c6 tempest-CreateVolumesFromImageTest-1946594272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30574f5f-36f5-4ad1-8173-2a970d0853cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:30 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-41f7fb3e-a9a1-4752-9f85-57d4836a42c6 tempest-CreateVolumesFromImageTest-1946594272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30574f5f-36f5-4ad1-8173-2a970d0853cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:30 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-41f7fb3e-a9a1-4752-9f85-57d4836a42c6 tempest-CreateVolumesFromImageTest-1946594272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ce28dfc-629c-420f-9696-11bba8eec2de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:30 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-41f7fb3e-a9a1-4752-9f85-57d4836a42c6 tempest-CreateVolumesFromImageTest-1946594272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ce28dfc-629c-420f-9696-11bba8eec2de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fae5f881-546c-4a1d-bcf6-3c08349f70fb', 'volume_name': 'volume-fae5f881-546c-4a1d-bcf6-3c08349f70fb', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:30 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-41f7fb3e-a9a1-4752-9f85-57d4836a42c6 tempest-CreateVolumesFromImageTest-1946594272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc5df846-363a-407d-b8bd-f94183e614df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:30 devstack sudo[104834]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:30 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-41f7fb3e-a9a1-4752-9f85-57d4836a42c6 tempest-CreateVolumesFromImageTest-1946594272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc5df846-363a-407d-b8bd-f94183e614df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:30 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-41f7fb3e-a9a1-4752-9f85-57d4836a42c6 tempest-CreateVolumesFromImageTest-1946594272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9ba39ac-e77f-47d4-ba17-70ee2798d35d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:30 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-41f7fb3e-a9a1-4752-9f85-57d4836a42c6 tempest-CreateVolumesFromImageTest-1946594272 None] Volume fae5f881-546c-4a1d-bcf6-3c08349f70fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fae5f881-546c-4a1d-bcf6-3c08349f70fb', 'volume_size': 1} Sep 28 09:38:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-41f7fb3e-a9a1-4752-9f85-57d4836a42c6 tempest-CreateVolumesFromImageTest-1946594272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:38:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2333e792-5f59-42ad-8dd7-d6751bfeaa0a tempest-CreateVolumesFromSourceVolumeTest-729336995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-30fe1b43-0bee-432f-afda-a9278693caa2" returned: 0 in 0.546s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2333e792-5f59-42ad-8dd7-d6751bfeaa0a tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-30fe1b43-0bee-432f-afda-a9278693caa2 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:30 devstack sudo[104842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-30fe1b43-0bee-432f-afda-a9278693caa2 Sep 28 09:38:30 devstack sudo[104842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:30 devstack sudo[104837]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-074ae0ef-cbee-4dea-96d5-8e087410854c tempest-CreateVolumesFromImageTest-1946594272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-010567c5-98c7-460b-907d-05bc05ae23c5" returned: 0 in 0.350s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:30 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-074ae0ef-cbee-4dea-96d5-8e087410854c tempest-CreateVolumesFromImageTest-1946594272 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:38:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-074ae0ef-cbee-4dea-96d5-8e087410854c tempest-CreateVolumesFromImageTest-1946594272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:38:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-7ff3b94a-fd68-4a79-bbe3-f5c107d61066 tempest-CreateVolumesFromImageTest-1946594272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.177s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:38:30 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-7ff3b94a-fd68-4a79-bbe3-f5c107d61066 tempest-CreateVolumesFromImageTest-1946594272 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:38:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1549398787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=178c67c6-8870-4e13-9ffb-bf3d2746ac11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74cd94f310a84494ab0b627a285e98aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:38:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:38:29Z,use_quota=True,user_id='322af0b602e94b378e1289aa063c8d9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:38:30 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-7ff3b94a-fd68-4a79-bbe3-f5c107d61066 tempest-CreateVolumesFromImageTest-1946594272 None] Creating volume 178c67c6-8870-4e13-9ffb-bf3d2746ac11 {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:38:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-7ff3b94a-fd68-4a79-bbe3-f5c107d61066 tempest-CreateVolumesFromImageTest-1946594272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:38:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-7ff3b94a-fd68-4a79-bbe3-f5c107d61066 tempest-CreateVolumesFromImageTest-1946594272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:38:30 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-7ff3b94a-fd68-4a79-bbe3-f5c107d61066 tempest-CreateVolumesFromImageTest-1946594272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:38:30 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-7ff3b94a-fd68-4a79-bbe3-f5c107d61066 tempest-CreateVolumesFromImageTest-1946594272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:38:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-7ff3b94a-fd68-4a79-bbe3-f5c107d61066 tempest-CreateVolumesFromImageTest-1946594272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:38:30 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-7ff3b94a-fd68-4a79-bbe3-f5c107d61066 tempest-CreateVolumesFromImageTest-1946594272 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:38:30 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-7ff3b94a-fd68-4a79-bbe3-f5c107d61066 tempest-CreateVolumesFromImageTest-1946594272 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:38:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-7ff3b94a-fd68-4a79-bbe3-f5c107d61066 tempest-CreateVolumesFromImageTest-1946594272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-178c67c6-8870-4e13-9ffb-bf3d2746ac11 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:30 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-074ae0ef-cbee-4dea-96d5-8e087410854c tempest-CreateVolumesFromImageTest-1946594272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0e282c2-8d51-415c-b1c1-dabc1dda4d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-010567c5-98c7-460b-907d-05bc05ae23c5', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:30 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-074ae0ef-cbee-4dea-96d5-8e087410854c tempest-CreateVolumesFromImageTest-1946594272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9cceebc-1bd4-4c8b-882c-db9f058875a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:30 devstack sudo[104845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-178c67c6-8870-4e13-9ffb-bf3d2746ac11 1073741824 Sep 28 09:38:30 devstack sudo[104845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:30 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-074ae0ef-cbee-4dea-96d5-8e087410854c tempest-CreateVolumesFromImageTest-1946594272 None] Volume volume-010567c5-98c7-460b-907d-05bc05ae23c5 (010567c5-98c7-460b-907d-05bc05ae23c5): created successfully Sep 28 09:38:30 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-074ae0ef-cbee-4dea-96d5-8e087410854c tempest-CreateVolumesFromImageTest-1946594272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9cceebc-1bd4-4c8b-882c-db9f058875a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:30 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-074ae0ef-cbee-4dea-96d5-8e087410854c tempest-CreateVolumesFromImageTest-1946594272 None] Flow 'volume_create_manager' (6b942d3d-d03e-4b6e-a10d-308f69f2cf22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:38:30 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-074ae0ef-cbee-4dea-96d5-8e087410854c tempest-CreateVolumesFromImageTest-1946594272 None] Created volume successfully. Sep 28 09:38:30 devstack sudo[104842]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2333e792-5f59-42ad-8dd7-d6751bfeaa0a tempest-CreateVolumesFromSourceVolumeTest-729336995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-30fe1b43-0bee-432f-afda-a9278693caa2" returned: 0 in 0.300s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:30 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-2333e792-5f59-42ad-8dd7-d6751bfeaa0a tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Lock "cinder-quobyte-30fe1b43-0bee-432f-afda-a9278693caa2" released by "delete_volume" :: held 0.909s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:38:30 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-2333e792-5f59-42ad-8dd7-d6751bfeaa0a tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Created reservations ['37e88097-3d34-4920-a69d-e991037dfd8f', 'e516ce06-7a6b-4fec-b41f-21f22f6e866a', '422bda44-e1b1-4766-a2b3-25a3a128ba1c', 'd53ce712-5d0b-4a00-b260-e1b5907572b0'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:38:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-2333e792-5f59-42ad-8dd7-d6751bfeaa0a tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:38:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-2333e792-5f59-42ad-8dd7-d6751bfeaa0a tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:38:30 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-2333e792-5f59-42ad-8dd7-d6751bfeaa0a tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:38:30 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-2333e792-5f59-42ad-8dd7-d6751bfeaa0a tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:38:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-2333e792-5f59-42ad-8dd7-d6751bfeaa0a tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:38:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2333e792-5f59-42ad-8dd7-d6751bfeaa0a tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:30 devstack sudo[104850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:38:30 devstack sudo[104850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:30 devstack sudo[104845]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-7ff3b94a-fd68-4a79-bbe3-f5c107d61066 tempest-CreateVolumesFromImageTest-1946594272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-178c67c6-8870-4e13-9ffb-bf3d2746ac11 1073741824" returned: 0 in 0.484s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-7ff3b94a-fd68-4a79-bbe3-f5c107d61066 tempest-CreateVolumesFromImageTest-1946594272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-178c67c6-8870-4e13-9ffb-bf3d2746ac11 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:30 devstack sudo[104855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-178c67c6-8870-4e13-9ffb-bf3d2746ac11 Sep 28 09:38:30 devstack sudo[104855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:30 devstack sudo[104850]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2333e792-5f59-42ad-8dd7-d6751bfeaa0a tempest-CreateVolumesFromSourceVolumeTest-729336995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.283s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:30 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-2333e792-5f59-42ad-8dd7-d6751bfeaa0a tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:38:30 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-2333e792-5f59-42ad-8dd7-d6751bfeaa0a tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Deleted volume successfully. Sep 28 09:38:31 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-2333e792-5f59-42ad-8dd7-d6751bfeaa0a tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Lock "cinder-30fe1b43-0bee-432f-afda-a9278693caa2-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:38:31 devstack sudo[104855]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:31 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-7ff3b94a-fd68-4a79-bbe3-f5c107d61066 tempest-CreateVolumesFromImageTest-1946594272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-178c67c6-8870-4e13-9ffb-bf3d2746ac11" returned: 0 in 0.287s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:31 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-7ff3b94a-fd68-4a79-bbe3-f5c107d61066 tempest-CreateVolumesFromImageTest-1946594272 None] <== create_volume: return (821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:38:31 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-7ff3b94a-fd68-4a79-bbe3-f5c107d61066 tempest-CreateVolumesFromImageTest-1946594272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:38:31 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-d72edd2a-9e7f-49bf-8996-2f5418ee6f36 tempest-CreateVolumesFromImageTest-1946594272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.570s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:38:31 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-d72edd2a-9e7f-49bf-8996-2f5418ee6f36 tempest-CreateVolumesFromImageTest-1946594272 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:38:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-147536523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d195ea2-b8f6-4a5c-97bf-5140ebeab3e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74cd94f310a84494ab0b627a285e98aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:38:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:38:29Z,use_quota=True,user_id='322af0b602e94b378e1289aa063c8d9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:38:31 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-d72edd2a-9e7f-49bf-8996-2f5418ee6f36 tempest-CreateVolumesFromImageTest-1946594272 None] Creating volume 7d195ea2-b8f6-4a5c-97bf-5140ebeab3e0 {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:38:31 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-d72edd2a-9e7f-49bf-8996-2f5418ee6f36 tempest-CreateVolumesFromImageTest-1946594272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:38:31 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-d72edd2a-9e7f-49bf-8996-2f5418ee6f36 tempest-CreateVolumesFromImageTest-1946594272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:38:31 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-d72edd2a-9e7f-49bf-8996-2f5418ee6f36 tempest-CreateVolumesFromImageTest-1946594272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:38:31 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-d72edd2a-9e7f-49bf-8996-2f5418ee6f36 tempest-CreateVolumesFromImageTest-1946594272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:38:31 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-d72edd2a-9e7f-49bf-8996-2f5418ee6f36 tempest-CreateVolumesFromImageTest-1946594272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:38:31 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-d72edd2a-9e7f-49bf-8996-2f5418ee6f36 tempest-CreateVolumesFromImageTest-1946594272 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:38:31 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-d72edd2a-9e7f-49bf-8996-2f5418ee6f36 tempest-CreateVolumesFromImageTest-1946594272 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:38:31 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-d72edd2a-9e7f-49bf-8996-2f5418ee6f36 tempest-CreateVolumesFromImageTest-1946594272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-7d195ea2-b8f6-4a5c-97bf-5140ebeab3e0 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:31 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7ff3b94a-fd68-4a79-bbe3-f5c107d61066 tempest-CreateVolumesFromImageTest-1946594272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17877a1d-79b6-4d8f-85df-94204b532485) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-178c67c6-8870-4e13-9ffb-bf3d2746ac11', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:31 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7ff3b94a-fd68-4a79-bbe3-f5c107d61066 tempest-CreateVolumesFromImageTest-1946594272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d6f207b-aec7-457b-8152-bb72565cfc8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:31 devstack sudo[104861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-7d195ea2-b8f6-4a5c-97bf-5140ebeab3e0 1073741824 Sep 28 09:38:31 devstack sudo[104861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:31 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-7ff3b94a-fd68-4a79-bbe3-f5c107d61066 tempest-CreateVolumesFromImageTest-1946594272 None] Volume volume-178c67c6-8870-4e13-9ffb-bf3d2746ac11 (178c67c6-8870-4e13-9ffb-bf3d2746ac11): created successfully Sep 28 09:38:31 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7ff3b94a-fd68-4a79-bbe3-f5c107d61066 tempest-CreateVolumesFromImageTest-1946594272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d6f207b-aec7-457b-8152-bb72565cfc8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:31 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7ff3b94a-fd68-4a79-bbe3-f5c107d61066 tempest-CreateVolumesFromImageTest-1946594272 None] Flow 'volume_create_manager' (42e085fc-a40a-43c3-b57c-44af717993ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:38:31 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-7ff3b94a-fd68-4a79-bbe3-f5c107d61066 tempest-CreateVolumesFromImageTest-1946594272 None] Created volume successfully. Sep 28 09:38:31 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-96923169-0e4c-4999-8df4-786b6d7017c1 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Acquiring lock "cinder-5e444684-f857-4b70-889a-1ffb683b1cf6-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:38:31 devstack sudo[104861]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:31 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-d72edd2a-9e7f-49bf-8996-2f5418ee6f36 tempest-CreateVolumesFromImageTest-1946594272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-7d195ea2-b8f6-4a5c-97bf-5140ebeab3e0 1073741824" returned: 0 in 0.501s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:31 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-96923169-0e4c-4999-8df4-786b6d7017c1 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Lock "cinder-5e444684-f857-4b70-889a-1ffb683b1cf6-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:38:31 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-d72edd2a-9e7f-49bf-8996-2f5418ee6f36 tempest-CreateVolumesFromImageTest-1946594272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-7d195ea2-b8f6-4a5c-97bf-5140ebeab3e0 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:31 devstack sudo[104869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-7d195ea2-b8f6-4a5c-97bf-5140ebeab3e0 Sep 28 09:38:31 devstack sudo[104869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:31 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-96923169-0e4c-4999-8df4-786b6d7017c1 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Acquiring lock "cinder-quobyte-5e444684-f857-4b70-889a-1ffb683b1cf6" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:38:31 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-96923169-0e4c-4999-8df4-786b6d7017c1 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Lock "cinder-quobyte-5e444684-f857-4b70-889a-1ffb683b1cf6" acquired by "delete_volume" :: waited 0.021s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:38:31 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[e39916a4-bebe-4b50-80d7-c55da4109437]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:38:31 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-96923169-0e4c-4999-8df4-786b6d7017c1 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-5e444684-f857-4b70-889a-1ffb683b1cf6 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:31 devstack sudo[104871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-5e444684-f857-4b70-889a-1ffb683b1cf6 Sep 28 09:38:31 devstack sudo[104871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:32 devstack sudo[104869]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-d72edd2a-9e7f-49bf-8996-2f5418ee6f36 tempest-CreateVolumesFromImageTest-1946594272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-7d195ea2-b8f6-4a5c-97bf-5140ebeab3e0" returned: 0 in 0.279s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:32 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-d72edd2a-9e7f-49bf-8996-2f5418ee6f36 tempest-CreateVolumesFromImageTest-1946594272 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:38:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-d72edd2a-9e7f-49bf-8996-2f5418ee6f36 tempest-CreateVolumesFromImageTest-1946594272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.840s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:38:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-41f7fb3e-a9a1-4752-9f85-57d4836a42c6 tempest-CreateVolumesFromImageTest-1946594272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.823s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:38:32 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-41f7fb3e-a9a1-4752-9f85-57d4836a42c6 tempest-CreateVolumesFromImageTest-1946594272 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:38:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1842289433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fae5f881-546c-4a1d-bcf6-3c08349f70fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74cd94f310a84494ab0b627a285e98aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:38:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:38:30Z,use_quota=True,user_id='322af0b602e94b378e1289aa063c8d9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:38:32 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-41f7fb3e-a9a1-4752-9f85-57d4836a42c6 tempest-CreateVolumesFromImageTest-1946594272 None] Creating volume fae5f881-546c-4a1d-bcf6-3c08349f70fb {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:38:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-41f7fb3e-a9a1-4752-9f85-57d4836a42c6 tempest-CreateVolumesFromImageTest-1946594272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:38:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-41f7fb3e-a9a1-4752-9f85-57d4836a42c6 tempest-CreateVolumesFromImageTest-1946594272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:38:32 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-41f7fb3e-a9a1-4752-9f85-57d4836a42c6 tempest-CreateVolumesFromImageTest-1946594272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:38:32 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-41f7fb3e-a9a1-4752-9f85-57d4836a42c6 tempest-CreateVolumesFromImageTest-1946594272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:38:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-41f7fb3e-a9a1-4752-9f85-57d4836a42c6 tempest-CreateVolumesFromImageTest-1946594272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:38:32 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-41f7fb3e-a9a1-4752-9f85-57d4836a42c6 tempest-CreateVolumesFromImageTest-1946594272 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:38:32 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-41f7fb3e-a9a1-4752-9f85-57d4836a42c6 tempest-CreateVolumesFromImageTest-1946594272 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:38:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-41f7fb3e-a9a1-4752-9f85-57d4836a42c6 tempest-CreateVolumesFromImageTest-1946594272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-fae5f881-546c-4a1d-bcf6-3c08349f70fb 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:32 devstack sudo[104874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-fae5f881-546c-4a1d-bcf6-3c08349f70fb 1073741824 Sep 28 09:38:32 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-d72edd2a-9e7f-49bf-8996-2f5418ee6f36 tempest-CreateVolumesFromImageTest-1946594272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96e90bd0-7e49-4753-8fac-38cca4237ccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d195ea2-b8f6-4a5c-97bf-5140ebeab3e0', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:32 devstack sudo[104874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:32 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-d72edd2a-9e7f-49bf-8996-2f5418ee6f36 tempest-CreateVolumesFromImageTest-1946594272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80148955-c6d3-475a-bebb-571738e53110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:32 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-d72edd2a-9e7f-49bf-8996-2f5418ee6f36 tempest-CreateVolumesFromImageTest-1946594272 None] Volume volume-7d195ea2-b8f6-4a5c-97bf-5140ebeab3e0 (7d195ea2-b8f6-4a5c-97bf-5140ebeab3e0): created successfully Sep 28 09:38:32 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-d72edd2a-9e7f-49bf-8996-2f5418ee6f36 tempest-CreateVolumesFromImageTest-1946594272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80148955-c6d3-475a-bebb-571738e53110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:32 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-d72edd2a-9e7f-49bf-8996-2f5418ee6f36 tempest-CreateVolumesFromImageTest-1946594272 None] Flow 'volume_create_manager' (a8e06d56-02a6-41a6-94bf-093d20f174a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:38:32 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-d72edd2a-9e7f-49bf-8996-2f5418ee6f36 tempest-CreateVolumesFromImageTest-1946594272 None] Created volume successfully. Sep 28 09:38:32 devstack sudo[104871]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-96923169-0e4c-4999-8df4-786b6d7017c1 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-5e444684-f857-4b70-889a-1ffb683b1cf6" returned: 0 in 0.481s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-96923169-0e4c-4999-8df4-786b6d7017c1 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-5e444684-f857-4b70-889a-1ffb683b1cf6 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:32 devstack sudo[104880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-5e444684-f857-4b70-889a-1ffb683b1cf6 Sep 28 09:38:32 devstack sudo[104880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:32 devstack sudo[104880]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-96923169-0e4c-4999-8df4-786b6d7017c1 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-5e444684-f857-4b70-889a-1ffb683b1cf6" returned: 0 in 0.278s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:32 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-96923169-0e4c-4999-8df4-786b6d7017c1 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Lock "cinder-quobyte-5e444684-f857-4b70-889a-1ffb683b1cf6" released by "delete_volume" :: held 0.822s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:38:32 devstack sudo[104874]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-41f7fb3e-a9a1-4752-9f85-57d4836a42c6 tempest-CreateVolumesFromImageTest-1946594272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-fae5f881-546c-4a1d-bcf6-3c08349f70fb 1073741824" returned: 0 in 0.621s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:32 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-96923169-0e4c-4999-8df4-786b6d7017c1 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Created reservations ['6723cb17-3491-4141-9370-4d3f22c3551a', '8bc7b3ec-2ff9-4a26-90cc-6ccee29f05f4', 'ce102ec5-5c21-4a4c-b249-eb9f09ddc4cf', 'c4d18ec8-f9b2-4ad7-9e6d-249299cd6a14'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:38:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-41f7fb3e-a9a1-4752-9f85-57d4836a42c6 tempest-CreateVolumesFromImageTest-1946594272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-fae5f881-546c-4a1d-bcf6-3c08349f70fb {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:32 devstack sudo[104886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-fae5f881-546c-4a1d-bcf6-3c08349f70fb Sep 28 09:38:32 devstack sudo[104886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-96923169-0e4c-4999-8df4-786b6d7017c1 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:38:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-96923169-0e4c-4999-8df4-786b6d7017c1 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:38:32 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-96923169-0e4c-4999-8df4-786b6d7017c1 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:38:32 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-96923169-0e4c-4999-8df4-786b6d7017c1 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:38:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-96923169-0e4c-4999-8df4-786b6d7017c1 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:38:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-96923169-0e4c-4999-8df4-786b6d7017c1 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:32 devstack sudo[104888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:38:32 devstack sudo[104888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:32 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-0ec278d4-3294-4af7-a9d0-96b60b673589 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Acquiring lock "cinder-1a88704c-3dbb-427e-9d2c-e8f39729f744-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:38:32 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-0ec278d4-3294-4af7-a9d0-96b60b673589 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Lock "cinder-1a88704c-3dbb-427e-9d2c-e8f39729f744-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:38:32 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-0ec278d4-3294-4af7-a9d0-96b60b673589 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Acquiring lock "cinder-quobyte-1a88704c-3dbb-427e-9d2c-e8f39729f744" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:38:33 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-0ec278d4-3294-4af7-a9d0-96b60b673589 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Lock "cinder-quobyte-1a88704c-3dbb-427e-9d2c-e8f39729f744" acquired by "delete_volume" :: waited 0.022s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:38:33 devstack sudo[104886]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:33 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df21fb2-29fb-4d67-aa0f-5ac3a223228a]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:38:33 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0ec278d4-3294-4af7-a9d0-96b60b673589 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1a88704c-3dbb-427e-9d2c-e8f39729f744 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:33 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-41f7fb3e-a9a1-4752-9f85-57d4836a42c6 tempest-CreateVolumesFromImageTest-1946594272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-fae5f881-546c-4a1d-bcf6-3c08349f70fb" returned: 0 in 0.327s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:33 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-41f7fb3e-a9a1-4752-9f85-57d4836a42c6 tempest-CreateVolumesFromImageTest-1946594272 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:38:33 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-41f7fb3e-a9a1-4752-9f85-57d4836a42c6 tempest-CreateVolumesFromImageTest-1946594272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:38:33 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-41f7fb3e-a9a1-4752-9f85-57d4836a42c6 tempest-CreateVolumesFromImageTest-1946594272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9ba39ac-e77f-47d4-ba17-70ee2798d35d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fae5f881-546c-4a1d-bcf6-3c08349f70fb', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:33 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-41f7fb3e-a9a1-4752-9f85-57d4836a42c6 tempest-CreateVolumesFromImageTest-1946594272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1eb1211-5365-46c1-8e5c-9d9ec1d12240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:33 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-41f7fb3e-a9a1-4752-9f85-57d4836a42c6 tempest-CreateVolumesFromImageTest-1946594272 None] Volume volume-fae5f881-546c-4a1d-bcf6-3c08349f70fb (fae5f881-546c-4a1d-bcf6-3c08349f70fb): created successfully Sep 28 09:38:33 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-41f7fb3e-a9a1-4752-9f85-57d4836a42c6 tempest-CreateVolumesFromImageTest-1946594272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1eb1211-5365-46c1-8e5c-9d9ec1d12240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:33 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-41f7fb3e-a9a1-4752-9f85-57d4836a42c6 tempest-CreateVolumesFromImageTest-1946594272 None] Flow 'volume_create_manager' (14dc1fd8-344d-4e0f-ab0b-0f6fab645809) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:38:33 devstack sudo[104888]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:33 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-41f7fb3e-a9a1-4752-9f85-57d4836a42c6 tempest-CreateVolumesFromImageTest-1946594272 None] Created volume successfully. Sep 28 09:38:33 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-96923169-0e4c-4999-8df4-786b6d7017c1 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.336s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:33 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-96923169-0e4c-4999-8df4-786b6d7017c1 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:38:33 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-96923169-0e4c-4999-8df4-786b6d7017c1 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Deleted volume successfully. Sep 28 09:38:33 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-96923169-0e4c-4999-8df4-786b6d7017c1 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Lock "cinder-5e444684-f857-4b70-889a-1ffb683b1cf6-delete_volume" released by "delete_volume" :: held 1.428s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:38:33 devstack sudo[104891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1a88704c-3dbb-427e-9d2c-e8f39729f744 Sep 28 09:38:33 devstack sudo[104891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:33 devstack sudo[104891]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:33 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0ec278d4-3294-4af7-a9d0-96b60b673589 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1a88704c-3dbb-427e-9d2c-e8f39729f744" returned: 0 in 0.405s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:33 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0ec278d4-3294-4af7-a9d0-96b60b673589 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1a88704c-3dbb-427e-9d2c-e8f39729f744 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:33 devstack sudo[104897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1a88704c-3dbb-427e-9d2c-e8f39729f744 Sep 28 09:38:33 devstack sudo[104897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:33 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-0c391e0b-3ffc-4c9c-b8ab-e7b8c4f0d6e4 tempest-CreateVolumesFromImageTest-1946594272 None] Acquiring lock "cinder-fae5f881-546c-4a1d-bcf6-3c08349f70fb-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:38:33 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-0c391e0b-3ffc-4c9c-b8ab-e7b8c4f0d6e4 tempest-CreateVolumesFromImageTest-1946594272 None] Lock "cinder-fae5f881-546c-4a1d-bcf6-3c08349f70fb-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:38:33 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-0c391e0b-3ffc-4c9c-b8ab-e7b8c4f0d6e4 tempest-CreateVolumesFromImageTest-1946594272 None] Acquiring lock "cinder-quobyte-fae5f881-546c-4a1d-bcf6-3c08349f70fb" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:38:33 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-0c391e0b-3ffc-4c9c-b8ab-e7b8c4f0d6e4 tempest-CreateVolumesFromImageTest-1946594272 None] Lock "cinder-quobyte-fae5f881-546c-4a1d-bcf6-3c08349f70fb" acquired by "delete_volume" :: waited 0.021s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:38:33 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc94b5f0-3d21-43b6-a80d-b1d006a4c12a]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:38:33 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0c391e0b-3ffc-4c9c-b8ab-e7b8c4f0d6e4 tempest-CreateVolumesFromImageTest-1946594272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-fae5f881-546c-4a1d-bcf6-3c08349f70fb {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:33 devstack sudo[104897]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:33 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0ec278d4-3294-4af7-a9d0-96b60b673589 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1a88704c-3dbb-427e-9d2c-e8f39729f744" returned: 0 in 0.293s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:33 devstack sudo[104899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-fae5f881-546c-4a1d-bcf6-3c08349f70fb Sep 28 09:38:33 devstack sudo[104899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:33 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-0ec278d4-3294-4af7-a9d0-96b60b673589 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Lock "cinder-quobyte-1a88704c-3dbb-427e-9d2c-e8f39729f744" released by "delete_volume" :: held 0.765s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:38:33 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-0ec278d4-3294-4af7-a9d0-96b60b673589 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Created reservations ['20e43ae5-5a14-481f-9f8a-1ad1ada30cb1', '54cf29c0-0395-4f63-a8da-3abfa90cdc60', '749f384b-a509-48ee-b82a-53f7344ccb37', 'e85a4a11-2bfc-4d80-9360-b11883cad947'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:38:33 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-0ec278d4-3294-4af7-a9d0-96b60b673589 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:38:33 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-0ec278d4-3294-4af7-a9d0-96b60b673589 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:38:33 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-0ec278d4-3294-4af7-a9d0-96b60b673589 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:38:33 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-0ec278d4-3294-4af7-a9d0-96b60b673589 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:38:33 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-0ec278d4-3294-4af7-a9d0-96b60b673589 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:38:33 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0ec278d4-3294-4af7-a9d0-96b60b673589 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:33 devstack sudo[104902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:38:33 devstack sudo[104902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:34 devstack sudo[104899]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:34 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0c391e0b-3ffc-4c9c-b8ab-e7b8c4f0d6e4 tempest-CreateVolumesFromImageTest-1946594272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-fae5f881-546c-4a1d-bcf6-3c08349f70fb" returned: 0 in 0.413s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:34 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0c391e0b-3ffc-4c9c-b8ab-e7b8c4f0d6e4 tempest-CreateVolumesFromImageTest-1946594272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-fae5f881-546c-4a1d-bcf6-3c08349f70fb {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:34 devstack sudo[104907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-fae5f881-546c-4a1d-bcf6-3c08349f70fb Sep 28 09:38:34 devstack sudo[104907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:34 devstack sudo[104902]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:34 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0ec278d4-3294-4af7-a9d0-96b60b673589 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.276s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:34 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-0ec278d4-3294-4af7-a9d0-96b60b673589 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:38:34 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-0ec278d4-3294-4af7-a9d0-96b60b673589 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Deleted volume successfully. Sep 28 09:38:34 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-0ec278d4-3294-4af7-a9d0-96b60b673589 tempest-CreateVolumesFromSourceVolumeTest-729336995 None] Lock "cinder-1a88704c-3dbb-427e-9d2c-e8f39729f744-delete_volume" released by "delete_volume" :: held 1.299s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:38:34 devstack sudo[104907]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:34 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0c391e0b-3ffc-4c9c-b8ab-e7b8c4f0d6e4 tempest-CreateVolumesFromImageTest-1946594272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-fae5f881-546c-4a1d-bcf6-3c08349f70fb" returned: 0 in 0.279s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:34 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-0c391e0b-3ffc-4c9c-b8ab-e7b8c4f0d6e4 tempest-CreateVolumesFromImageTest-1946594272 None] Lock "cinder-quobyte-fae5f881-546c-4a1d-bcf6-3c08349f70fb" released by "delete_volume" :: held 0.734s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:38:34 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-0c391e0b-3ffc-4c9c-b8ab-e7b8c4f0d6e4 tempest-CreateVolumesFromImageTest-1946594272 None] Created reservations ['21b6e643-6042-4f97-baad-64c2d4391780', '8f459862-fa9d-4c14-b022-6ce2a47b5fc4', '05b25aa3-c902-44ab-820b-b4c40b86e1a4', 'b1b88016-6ba6-4b1c-982b-128b46458ecd'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:38:34 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-0c391e0b-3ffc-4c9c-b8ab-e7b8c4f0d6e4 tempest-CreateVolumesFromImageTest-1946594272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:38:34 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-0c391e0b-3ffc-4c9c-b8ab-e7b8c4f0d6e4 tempest-CreateVolumesFromImageTest-1946594272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:38:34 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-0c391e0b-3ffc-4c9c-b8ab-e7b8c4f0d6e4 tempest-CreateVolumesFromImageTest-1946594272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:38:34 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-0c391e0b-3ffc-4c9c-b8ab-e7b8c4f0d6e4 tempest-CreateVolumesFromImageTest-1946594272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:38:34 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-0c391e0b-3ffc-4c9c-b8ab-e7b8c4f0d6e4 tempest-CreateVolumesFromImageTest-1946594272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:38:34 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0c391e0b-3ffc-4c9c-b8ab-e7b8c4f0d6e4 tempest-CreateVolumesFromImageTest-1946594272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:34 devstack sudo[104915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:38:34 devstack sudo[104915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:34 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-3a017c5f-4b65-4aae-812f-1e36ba8db3dd tempest-CreateVolumesFromImageTest-1946594272 None] Acquiring lock "cinder-7d195ea2-b8f6-4a5c-97bf-5140ebeab3e0-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:38:34 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-3a017c5f-4b65-4aae-812f-1e36ba8db3dd tempest-CreateVolumesFromImageTest-1946594272 None] Lock "cinder-7d195ea2-b8f6-4a5c-97bf-5140ebeab3e0-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:38:34 devstack sudo[104915]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:34 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0c391e0b-3ffc-4c9c-b8ab-e7b8c4f0d6e4 tempest-CreateVolumesFromImageTest-1946594272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.305s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:34 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-0c391e0b-3ffc-4c9c-b8ab-e7b8c4f0d6e4 tempest-CreateVolumesFromImageTest-1946594272 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:38:34 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-0c391e0b-3ffc-4c9c-b8ab-e7b8c4f0d6e4 tempest-CreateVolumesFromImageTest-1946594272 None] Deleted volume successfully. Sep 28 09:38:34 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-3a017c5f-4b65-4aae-812f-1e36ba8db3dd tempest-CreateVolumesFromImageTest-1946594272 None] Acquiring lock "cinder-quobyte-7d195ea2-b8f6-4a5c-97bf-5140ebeab3e0" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:38:34 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-0c391e0b-3ffc-4c9c-b8ab-e7b8c4f0d6e4 tempest-CreateVolumesFromImageTest-1946594272 None] Lock "cinder-fae5f881-546c-4a1d-bcf6-3c08349f70fb-delete_volume" released by "delete_volume" :: held 1.331s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:38:34 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-3a017c5f-4b65-4aae-812f-1e36ba8db3dd tempest-CreateVolumesFromImageTest-1946594272 None] Lock "cinder-quobyte-7d195ea2-b8f6-4a5c-97bf-5140ebeab3e0" acquired by "delete_volume" :: waited 0.019s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:38:34 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[526cd47a-3be9-49bb-9976-98e820e5ce6a]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:38:34 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3a017c5f-4b65-4aae-812f-1e36ba8db3dd tempest-CreateVolumesFromImageTest-1946594272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-7d195ea2-b8f6-4a5c-97bf-5140ebeab3e0 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:35 devstack sudo[104921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-7d195ea2-b8f6-4a5c-97bf-5140ebeab3e0 Sep 28 09:38:35 devstack sudo[104921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:35 devstack sudo[104921]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:35 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3a017c5f-4b65-4aae-812f-1e36ba8db3dd tempest-CreateVolumesFromImageTest-1946594272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-7d195ea2-b8f6-4a5c-97bf-5140ebeab3e0" returned: 0 in 0.458s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:35 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3a017c5f-4b65-4aae-812f-1e36ba8db3dd tempest-CreateVolumesFromImageTest-1946594272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-7d195ea2-b8f6-4a5c-97bf-5140ebeab3e0 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:35 devstack sudo[104934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-7d195ea2-b8f6-4a5c-97bf-5140ebeab3e0 Sep 28 09:38:35 devstack sudo[104934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:35 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-19caf9a2-de42-41df-aea8-bb6c378eb3aa req-b6eff6d3-a877-4538-98a1-c44d22da04a2 tempest-TestStampPattern-708957854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:38:35 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-19caf9a2-de42-41df-aea8-bb6c378eb3aa req-b6eff6d3-a877-4538-98a1-c44d22da04a2 tempest-TestStampPattern-708957854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:38:35 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-19caf9a2-de42-41df-aea8-bb6c378eb3aa req-b6eff6d3-a877-4538-98a1-c44d22da04a2 tempest-TestStampPattern-708957854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:38:35 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [req-19caf9a2-de42-41df-aea8-bb6c378eb3aa req-b6eff6d3-a877-4538-98a1-c44d22da04a2 tempest-TestStampPattern-708957854 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d', 'name': 'volume-f8848ae3-33f7-4d6a-98ec-13d3d4d35dbd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3a724fe2-d768-4c28-9b7a-3124ca993557', 'enforce_multipath': True} {{(pid=86553) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 09:38:35 devstack cinder-volume[86553]: INFO cinder.volume.manager [req-19caf9a2-de42-41df-aea8-bb6c378eb3aa req-b6eff6d3-a877-4538-98a1-c44d22da04a2 tempest-TestStampPattern-708957854 None] attachment_update completed successfully. Sep 28 09:38:35 devstack sudo[104934]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:35 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3a017c5f-4b65-4aae-812f-1e36ba8db3dd tempest-CreateVolumesFromImageTest-1946594272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-7d195ea2-b8f6-4a5c-97bf-5140ebeab3e0" returned: 0 in 0.288s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:35 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-3a017c5f-4b65-4aae-812f-1e36ba8db3dd tempest-CreateVolumesFromImageTest-1946594272 None] Lock "cinder-quobyte-7d195ea2-b8f6-4a5c-97bf-5140ebeab3e0" released by "delete_volume" :: held 0.794s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:38:35 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-3a017c5f-4b65-4aae-812f-1e36ba8db3dd tempest-CreateVolumesFromImageTest-1946594272 None] Created reservations ['05520a0f-9b02-4953-a4ca-191bba54580c', '9e7ef377-ea4d-44e5-a7f4-630b2eef5078', '24eb6a66-37b7-4935-90ae-b43a622b4f62', 'ef129f1f-c911-46d7-91b2-d8fbd1b25a3c'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:38:35 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-3a017c5f-4b65-4aae-812f-1e36ba8db3dd tempest-CreateVolumesFromImageTest-1946594272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:38:35 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-3a017c5f-4b65-4aae-812f-1e36ba8db3dd tempest-CreateVolumesFromImageTest-1946594272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:38:35 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-3a017c5f-4b65-4aae-812f-1e36ba8db3dd tempest-CreateVolumesFromImageTest-1946594272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:38:35 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-3a017c5f-4b65-4aae-812f-1e36ba8db3dd tempest-CreateVolumesFromImageTest-1946594272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:38:35 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-3a017c5f-4b65-4aae-812f-1e36ba8db3dd tempest-CreateVolumesFromImageTest-1946594272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:38:35 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3a017c5f-4b65-4aae-812f-1e36ba8db3dd tempest-CreateVolumesFromImageTest-1946594272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:35 devstack sudo[105030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:38:35 devstack sudo[105030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:35 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-a14628b7-04c4-4be8-b96d-62db6280798e tempest-CreateVolumesFromImageTest-1946594272 None] Acquiring lock "cinder-178c67c6-8870-4e13-9ffb-bf3d2746ac11-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:38:36 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-a14628b7-04c4-4be8-b96d-62db6280798e tempest-CreateVolumesFromImageTest-1946594272 None] Lock "cinder-178c67c6-8870-4e13-9ffb-bf3d2746ac11-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:38:36 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-a14628b7-04c4-4be8-b96d-62db6280798e tempest-CreateVolumesFromImageTest-1946594272 None] Acquiring lock "cinder-quobyte-178c67c6-8870-4e13-9ffb-bf3d2746ac11" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:38:36 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-a14628b7-04c4-4be8-b96d-62db6280798e tempest-CreateVolumesFromImageTest-1946594272 None] Lock "cinder-quobyte-178c67c6-8870-4e13-9ffb-bf3d2746ac11" acquired by "delete_volume" :: waited 0.024s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:38:36 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[56427126-ed79-4fd5-9a59-650f87581a14]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:38:36 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a14628b7-04c4-4be8-b96d-62db6280798e tempest-CreateVolumesFromImageTest-1946594272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-178c67c6-8870-4e13-9ffb-bf3d2746ac11 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:36 devstack sudo[105030]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:36 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3a017c5f-4b65-4aae-812f-1e36ba8db3dd tempest-CreateVolumesFromImageTest-1946594272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.353s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:36 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-3a017c5f-4b65-4aae-812f-1e36ba8db3dd tempest-CreateVolumesFromImageTest-1946594272 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:38:36 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-3a017c5f-4b65-4aae-812f-1e36ba8db3dd tempest-CreateVolumesFromImageTest-1946594272 None] Deleted volume successfully. Sep 28 09:38:36 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-3a017c5f-4b65-4aae-812f-1e36ba8db3dd tempest-CreateVolumesFromImageTest-1946594272 None] Lock "cinder-7d195ea2-b8f6-4a5c-97bf-5140ebeab3e0-delete_volume" released by "delete_volume" :: held 1.450s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:38:36 devstack sudo[105354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-178c67c6-8870-4e13-9ffb-bf3d2746ac11 Sep 28 09:38:36 devstack sudo[105354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:36 devstack sudo[105354]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:36 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a14628b7-04c4-4be8-b96d-62db6280798e tempest-CreateVolumesFromImageTest-1946594272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-178c67c6-8870-4e13-9ffb-bf3d2746ac11" returned: 0 in 0.510s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:36 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a14628b7-04c4-4be8-b96d-62db6280798e tempest-CreateVolumesFromImageTest-1946594272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-178c67c6-8870-4e13-9ffb-bf3d2746ac11 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:36 devstack sudo[105361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-178c67c6-8870-4e13-9ffb-bf3d2746ac11 Sep 28 09:38:36 devstack sudo[105361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:36 devstack sudo[105361]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:36 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a14628b7-04c4-4be8-b96d-62db6280798e tempest-CreateVolumesFromImageTest-1946594272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-178c67c6-8870-4e13-9ffb-bf3d2746ac11" returned: 0 in 0.282s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:36 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-a14628b7-04c4-4be8-b96d-62db6280798e tempest-CreateVolumesFromImageTest-1946594272 None] Lock "cinder-quobyte-178c67c6-8870-4e13-9ffb-bf3d2746ac11" released by "delete_volume" :: held 0.856s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:38:36 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-a14628b7-04c4-4be8-b96d-62db6280798e tempest-CreateVolumesFromImageTest-1946594272 None] Created reservations ['d20245fb-6f0e-4fb0-b5d7-83a8d0b76f30', 'd9c54926-0dc6-4f04-b85d-e9211d6219b9', '8d96d3f1-17b6-489e-8519-07f389d1f00a', '14f36c75-4099-41bb-b721-6c3ffd53c605'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:38:37 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-a14628b7-04c4-4be8-b96d-62db6280798e tempest-CreateVolumesFromImageTest-1946594272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:38:37 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-a14628b7-04c4-4be8-b96d-62db6280798e tempest-CreateVolumesFromImageTest-1946594272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:38:37 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-a14628b7-04c4-4be8-b96d-62db6280798e tempest-CreateVolumesFromImageTest-1946594272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:38:37 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-a14628b7-04c4-4be8-b96d-62db6280798e tempest-CreateVolumesFromImageTest-1946594272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:38:37 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-a14628b7-04c4-4be8-b96d-62db6280798e tempest-CreateVolumesFromImageTest-1946594272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:38:37 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a14628b7-04c4-4be8-b96d-62db6280798e tempest-CreateVolumesFromImageTest-1946594272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:37 devstack sudo[105364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:38:37 devstack sudo[105364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:37 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-75e49795-75c4-4ff7-a768-55c17bba4e5d tempest-CreateVolumesFromImageTest-1946594272 None] Acquiring lock "cinder-010567c5-98c7-460b-907d-05bc05ae23c5-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:38:37 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-75e49795-75c4-4ff7-a768-55c17bba4e5d tempest-CreateVolumesFromImageTest-1946594272 None] Lock "cinder-010567c5-98c7-460b-907d-05bc05ae23c5-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:38:37 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-75e49795-75c4-4ff7-a768-55c17bba4e5d tempest-CreateVolumesFromImageTest-1946594272 None] Acquiring lock "cinder-quobyte-010567c5-98c7-460b-907d-05bc05ae23c5" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:38:37 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-75e49795-75c4-4ff7-a768-55c17bba4e5d tempest-CreateVolumesFromImageTest-1946594272 None] Lock "cinder-quobyte-010567c5-98c7-460b-907d-05bc05ae23c5" acquired by "delete_volume" :: waited 0.019s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:38:37 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dbf6d09-f355-4fb7-815c-23349f056875]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:38:37 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-75e49795-75c4-4ff7-a768-55c17bba4e5d tempest-CreateVolumesFromImageTest-1946594272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-010567c5-98c7-460b-907d-05bc05ae23c5 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:37 devstack sudo[105364]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:37 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a14628b7-04c4-4be8-b96d-62db6280798e tempest-CreateVolumesFromImageTest-1946594272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.307s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:37 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-a14628b7-04c4-4be8-b96d-62db6280798e tempest-CreateVolumesFromImageTest-1946594272 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:38:37 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-a14628b7-04c4-4be8-b96d-62db6280798e tempest-CreateVolumesFromImageTest-1946594272 None] Deleted volume successfully. Sep 28 09:38:37 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-a14628b7-04c4-4be8-b96d-62db6280798e tempest-CreateVolumesFromImageTest-1946594272 None] Lock "cinder-178c67c6-8870-4e13-9ffb-bf3d2746ac11-delete_volume" released by "delete_volume" :: held 1.405s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:38:37 devstack sudo[105367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-010567c5-98c7-460b-907d-05bc05ae23c5 Sep 28 09:38:37 devstack sudo[105367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:37 devstack sudo[105367]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:37 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-75e49795-75c4-4ff7-a768-55c17bba4e5d tempest-CreateVolumesFromImageTest-1946594272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-010567c5-98c7-460b-907d-05bc05ae23c5" returned: 0 in 0.426s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:37 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-75e49795-75c4-4ff7-a768-55c17bba4e5d tempest-CreateVolumesFromImageTest-1946594272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-010567c5-98c7-460b-907d-05bc05ae23c5 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:37 devstack sudo[105378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-010567c5-98c7-460b-907d-05bc05ae23c5 Sep 28 09:38:37 devstack sudo[105378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:37 devstack sudo[105378]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:37 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-75e49795-75c4-4ff7-a768-55c17bba4e5d tempest-CreateVolumesFromImageTest-1946594272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-010567c5-98c7-460b-907d-05bc05ae23c5" returned: 0 in 0.274s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:38 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-75e49795-75c4-4ff7-a768-55c17bba4e5d tempest-CreateVolumesFromImageTest-1946594272 None] Lock "cinder-quobyte-010567c5-98c7-460b-907d-05bc05ae23c5" released by "delete_volume" :: held 0.761s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:38:38 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-75e49795-75c4-4ff7-a768-55c17bba4e5d tempest-CreateVolumesFromImageTest-1946594272 None] Created reservations ['031d6655-8fee-4780-a2f4-f3fe06a011a4', '010652f6-c32f-4022-9de7-17e5ed99399a', 'd8242039-7ac3-42b9-9f03-a0c85cf3b9e1', '991b790d-54a3-44a8-ae1f-659f4767c7b8'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:38:38 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-75e49795-75c4-4ff7-a768-55c17bba4e5d tempest-CreateVolumesFromImageTest-1946594272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:38:38 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-75e49795-75c4-4ff7-a768-55c17bba4e5d tempest-CreateVolumesFromImageTest-1946594272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:38:38 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-75e49795-75c4-4ff7-a768-55c17bba4e5d tempest-CreateVolumesFromImageTest-1946594272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:38:38 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-75e49795-75c4-4ff7-a768-55c17bba4e5d tempest-CreateVolumesFromImageTest-1946594272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:38:38 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-75e49795-75c4-4ff7-a768-55c17bba4e5d tempest-CreateVolumesFromImageTest-1946594272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:38:38 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-75e49795-75c4-4ff7-a768-55c17bba4e5d tempest-CreateVolumesFromImageTest-1946594272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:38 devstack sudo[105386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:38:38 devstack sudo[105386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:38 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-a69f27c5-9163-4ff6-8eb6-0cb982e1b25a tempest-CreateVolumesFromImageTest-1946594272 None] Acquiring lock "cinder-ae91d86f-12e8-4b7c-9c50-233a6e3c9cc8-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:38:38 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-a69f27c5-9163-4ff6-8eb6-0cb982e1b25a tempest-CreateVolumesFromImageTest-1946594272 None] Lock "cinder-ae91d86f-12e8-4b7c-9c50-233a6e3c9cc8-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:38:38 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-a69f27c5-9163-4ff6-8eb6-0cb982e1b25a tempest-CreateVolumesFromImageTest-1946594272 None] Acquiring lock "cinder-quobyte-ae91d86f-12e8-4b7c-9c50-233a6e3c9cc8" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:38:38 devstack sudo[105386]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:38 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-a69f27c5-9163-4ff6-8eb6-0cb982e1b25a tempest-CreateVolumesFromImageTest-1946594272 None] Lock "cinder-quobyte-ae91d86f-12e8-4b7c-9c50-233a6e3c9cc8" acquired by "delete_volume" :: waited 0.023s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:38:38 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-75e49795-75c4-4ff7-a768-55c17bba4e5d tempest-CreateVolumesFromImageTest-1946594272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.368s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:38 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-75e49795-75c4-4ff7-a768-55c17bba4e5d tempest-CreateVolumesFromImageTest-1946594272 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:38:38 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-75e49795-75c4-4ff7-a768-55c17bba4e5d tempest-CreateVolumesFromImageTest-1946594272 None] Deleted volume successfully. Sep 28 09:38:38 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d66d671-410b-4bbb-b1b3-11d4cd7e032d]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:38:38 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a69f27c5-9163-4ff6-8eb6-0cb982e1b25a tempest-CreateVolumesFromImageTest-1946594272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-ae91d86f-12e8-4b7c-9c50-233a6e3c9cc8 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:38 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-75e49795-75c4-4ff7-a768-55c17bba4e5d tempest-CreateVolumesFromImageTest-1946594272 None] Lock "cinder-010567c5-98c7-460b-907d-05bc05ae23c5-delete_volume" released by "delete_volume" :: held 1.376s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:38:38 devstack sudo[105389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-ae91d86f-12e8-4b7c-9c50-233a6e3c9cc8 Sep 28 09:38:38 devstack sudo[105389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:38 devstack sudo[105389]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:38 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a69f27c5-9163-4ff6-8eb6-0cb982e1b25a tempest-CreateVolumesFromImageTest-1946594272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-ae91d86f-12e8-4b7c-9c50-233a6e3c9cc8" returned: 0 in 0.421s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:38 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a69f27c5-9163-4ff6-8eb6-0cb982e1b25a tempest-CreateVolumesFromImageTest-1946594272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-ae91d86f-12e8-4b7c-9c50-233a6e3c9cc8 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:38 devstack sudo[105396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-ae91d86f-12e8-4b7c-9c50-233a6e3c9cc8 Sep 28 09:38:38 devstack sudo[105396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:39 devstack sudo[105396]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a69f27c5-9163-4ff6-8eb6-0cb982e1b25a tempest-CreateVolumesFromImageTest-1946594272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-ae91d86f-12e8-4b7c-9c50-233a6e3c9cc8" returned: 0 in 0.271s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:39 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-a69f27c5-9163-4ff6-8eb6-0cb982e1b25a tempest-CreateVolumesFromImageTest-1946594272 None] Lock "cinder-quobyte-ae91d86f-12e8-4b7c-9c50-233a6e3c9cc8" released by "delete_volume" :: held 0.753s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:38:39 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-a69f27c5-9163-4ff6-8eb6-0cb982e1b25a tempest-CreateVolumesFromImageTest-1946594272 None] Created reservations ['1a45baca-badf-4d55-899d-a0bcd0af5e27', '37d172c0-e91a-4065-9784-3d4fff248c20', 'faf46439-b366-44ba-a9be-f6cefac62394', '7edef564-2928-4649-92a3-bc331b5f49c3'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:38:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-a69f27c5-9163-4ff6-8eb6-0cb982e1b25a tempest-CreateVolumesFromImageTest-1946594272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:38:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-a69f27c5-9163-4ff6-8eb6-0cb982e1b25a tempest-CreateVolumesFromImageTest-1946594272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:38:39 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-a69f27c5-9163-4ff6-8eb6-0cb982e1b25a tempest-CreateVolumesFromImageTest-1946594272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:38:39 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-a69f27c5-9163-4ff6-8eb6-0cb982e1b25a tempest-CreateVolumesFromImageTest-1946594272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:38:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-a69f27c5-9163-4ff6-8eb6-0cb982e1b25a tempest-CreateVolumesFromImageTest-1946594272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:38:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a69f27c5-9163-4ff6-8eb6-0cb982e1b25a tempest-CreateVolumesFromImageTest-1946594272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:39 devstack sudo[105399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:38:39 devstack sudo[105399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:39 devstack sudo[105399]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a69f27c5-9163-4ff6-8eb6-0cb982e1b25a tempest-CreateVolumesFromImageTest-1946594272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.280s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:39 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-a69f27c5-9163-4ff6-8eb6-0cb982e1b25a tempest-CreateVolumesFromImageTest-1946594272 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:38:39 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-a69f27c5-9163-4ff6-8eb6-0cb982e1b25a tempest-CreateVolumesFromImageTest-1946594272 None] Deleted volume successfully. Sep 28 09:38:39 devstack cinder-volume[86553]: DEBUG dbcounter [-] [86553] Writing DB stats cinder:UPDATE=162,cinder:SELECT=126,cinder:DELETE=17,cinder:INSERT=51 {{(pid=86553) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 09:38:39 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-a69f27c5-9163-4ff6-8eb6-0cb982e1b25a tempest-CreateVolumesFromImageTest-1946594272 None] Lock "cinder-ae91d86f-12e8-4b7c-9c50-233a6e3c9cc8-delete_volume" released by "delete_volume" :: held 1.318s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:38:40 devstack cinder-volume[86553]: DEBUG dbcounter [-] [86553] Writing DB stats cinder:SELECT=120,cinder:UPDATE=173,cinder:INSERT=35,cinder:DELETE=13 {{(pid=86553) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 09:38:40 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccba4e22-88fe-48c8-865a-05fe04dcc191 tempest-VolumeImageDependencyTests-1072874558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:38:40 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ccba4e22-88fe-48c8-865a-05fe04dcc191 tempest-VolumeImageDependencyTests-1072874558 None] Flow 'volume_create_manager' (b1fc3778-59c7-4bcb-9604-404ac2e41c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:38:40 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ccba4e22-88fe-48c8-865a-05fe04dcc191 tempest-VolumeImageDependencyTests-1072874558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e3f9f81-ed0a-4c1f-9324-e6ce8639c358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:40 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ccba4e22-88fe-48c8-865a-05fe04dcc191 tempest-VolumeImageDependencyTests-1072874558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e3f9f81-ed0a-4c1f-9324-e6ce8639c358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:38:40Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb193ad4-ba54-48fb-a2d5-9b92b5d41058,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2a24b011de341cf9c366be02a187c31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:38:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:38:41Z,use_quota=True,user_id='0d44ff328cd0471a9db537946c206efc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:40 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ccba4e22-88fe-48c8-865a-05fe04dcc191 tempest-VolumeImageDependencyTests-1072874558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (970b2000-c241-4090-827a-ed4987b78e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:40 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ccba4e22-88fe-48c8-865a-05fe04dcc191 tempest-VolumeImageDependencyTests-1072874558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (970b2000-c241-4090-827a-ed4987b78e0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:40 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ccba4e22-88fe-48c8-865a-05fe04dcc191 tempest-VolumeImageDependencyTests-1072874558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e6c64ce-6048-4715-b34d-8ae8357033ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:40 devstack cinder-volume[86553]: DEBUG cinder.image.glance [None req-ccba4e22-88fe-48c8-865a-05fe04dcc191 tempest-VolumeImageDependencyTests-1072874558 None] Creating Keystone auth plugin from conf {{(pid=86553) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 09:38:41 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ccba4e22-88fe-48c8-865a-05fe04dcc191 tempest-VolumeImageDependencyTests-1072874558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e6c64ce-6048-4715-b34d-8ae8357033ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bb193ad4-ba54-48fb-a2d5-9b92b5d41058', 'volume_name': 'volume-bb193ad4-ba54-48fb-a2d5-9b92b5d41058', 'volume_size': 1, 'image_id': '42deabeb-8640-4133-98fc-c1623f4ac0cd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/42deabeb-8640-4133-98fc-c1623f4ac0cd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '94b27c21a298f96956df00daf21a9c27', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd2a24b011de341cf9c366be02a187c31', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5e341a3a4d1020e5e2eadbeeda36d00ee86eeb632e903be372859098d66667364a964d25eb9886949692b6208c05013cb4660fa5a0118acc2353d900bc341b50', 'id': '42deabeb-8640-4133-98fc-c1623f4ac0cd', 'created_at': datetime.datetime(2026, 9, 28, 7, 38, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 7, 38, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/42deabeb-8640-4133-98fc-c1623f4ac0cd/file', 'properties': {}}, 'image_service': }' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:41 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ccba4e22-88fe-48c8-865a-05fe04dcc191 tempest-VolumeImageDependencyTests-1072874558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2ff7f79-c247-42b9-9cf5-6f6ec59de148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:41 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ccba4e22-88fe-48c8-865a-05fe04dcc191 tempest-VolumeImageDependencyTests-1072874558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2ff7f79-c247-42b9-9cf5-6f6ec59de148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:41 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ccba4e22-88fe-48c8-865a-05fe04dcc191 tempest-VolumeImageDependencyTests-1072874558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (546f56dc-396d-404a-abb8-e163afa24b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:41 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-ccba4e22-88fe-48c8-865a-05fe04dcc191 tempest-VolumeImageDependencyTests-1072874558 None] Volume bb193ad4-ba54-48fb-a2d5-9b92b5d41058: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bb193ad4-ba54-48fb-a2d5-9b92b5d41058', 'volume_size': 1, 'image_id': '42deabeb-8640-4133-98fc-c1623f4ac0cd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/42deabeb-8640-4133-98fc-c1623f4ac0cd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '94b27c21a298f96956df00daf21a9c27', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd2a24b011de341cf9c366be02a187c31', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5e341a3a4d1020e5e2eadbeeda36d00ee86eeb632e903be372859098d66667364a964d25eb9886949692b6208c05013cb4660fa5a0118acc2353d900bc341b50', 'id': '42deabeb-8640-4133-98fc-c1623f4ac0cd', 'created_at': datetime.datetime(2026, 9, 28, 7, 38, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 7, 38, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/42deabeb-8640-4133-98fc-c1623f4ac0cd/file', 'properties': {}}, 'image_service': } Sep 28 09:38:41 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccba4e22-88fe-48c8-865a-05fe04dcc191 tempest-VolumeImageDependencyTests-1072874558 None] Trying to clone bb193ad4-ba54-48fb-a2d5-9b92b5d41058 from image 42deabeb-8640-4133-98fc-c1623f4ac0cd at location (None, [{'url': 'file:///opt/stack/data/glance/images/42deabeb-8640-4133-98fc-c1623f4ac0cd', 'metadata': {}}]). {{(pid=86553) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 09:38:41 devstack cinder-volume[86553]: DEBUG cinder.image.image_utils [None req-ccba4e22-88fe-48c8-865a-05fe04dcc191 tempest-VolumeImageDependencyTests-1072874558 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_42deabeb-8640-4133-98fc-c1623f4ac0cd_02s6ri4tdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86553) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 09:38:41 devstack cinder-volume[86553]: INFO cinder.image.image_utils [None req-ccba4e22-88fe-48c8-865a-05fe04dcc191 tempest-VolumeImageDependencyTests-1072874558 None] Image download 0.00 MB at 0.00 MB/s Sep 28 09:38:41 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2aa8fe5-5c05-4440-b64d-b3c6c45c39b2]: (4, 'raw') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:38:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ccba4e22-88fe-48c8-865a-05fe04dcc191 tempest-VolumeImageDependencyTests-1072874558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_42deabeb-8640-4133-98fc-c1623f4ac0cd_02s6ri4tdevstack@QuobyteHD {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:41 devstack sudo[105414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_42deabeb-8640-4133-98fc-c1623f4ac0cd_02s6ri4tdevstack@QuobyteHD Sep 28 09:38:41 devstack sudo[105414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:41 devstack cinder-volume[86553]: INFO cinder.volume.manager [req-fcf26a77-06b9-4f61-b09e-a42aefd3d25a req-9f32d2dc-d359-4b09-9fef-464bfd9ab210 tempest-TestStampPattern-708957854 None] Terminate volume connection completed successfully. Sep 28 09:38:41 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [req-fcf26a77-06b9-4f61-b09e-a42aefd3d25a req-9f32d2dc-d359-4b09-9fef-464bfd9ab210 tempest-TestStampPattern-708957854 None] Deleting attachment 3a724fe2-d768-4c28-9b7a-3124ca993557. {{(pid=86553) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 09:38:41 devstack sudo[105414]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ccba4e22-88fe-48c8-865a-05fe04dcc191 tempest-VolumeImageDependencyTests-1072874558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_42deabeb-8640-4133-98fc-c1623f4ac0cd_02s6ri4tdevstack@QuobyteHD" returned: 0 in 0.409s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ccba4e22-88fe-48c8-865a-05fe04dcc191 tempest-VolumeImageDependencyTests-1072874558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_42deabeb-8640-4133-98fc-c1623f4ac0cd_02s6ri4tdevstack@QuobyteHD {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:41 devstack sudo[105447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_42deabeb-8640-4133-98fc-c1623f4ac0cd_02s6ri4tdevstack@QuobyteHD Sep 28 09:38:41 devstack sudo[105447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:42 devstack sudo[105447]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ccba4e22-88fe-48c8-865a-05fe04dcc191 tempest-VolumeImageDependencyTests-1072874558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_42deabeb-8640-4133-98fc-c1623f4ac0cd_02s6ri4tdevstack@QuobyteHD" returned: 1 in 0.351s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ccba4e22-88fe-48c8-865a-05fe04dcc191 tempest-VolumeImageDependencyTests-1072874558 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_42deabeb-8640-4133-98fc-c1623f4ac0cd_02s6ri4tdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 09:38:42 devstack cinder-volume[86553]: DEBUG cinder.image.image_utils [None req-ccba4e22-88fe-48c8-865a-05fe04dcc191 tempest-VolumeImageDependencyTests-1072874558 None] Temporary image 42deabeb-8640-4133-98fc-c1623f4ac0cd is fetched for user 0d44ff328cd0471a9db537946c206efc. {{(pid=86553) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 09:38:42 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[6276942e-4b99-4e16-a890-30c899684f22]: (4, 'raw') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:38:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ccba4e22-88fe-48c8-865a-05fe04dcc191 tempest-VolumeImageDependencyTests-1072874558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_42deabeb-8640-4133-98fc-c1623f4ac0cd_02s6ri4tdevstack@QuobyteHD {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:42 devstack sudo[105453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_42deabeb-8640-4133-98fc-c1623f4ac0cd_02s6ri4tdevstack@QuobyteHD Sep 28 09:38:42 devstack sudo[105453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-fa233440-e8c0-4133-ad28-943bf10eaf3b tempest-TestStampPattern-708957854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:38:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-fa233440-e8c0-4133-ad28-943bf10eaf3b tempest-TestStampPattern-708957854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:38:42 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-fa233440-e8c0-4133-ad28-943bf10eaf3b tempest-TestStampPattern-708957854 None] Creating offline snapshot 1029b85b-8cdd-41df-be71-5eb500190aee of volume f8848ae3-33f7-4d6a-98ec-13d3d4d35dbd {{(pid=86553) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 09:38:42 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[59ce2535-5e32-4d4c-b9b3-b43ce86bb4ec]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:38:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-fa233440-e8c0-4133-ad28-943bf10eaf3b tempest-TestStampPattern-708957854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f8848ae3-33f7-4d6a-98ec-13d3d4d35dbd {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:42 devstack sudo[105453]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ccba4e22-88fe-48c8-865a-05fe04dcc191 tempest-VolumeImageDependencyTests-1072874558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_42deabeb-8640-4133-98fc-c1623f4ac0cd_02s6ri4tdevstack@QuobyteHD" returned: 0 in 0.373s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ccba4e22-88fe-48c8-865a-05fe04dcc191 tempest-VolumeImageDependencyTests-1072874558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_42deabeb-8640-4133-98fc-c1623f4ac0cd_02s6ri4tdevstack@QuobyteHD {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:42 devstack sudo[105455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f8848ae3-33f7-4d6a-98ec-13d3d4d35dbd Sep 28 09:38:42 devstack sudo[105455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:42 devstack sudo[105459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_42deabeb-8640-4133-98fc-c1623f4ac0cd_02s6ri4tdevstack@QuobyteHD Sep 28 09:38:42 devstack sudo[105459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:42 devstack sudo[105455]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-fa233440-e8c0-4133-ad28-943bf10eaf3b tempest-TestStampPattern-708957854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f8848ae3-33f7-4d6a-98ec-13d3d4d35dbd" returned: 0 in 0.447s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-fa233440-e8c0-4133-ad28-943bf10eaf3b tempest-TestStampPattern-708957854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f8848ae3-33f7-4d6a-98ec-13d3d4d35dbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f8848ae3-33f7-4d6a-98ec-13d3d4d35dbd.1029b85b-8cdd-41df-be71-5eb500190aee 1G {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:42 devstack sudo[105459]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ccba4e22-88fe-48c8-865a-05fe04dcc191 tempest-VolumeImageDependencyTests-1072874558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_42deabeb-8640-4133-98fc-c1623f4ac0cd_02s6ri4tdevstack@QuobyteHD" returned: 1 in 0.367s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ccba4e22-88fe-48c8-865a-05fe04dcc191 tempest-VolumeImageDependencyTests-1072874558 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_42deabeb-8640-4133-98fc-c1623f4ac0cd_02s6ri4tdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 09:38:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ccba4e22-88fe-48c8-865a-05fe04dcc191 tempest-VolumeImageDependencyTests-1072874558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:38:42 devstack sudo[105467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f8848ae3-33f7-4d6a-98ec-13d3d4d35dbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f8848ae3-33f7-4d6a-98ec-13d3d4d35dbd.1029b85b-8cdd-41df-be71-5eb500190aee 1G Sep 28 09:38:42 devstack sudo[105467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:42 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-be8f9837-84fd-482a-a0b0-aa8a9db6eaef tempest-CinderUnicodeTest-231430199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:38:42 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-be8f9837-84fd-482a-a0b0-aa8a9db6eaef tempest-CinderUnicodeTest-231430199 None] Flow 'volume_create_manager' (e65b4aa6-7d59-4f3b-aacc-257a6282bd2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:38:42 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-be8f9837-84fd-482a-a0b0-aa8a9db6eaef tempest-CinderUnicodeTest-231430199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aad5aa6a-0796-48bb-aaca-5ce0dfcace7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:43 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-be8f9837-84fd-482a-a0b0-aa8a9db6eaef tempest-CinderUnicodeTest-231430199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aad5aa6a-0796-48bb-aaca-5ce0dfcace7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:38:43Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ade8553e-26fc-4742-be74-9e4891c57e04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c016a949e882456cbdb9f02658648e64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:38:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:38:43Z,use_quota=True,user_id='8dccd5bd4fe84116ae52095ff7864b34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:43 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-be8f9837-84fd-482a-a0b0-aa8a9db6eaef tempest-CinderUnicodeTest-231430199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7a7f62f-d748-4c17-82ec-2ad9df458a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:43 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-be8f9837-84fd-482a-a0b0-aa8a9db6eaef tempest-CinderUnicodeTest-231430199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7a7f62f-d748-4c17-82ec-2ad9df458a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:43 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-be8f9837-84fd-482a-a0b0-aa8a9db6eaef tempest-CinderUnicodeTest-231430199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a98e68c0-2381-435e-a122-f3bc70b51826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:43 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-be8f9837-84fd-482a-a0b0-aa8a9db6eaef tempest-CinderUnicodeTest-231430199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a98e68c0-2381-435e-a122-f3bc70b51826) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ade8553e-26fc-4742-be74-9e4891c57e04', 'volume_name': 'volume-ade8553e-26fc-4742-be74-9e4891c57e04', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:43 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-be8f9837-84fd-482a-a0b0-aa8a9db6eaef tempest-CinderUnicodeTest-231430199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8322586-f8fc-4c3d-8827-c9fa94962b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:43 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-be8f9837-84fd-482a-a0b0-aa8a9db6eaef tempest-CinderUnicodeTest-231430199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8322586-f8fc-4c3d-8827-c9fa94962b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:43 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-be8f9837-84fd-482a-a0b0-aa8a9db6eaef tempest-CinderUnicodeTest-231430199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ef43ff1-d0f3-452f-a4fd-6c2062e49872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:43 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-be8f9837-84fd-482a-a0b0-aa8a9db6eaef tempest-CinderUnicodeTest-231430199 None] Volume ade8553e-26fc-4742-be74-9e4891c57e04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ade8553e-26fc-4742-be74-9e4891c57e04', 'volume_size': 1} Sep 28 09:38:43 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-be8f9837-84fd-482a-a0b0-aa8a9db6eaef tempest-CinderUnicodeTest-231430199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:38:43 devstack sudo[105467]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:43 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-fa233440-e8c0-4133-ad28-943bf10eaf3b tempest-TestStampPattern-708957854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f8848ae3-33f7-4d6a-98ec-13d3d4d35dbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f8848ae3-33f7-4d6a-98ec-13d3d4d35dbd.1029b85b-8cdd-41df-be71-5eb500190aee 1G" returned: 0 in 0.413s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:43 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-fa233440-e8c0-4133-ad28-943bf10eaf3b tempest-TestStampPattern-708957854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8848ae3-33f7-4d6a-98ec-13d3d4d35dbd -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f8848ae3-33f7-4d6a-98ec-13d3d4d35dbd.1029b85b-8cdd-41df-be71-5eb500190aee {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:43 devstack sudo[105472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8848ae3-33f7-4d6a-98ec-13d3d4d35dbd -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f8848ae3-33f7-4d6a-98ec-13d3d4d35dbd.1029b85b-8cdd-41df-be71-5eb500190aee Sep 28 09:38:43 devstack sudo[105472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:43 devstack sudo[105472]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:43 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-fa233440-e8c0-4133-ad28-943bf10eaf3b tempest-TestStampPattern-708957854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8848ae3-33f7-4d6a-98ec-13d3d4d35dbd -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f8848ae3-33f7-4d6a-98ec-13d3d4d35dbd.1029b85b-8cdd-41df-be71-5eb500190aee" returned: 0 in 0.292s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:43 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-fa233440-e8c0-4133-ad28-943bf10eaf3b tempest-TestStampPattern-708957854 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f8848ae3-33f7-4d6a-98ec-13d3d4d35dbd.1029b85b-8cdd-41df-be71-5eb500190aee is being set with open permissions: ugo+rw Sep 28 09:38:43 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-fa233440-e8c0-4133-ad28-943bf10eaf3b tempest-TestStampPattern-708957854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f8848ae3-33f7-4d6a-98ec-13d3d4d35dbd.1029b85b-8cdd-41df-be71-5eb500190aee {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:43 devstack sudo[105478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f8848ae3-33f7-4d6a-98ec-13d3d4d35dbd.1029b85b-8cdd-41df-be71-5eb500190aee Sep 28 09:38:43 devstack sudo[105478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:43 devstack sudo[105478]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:43 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-fa233440-e8c0-4133-ad28-943bf10eaf3b tempest-TestStampPattern-708957854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f8848ae3-33f7-4d6a-98ec-13d3d4d35dbd.1029b85b-8cdd-41df-be71-5eb500190aee" returned: 0 in 0.250s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:43 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-fa233440-e8c0-4133-ad28-943bf10eaf3b tempest-TestStampPattern-708957854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f8848ae3-33f7-4d6a-98ec-13d3d4d35dbd.info {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:43 devstack sudo[105481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f8848ae3-33f7-4d6a-98ec-13d3d4d35dbd.info Sep 28 09:38:43 devstack sudo[105481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:44 devstack sudo[105481]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-fa233440-e8c0-4133-ad28-943bf10eaf3b tempest-TestStampPattern-708957854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f8848ae3-33f7-4d6a-98ec-13d3d4d35dbd.info" returned: 0 in 0.274s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:44 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-fa233440-e8c0-4133-ad28-943bf10eaf3b tempest-TestStampPattern-708957854 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f8848ae3-33f7-4d6a-98ec-13d3d4d35dbd.info is being set with open permissions: ugo+rw Sep 28 09:38:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-fa233440-e8c0-4133-ad28-943bf10eaf3b tempest-TestStampPattern-708957854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f8848ae3-33f7-4d6a-98ec-13d3d4d35dbd.info {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:44 devstack sudo[105484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f8848ae3-33f7-4d6a-98ec-13d3d4d35dbd.info Sep 28 09:38:44 devstack sudo[105484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:44 devstack sudo[105484]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-fa233440-e8c0-4133-ad28-943bf10eaf3b tempest-TestStampPattern-708957854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f8848ae3-33f7-4d6a-98ec-13d3d4d35dbd.info" returned: 0 in 0.253s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-fa233440-e8c0-4133-ad28-943bf10eaf3b tempest-TestStampPattern-708957854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.027s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:38:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ccba4e22-88fe-48c8-865a-05fe04dcc191 tempest-VolumeImageDependencyTests-1072874558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.517s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:38:44 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ccba4e22-88fe-48c8-865a-05fe04dcc191 tempest-VolumeImageDependencyTests-1072874558 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:38:40Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb193ad4-ba54-48fb-a2d5-9b92b5d41058,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2a24b011de341cf9c366be02a187c31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:38:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:38:41Z,use_quota=True,user_id='0d44ff328cd0471a9db537946c206efc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:38:44 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-ccba4e22-88fe-48c8-865a-05fe04dcc191 tempest-VolumeImageDependencyTests-1072874558 None] Creating volume bb193ad4-ba54-48fb-a2d5-9b92b5d41058 {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:38:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ccba4e22-88fe-48c8-865a-05fe04dcc191 tempest-VolumeImageDependencyTests-1072874558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:38:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ccba4e22-88fe-48c8-865a-05fe04dcc191 tempest-VolumeImageDependencyTests-1072874558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:38:44 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ccba4e22-88fe-48c8-865a-05fe04dcc191 tempest-VolumeImageDependencyTests-1072874558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:38:44 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ccba4e22-88fe-48c8-865a-05fe04dcc191 tempest-VolumeImageDependencyTests-1072874558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:38:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ccba4e22-88fe-48c8-865a-05fe04dcc191 tempest-VolumeImageDependencyTests-1072874558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:38:44 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ccba4e22-88fe-48c8-865a-05fe04dcc191 tempest-VolumeImageDependencyTests-1072874558 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:38:44 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-ccba4e22-88fe-48c8-865a-05fe04dcc191 tempest-VolumeImageDependencyTests-1072874558 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:38:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ccba4e22-88fe-48c8-865a-05fe04dcc191 tempest-VolumeImageDependencyTests-1072874558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bb193ad4-ba54-48fb-a2d5-9b92b5d41058 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:44 devstack sudo[105487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bb193ad4-ba54-48fb-a2d5-9b92b5d41058 1073741824 Sep 28 09:38:44 devstack sudo[105487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:44 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-fa233440-e8c0-4133-ad28-943bf10eaf3b tempest-TestStampPattern-708957854 None] Create snapshot completed successfully Sep 28 09:38:44 devstack sudo[105487]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ccba4e22-88fe-48c8-865a-05fe04dcc191 tempest-VolumeImageDependencyTests-1072874558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bb193ad4-ba54-48fb-a2d5-9b92b5d41058 1073741824" returned: 0 in 0.423s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ccba4e22-88fe-48c8-865a-05fe04dcc191 tempest-VolumeImageDependencyTests-1072874558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bb193ad4-ba54-48fb-a2d5-9b92b5d41058 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:44 devstack sudo[105493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bb193ad4-ba54-48fb-a2d5-9b92b5d41058 Sep 28 09:38:44 devstack sudo[105493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:45 devstack sudo[105493]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:45 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ccba4e22-88fe-48c8-865a-05fe04dcc191 tempest-VolumeImageDependencyTests-1072874558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bb193ad4-ba54-48fb-a2d5-9b92b5d41058" returned: 0 in 0.253s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:45 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ccba4e22-88fe-48c8-865a-05fe04dcc191 tempest-VolumeImageDependencyTests-1072874558 None] <== create_volume: return (716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:38:45 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ccba4e22-88fe-48c8-865a-05fe04dcc191 tempest-VolumeImageDependencyTests-1072874558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:38:45 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-be8f9837-84fd-482a-a0b0-aa8a9db6eaef tempest-CinderUnicodeTest-231430199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.058s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:38:45 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-be8f9837-84fd-482a-a0b0-aa8a9db6eaef tempest-CinderUnicodeTest-231430199 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:38:43Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ade8553e-26fc-4742-be74-9e4891c57e04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c016a949e882456cbdb9f02658648e64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:38:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:38:43Z,use_quota=True,user_id='8dccd5bd4fe84116ae52095ff7864b34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:38:45 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-be8f9837-84fd-482a-a0b0-aa8a9db6eaef tempest-CinderUnicodeTest-231430199 None] Creating volume ade8553e-26fc-4742-be74-9e4891c57e04 {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:38:45 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-be8f9837-84fd-482a-a0b0-aa8a9db6eaef tempest-CinderUnicodeTest-231430199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:38:45 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-be8f9837-84fd-482a-a0b0-aa8a9db6eaef tempest-CinderUnicodeTest-231430199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:38:45 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-be8f9837-84fd-482a-a0b0-aa8a9db6eaef tempest-CinderUnicodeTest-231430199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:38:45 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-be8f9837-84fd-482a-a0b0-aa8a9db6eaef tempest-CinderUnicodeTest-231430199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:38:45 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-be8f9837-84fd-482a-a0b0-aa8a9db6eaef tempest-CinderUnicodeTest-231430199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:38:45 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-be8f9837-84fd-482a-a0b0-aa8a9db6eaef tempest-CinderUnicodeTest-231430199 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:38:45 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-be8f9837-84fd-482a-a0b0-aa8a9db6eaef tempest-CinderUnicodeTest-231430199 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:38:45 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-be8f9837-84fd-482a-a0b0-aa8a9db6eaef tempest-CinderUnicodeTest-231430199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-ade8553e-26fc-4742-be74-9e4891c57e04 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:45 devstack sudo[105496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-ade8553e-26fc-4742-be74-9e4891c57e04 1073741824 Sep 28 09:38:45 devstack sudo[105496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:45 devstack cinder-volume[86553]: DEBUG cinder.volume.volume_utils [None req-ccba4e22-88fe-48c8-865a-05fe04dcc191 tempest-VolumeImageDependencyTests-1072874558 None] Attempting download of 42deabeb-8640-4133-98fc-c1623f4ac0cd ((None, [{'url': 'file:///opt/stack/data/glance/images/42deabeb-8640-4133-98fc-c1623f4ac0cd', 'metadata': {}}])) to volume bb193ad4-ba54-48fb-a2d5-9b92b5d41058. {{(pid=86553) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 09:38:45 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2e354f9-0605-40c3-8801-87252d2d564b]: (4, 'raw') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:38:45 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ccba4e22-88fe-48c8-865a-05fe04dcc191 tempest-VolumeImageDependencyTests-1072874558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_42deabeb-8640-4133-98fc-c1623f4ac0cd_ot0i8594 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:45 devstack sudo[105498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_42deabeb-8640-4133-98fc-c1623f4ac0cd_ot0i8594 Sep 28 09:38:45 devstack sudo[105498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:45 devstack sudo[105498]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:45 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ccba4e22-88fe-48c8-865a-05fe04dcc191 tempest-VolumeImageDependencyTests-1072874558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_42deabeb-8640-4133-98fc-c1623f4ac0cd_ot0i8594" returned: 0 in 0.344s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:45 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ccba4e22-88fe-48c8-865a-05fe04dcc191 tempest-VolumeImageDependencyTests-1072874558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_42deabeb-8640-4133-98fc-c1623f4ac0cd_ot0i8594 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:45 devstack sudo[105496]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:45 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-be8f9837-84fd-482a-a0b0-aa8a9db6eaef tempest-CinderUnicodeTest-231430199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-ade8553e-26fc-4742-be74-9e4891c57e04 1073741824" returned: 0 in 0.493s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:45 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-be8f9837-84fd-482a-a0b0-aa8a9db6eaef tempest-CinderUnicodeTest-231430199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-ade8553e-26fc-4742-be74-9e4891c57e04 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:45 devstack sudo[105505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_42deabeb-8640-4133-98fc-c1623f4ac0cd_ot0i8594 Sep 28 09:38:45 devstack sudo[105505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:45 devstack sudo[105506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-ade8553e-26fc-4742-be74-9e4891c57e04 Sep 28 09:38:45 devstack sudo[105506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:45 devstack sudo[105505]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:45 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ccba4e22-88fe-48c8-865a-05fe04dcc191 tempest-VolumeImageDependencyTests-1072874558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_42deabeb-8640-4133-98fc-c1623f4ac0cd_ot0i8594" returned: 1 in 0.358s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:45 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ccba4e22-88fe-48c8-865a-05fe04dcc191 tempest-VolumeImageDependencyTests-1072874558 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_42deabeb-8640-4133-98fc-c1623f4ac0cd_ot0i8594' failed. Not Retrying. {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 09:38:45 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b4dbf5-a1a8-4e4b-8ed3-6de4603e491f]: (4, 'raw') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:38:45 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ccba4e22-88fe-48c8-865a-05fe04dcc191 tempest-VolumeImageDependencyTests-1072874558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_42deabeb-8640-4133-98fc-c1623f4ac0cd_02s6ri4tdevstack@QuobyteHD {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:45 devstack sudo[105506]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:45 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-be8f9837-84fd-482a-a0b0-aa8a9db6eaef tempest-CinderUnicodeTest-231430199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-ade8553e-26fc-4742-be74-9e4891c57e04" returned: 0 in 0.275s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:45 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-be8f9837-84fd-482a-a0b0-aa8a9db6eaef tempest-CinderUnicodeTest-231430199 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:38:45 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-be8f9837-84fd-482a-a0b0-aa8a9db6eaef tempest-CinderUnicodeTest-231430199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:38:45 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-be8f9837-84fd-482a-a0b0-aa8a9db6eaef tempest-CinderUnicodeTest-231430199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ef43ff1-d0f3-452f-a4fd-6c2062e49872) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ade8553e-26fc-4742-be74-9e4891c57e04', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:45 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-be8f9837-84fd-482a-a0b0-aa8a9db6eaef tempest-CinderUnicodeTest-231430199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8380b6c-cd05-4ea2-b0b4-64a3a56b980d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:45 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-be8f9837-84fd-482a-a0b0-aa8a9db6eaef tempest-CinderUnicodeTest-231430199 None] Volume volume-ade8553e-26fc-4742-be74-9e4891c57e04 (ade8553e-26fc-4742-be74-9e4891c57e04): created successfully Sep 28 09:38:45 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-be8f9837-84fd-482a-a0b0-aa8a9db6eaef tempest-CinderUnicodeTest-231430199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8380b6c-cd05-4ea2-b0b4-64a3a56b980d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:45 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-be8f9837-84fd-482a-a0b0-aa8a9db6eaef tempest-CinderUnicodeTest-231430199 None] Flow 'volume_create_manager' (e65b4aa6-7d59-4f3b-aacc-257a6282bd2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:38:45 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-be8f9837-84fd-482a-a0b0-aa8a9db6eaef tempest-CinderUnicodeTest-231430199 None] Created volume successfully. Sep 28 09:38:46 devstack sudo[105512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_42deabeb-8640-4133-98fc-c1623f4ac0cd_02s6ri4tdevstack@QuobyteHD Sep 28 09:38:46 devstack sudo[105512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:46 devstack sudo[105512]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:46 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ccba4e22-88fe-48c8-865a-05fe04dcc191 tempest-VolumeImageDependencyTests-1072874558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_42deabeb-8640-4133-98fc-c1623f4ac0cd_02s6ri4tdevstack@QuobyteHD" returned: 0 in 0.397s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:46 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ccba4e22-88fe-48c8-865a-05fe04dcc191 tempest-VolumeImageDependencyTests-1072874558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_42deabeb-8640-4133-98fc-c1623f4ac0cd_02s6ri4tdevstack@QuobyteHD {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:46 devstack sudo[105516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_42deabeb-8640-4133-98fc-c1623f4ac0cd_02s6ri4tdevstack@QuobyteHD Sep 28 09:38:46 devstack sudo[105516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:46 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-338457df-568f-44e6-8fe7-afdc096b217c tempest-CinderUnicodeTest-231430199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:38:46 devstack sudo[105516]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:46 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-338457df-568f-44e6-8fe7-afdc096b217c tempest-CinderUnicodeTest-231430199 None] Flow 'volume_create_manager' (cd7b2f15-e438-4757-b330-0b65cd30d463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:38:46 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-338457df-568f-44e6-8fe7-afdc096b217c tempest-CinderUnicodeTest-231430199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (773dede0-1ab1-4332-b0d6-db95947b0298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:46 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ccba4e22-88fe-48c8-865a-05fe04dcc191 tempest-VolumeImageDependencyTests-1072874558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_42deabeb-8640-4133-98fc-c1623f4ac0cd_02s6ri4tdevstack@QuobyteHD" returned: 1 in 0.449s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:46 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ccba4e22-88fe-48c8-865a-05fe04dcc191 tempest-VolumeImageDependencyTests-1072874558 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_42deabeb-8640-4133-98fc-c1623f4ac0cd_02s6ri4tdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 09:38:46 devstack cinder-volume[86553]: DEBUG cinder.image.image_utils [None req-ccba4e22-88fe-48c8-865a-05fe04dcc191 tempest-VolumeImageDependencyTests-1072874558 None] 42deabeb-8640-4133-98fc-c1623f4ac0cd was raw, converting to qcow2 {{(pid=86553) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 09:38:46 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ccba4e22-88fe-48c8-865a-05fe04dcc191 tempest-VolumeImageDependencyTests-1072874558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_42deabeb-8640-4133-98fc-c1623f4ac0cd_02s6ri4tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bb193ad4-ba54-48fb-a2d5-9b92b5d41058 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:46 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-338457df-568f-44e6-8fe7-afdc096b217c tempest-CinderUnicodeTest-231430199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (773dede0-1ab1-4332-b0d6-db95947b0298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:38:46Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-283019072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b3d0337-533b-46c6-8822-6e27c2b8a616,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c016a949e882456cbdb9f02658648e64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:38:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:38:47Z,use_quota=True,user_id='8dccd5bd4fe84116ae52095ff7864b34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:46 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-338457df-568f-44e6-8fe7-afdc096b217c tempest-CinderUnicodeTest-231430199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8960aecc-d328-4abb-b753-f00003762a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:46 devstack sudo[105521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_42deabeb-8640-4133-98fc-c1623f4ac0cd_02s6ri4tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bb193ad4-ba54-48fb-a2d5-9b92b5d41058 Sep 28 09:38:46 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-338457df-568f-44e6-8fe7-afdc096b217c tempest-CinderUnicodeTest-231430199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8960aecc-d328-4abb-b753-f00003762a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:46 devstack sudo[105521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:46 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-338457df-568f-44e6-8fe7-afdc096b217c tempest-CinderUnicodeTest-231430199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d231aa69-dcdf-42d5-a18d-9a9486435674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:46 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-338457df-568f-44e6-8fe7-afdc096b217c tempest-CinderUnicodeTest-231430199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d231aa69-dcdf-42d5-a18d-9a9486435674) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b3d0337-533b-46c6-8822-6e27c2b8a616', 'volume_name': 'volume-1b3d0337-533b-46c6-8822-6e27c2b8a616', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:46 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-338457df-568f-44e6-8fe7-afdc096b217c tempest-CinderUnicodeTest-231430199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13dff2f6-3170-4d1c-8a48-ee31733cbd2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:46 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-338457df-568f-44e6-8fe7-afdc096b217c tempest-CinderUnicodeTest-231430199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13dff2f6-3170-4d1c-8a48-ee31733cbd2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:46 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-338457df-568f-44e6-8fe7-afdc096b217c tempest-CinderUnicodeTest-231430199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3682d828-6f34-401a-ba00-030bc85d7425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:46 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-338457df-568f-44e6-8fe7-afdc096b217c tempest-CinderUnicodeTest-231430199 None] Volume 1b3d0337-533b-46c6-8822-6e27c2b8a616: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b3d0337-533b-46c6-8822-6e27c2b8a616', 'volume_size': 1} Sep 28 09:38:46 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-338457df-568f-44e6-8fe7-afdc096b217c tempest-CinderUnicodeTest-231430199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:38:46 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-338457df-568f-44e6-8fe7-afdc096b217c tempest-CinderUnicodeTest-231430199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:38:46 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-338457df-568f-44e6-8fe7-afdc096b217c tempest-CinderUnicodeTest-231430199 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:38:46Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-283019072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b3d0337-533b-46c6-8822-6e27c2b8a616,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c016a949e882456cbdb9f02658648e64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:38:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:38:47Z,use_quota=True,user_id='8dccd5bd4fe84116ae52095ff7864b34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:38:46 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-338457df-568f-44e6-8fe7-afdc096b217c tempest-CinderUnicodeTest-231430199 None] Creating volume 1b3d0337-533b-46c6-8822-6e27c2b8a616 {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:38:46 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-338457df-568f-44e6-8fe7-afdc096b217c tempest-CinderUnicodeTest-231430199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:38:46 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-338457df-568f-44e6-8fe7-afdc096b217c tempest-CinderUnicodeTest-231430199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:38:46 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-338457df-568f-44e6-8fe7-afdc096b217c tempest-CinderUnicodeTest-231430199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:38:46 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-338457df-568f-44e6-8fe7-afdc096b217c tempest-CinderUnicodeTest-231430199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:38:46 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-338457df-568f-44e6-8fe7-afdc096b217c tempest-CinderUnicodeTest-231430199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:38:46 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-338457df-568f-44e6-8fe7-afdc096b217c tempest-CinderUnicodeTest-231430199 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:38:46 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-338457df-568f-44e6-8fe7-afdc096b217c tempest-CinderUnicodeTest-231430199 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:38:46 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-338457df-568f-44e6-8fe7-afdc096b217c tempest-CinderUnicodeTest-231430199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1b3d0337-533b-46c6-8822-6e27c2b8a616 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:46 devstack sudo[105523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1b3d0337-533b-46c6-8822-6e27c2b8a616 1073741824 Sep 28 09:38:46 devstack sudo[105523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:47 devstack sudo[105521]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:47 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ccba4e22-88fe-48c8-865a-05fe04dcc191 tempest-VolumeImageDependencyTests-1072874558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_42deabeb-8640-4133-98fc-c1623f4ac0cd_02s6ri4tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bb193ad4-ba54-48fb-a2d5-9b92b5d41058" returned: 0 in 0.542s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:47 devstack cinder-volume[86553]: DEBUG cinder.image.image_utils [None req-ccba4e22-88fe-48c8-865a-05fe04dcc191 tempest-VolumeImageDependencyTests-1072874558 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_42deabeb-8640-4133-98fc-c1623f4ac0cd_02s6ri4tdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bb193ad4-ba54-48fb-a2d5-9b92b5d41058 {{(pid=86553) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 09:38:47 devstack cinder-volume[86553]: INFO cinder.image.image_utils [None req-ccba4e22-88fe-48c8-865a-05fe04dcc191 tempest-VolumeImageDependencyTests-1072874558 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 09:38:47 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ccba4e22-88fe-48c8-865a-05fe04dcc191 tempest-VolumeImageDependencyTests-1072874558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bb193ad4-ba54-48fb-a2d5-9b92b5d41058 1G {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:47 devstack sudo[105523]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:47 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-338457df-568f-44e6-8fe7-afdc096b217c tempest-CinderUnicodeTest-231430199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1b3d0337-533b-46c6-8822-6e27c2b8a616 1073741824" returned: 0 in 0.479s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:47 devstack sudo[105537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bb193ad4-ba54-48fb-a2d5-9b92b5d41058 1G Sep 28 09:38:47 devstack sudo[105537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:47 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-338457df-568f-44e6-8fe7-afdc096b217c tempest-CinderUnicodeTest-231430199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1b3d0337-533b-46c6-8822-6e27c2b8a616 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:47 devstack sudo[105542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1b3d0337-533b-46c6-8822-6e27c2b8a616 Sep 28 09:38:47 devstack sudo[105542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:47 devstack sudo[105542]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:47 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-338457df-568f-44e6-8fe7-afdc096b217c tempest-CinderUnicodeTest-231430199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1b3d0337-533b-46c6-8822-6e27c2b8a616" returned: 0 in 0.310s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:47 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-338457df-568f-44e6-8fe7-afdc096b217c tempest-CinderUnicodeTest-231430199 None] <== create_volume: return (854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:38:47 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-338457df-568f-44e6-8fe7-afdc096b217c tempest-CinderUnicodeTest-231430199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.857s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:38:47 devstack sudo[105537]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:47 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-338457df-568f-44e6-8fe7-afdc096b217c tempest-CinderUnicodeTest-231430199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3682d828-6f34-401a-ba00-030bc85d7425) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b3d0337-533b-46c6-8822-6e27c2b8a616', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:47 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-338457df-568f-44e6-8fe7-afdc096b217c tempest-CinderUnicodeTest-231430199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37b8c063-1c48-4d06-a5de-dbe4f0acb53d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:47 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ccba4e22-88fe-48c8-865a-05fe04dcc191 tempest-VolumeImageDependencyTests-1072874558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bb193ad4-ba54-48fb-a2d5-9b92b5d41058 1G" returned: 0 in 0.410s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:47 devstack cinder-volume[86553]: DEBUG cinder.volume.volume_utils [None req-ccba4e22-88fe-48c8-865a-05fe04dcc191 tempest-VolumeImageDependencyTests-1072874558 None] Downloaded image 42deabeb-8640-4133-98fc-c1623f4ac0cd ((None, [{'url': 'file:///opt/stack/data/glance/images/42deabeb-8640-4133-98fc-c1623f4ac0cd', 'metadata': {}}])) to volume bb193ad4-ba54-48fb-a2d5-9b92b5d41058 successfully. {{(pid=86553) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 09:38:47 devstack cinder-volume[86553]: DEBUG cinder.image.image_utils [None req-ccba4e22-88fe-48c8-865a-05fe04dcc191 tempest-VolumeImageDependencyTests-1072874558 None] Temporary image 42deabeb-8640-4133-98fc-c1623f4ac0cd for user 0d44ff328cd0471a9db537946c206efc is deleted. {{(pid=86553) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 09:38:47 devstack cinder-volume[86553]: DEBUG cinder.volume.volume_utils [None req-ccba4e22-88fe-48c8-865a-05fe04dcc191 tempest-VolumeImageDependencyTests-1072874558 None] Marking volume bb193ad4-ba54-48fb-a2d5-9b92b5d41058 as bootable. {{(pid=86553) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 09:38:47 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-338457df-568f-44e6-8fe7-afdc096b217c tempest-CinderUnicodeTest-231430199 None] Volume volume-1b3d0337-533b-46c6-8822-6e27c2b8a616 (1b3d0337-533b-46c6-8822-6e27c2b8a616): created successfully Sep 28 09:38:47 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-338457df-568f-44e6-8fe7-afdc096b217c tempest-CinderUnicodeTest-231430199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37b8c063-1c48-4d06-a5de-dbe4f0acb53d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:47 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-338457df-568f-44e6-8fe7-afdc096b217c tempest-CinderUnicodeTest-231430199 None] Flow 'volume_create_manager' (cd7b2f15-e438-4757-b330-0b65cd30d463) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:38:47 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccba4e22-88fe-48c8-865a-05fe04dcc191 tempest-VolumeImageDependencyTests-1072874558 None] Copying metadata from image 42deabeb-8640-4133-98fc-c1623f4ac0cd to bb193ad4-ba54-48fb-a2d5-9b92b5d41058. {{(pid=86553) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 09:38:47 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccba4e22-88fe-48c8-865a-05fe04dcc191 tempest-VolumeImageDependencyTests-1072874558 None] Creating volume glance metadata for volume bb193ad4-ba54-48fb-a2d5-9b92b5d41058 backed by image 42deabeb-8640-4133-98fc-c1623f4ac0cd with: {'image_id': '42deabeb-8640-4133-98fc-c1623f4ac0cd', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '94b27c21a298f96956df00daf21a9c27', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86553) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 09:38:47 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-338457df-568f-44e6-8fe7-afdc096b217c tempest-CinderUnicodeTest-231430199 None] Created volume successfully. Sep 28 09:38:47 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ccba4e22-88fe-48c8-865a-05fe04dcc191 tempest-VolumeImageDependencyTests-1072874558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (546f56dc-396d-404a-abb8-e163afa24b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb193ad4-ba54-48fb-a2d5-9b92b5d41058', 'volume_size': 1, 'image_id': '42deabeb-8640-4133-98fc-c1623f4ac0cd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/42deabeb-8640-4133-98fc-c1623f4ac0cd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '94b27c21a298f96956df00daf21a9c27', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd2a24b011de341cf9c366be02a187c31', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5e341a3a4d1020e5e2eadbeeda36d00ee86eeb632e903be372859098d66667364a964d25eb9886949692b6208c05013cb4660fa5a0118acc2353d900bc341b50', 'id': '42deabeb-8640-4133-98fc-c1623f4ac0cd', 'created_at': datetime.datetime(2026, 9, 28, 7, 38, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 7, 38, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/42deabeb-8640-4133-98fc-c1623f4ac0cd/file', 'properties': {}}, 'image_service': }' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:47 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ccba4e22-88fe-48c8-865a-05fe04dcc191 tempest-VolumeImageDependencyTests-1072874558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7b4e095-acc4-4535-af6a-5db6eb205c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:47 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-ccba4e22-88fe-48c8-865a-05fe04dcc191 tempest-VolumeImageDependencyTests-1072874558 None] Volume volume-bb193ad4-ba54-48fb-a2d5-9b92b5d41058 (bb193ad4-ba54-48fb-a2d5-9b92b5d41058): created successfully Sep 28 09:38:47 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ccba4e22-88fe-48c8-865a-05fe04dcc191 tempest-VolumeImageDependencyTests-1072874558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7b4e095-acc4-4535-af6a-5db6eb205c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:47 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ccba4e22-88fe-48c8-865a-05fe04dcc191 tempest-VolumeImageDependencyTests-1072874558 None] Flow 'volume_create_manager' (b1fc3778-59c7-4bcb-9604-404ac2e41c5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:38:47 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-ccba4e22-88fe-48c8-865a-05fe04dcc191 tempest-VolumeImageDependencyTests-1072874558 None] Created volume successfully. Sep 28 09:38:48 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-00bb4299-7900-4c6e-9ed6-a0c49ecd67da tempest-VolumeImageDependencyTests-1072874558 None] Acquiring lock "cinder-bb193ad4-ba54-48fb-a2d5-9b92b5d41058-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:38:48 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-00bb4299-7900-4c6e-9ed6-a0c49ecd67da tempest-VolumeImageDependencyTests-1072874558 None] Lock "cinder-bb193ad4-ba54-48fb-a2d5-9b92b5d41058-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:38:48 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-00bb4299-7900-4c6e-9ed6-a0c49ecd67da tempest-VolumeImageDependencyTests-1072874558 None] Acquiring lock "cinder-quobyte-bb193ad4-ba54-48fb-a2d5-9b92b5d41058" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:38:48 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-00bb4299-7900-4c6e-9ed6-a0c49ecd67da tempest-VolumeImageDependencyTests-1072874558 None] Lock "cinder-quobyte-bb193ad4-ba54-48fb-a2d5-9b92b5d41058" acquired by "delete_volume" :: waited 0.017s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:38:48 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[292f46fb-3ec0-4d04-a5a0-592b9d497d5b]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:38:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-00bb4299-7900-4c6e-9ed6-a0c49ecd67da tempest-VolumeImageDependencyTests-1072874558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bb193ad4-ba54-48fb-a2d5-9b92b5d41058 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:48 devstack sudo[105564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bb193ad4-ba54-48fb-a2d5-9b92b5d41058 Sep 28 09:38:48 devstack sudo[105564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:48 devstack sudo[105564]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-00bb4299-7900-4c6e-9ed6-a0c49ecd67da tempest-VolumeImageDependencyTests-1072874558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bb193ad4-ba54-48fb-a2d5-9b92b5d41058" returned: 0 in 0.377s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-00bb4299-7900-4c6e-9ed6-a0c49ecd67da tempest-VolumeImageDependencyTests-1072874558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bb193ad4-ba54-48fb-a2d5-9b92b5d41058 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:48 devstack sudo[105577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bb193ad4-ba54-48fb-a2d5-9b92b5d41058 Sep 28 09:38:48 devstack sudo[105577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:48 devstack sudo[105577]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-00bb4299-7900-4c6e-9ed6-a0c49ecd67da tempest-VolumeImageDependencyTests-1072874558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bb193ad4-ba54-48fb-a2d5-9b92b5d41058" returned: 0 in 0.299s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:48 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-00bb4299-7900-4c6e-9ed6-a0c49ecd67da tempest-VolumeImageDependencyTests-1072874558 None] Lock "cinder-quobyte-bb193ad4-ba54-48fb-a2d5-9b92b5d41058" released by "delete_volume" :: held 0.727s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:38:48 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-00bb4299-7900-4c6e-9ed6-a0c49ecd67da tempest-VolumeImageDependencyTests-1072874558 None] Created reservations ['bb49fc36-2169-4174-8dda-c86d68c7e620', '1558b95b-391c-4516-ae9d-e496d9220692', 'e4e08b00-8567-4f24-957a-bc79b1f5ca7f', 'b2dcc7fb-355c-4e51-a0ce-341f0898fc94'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:38:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-00bb4299-7900-4c6e-9ed6-a0c49ecd67da tempest-VolumeImageDependencyTests-1072874558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:38:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-00bb4299-7900-4c6e-9ed6-a0c49ecd67da tempest-VolumeImageDependencyTests-1072874558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:38:49 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-00bb4299-7900-4c6e-9ed6-a0c49ecd67da tempest-VolumeImageDependencyTests-1072874558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:38:49 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-00bb4299-7900-4c6e-9ed6-a0c49ecd67da tempest-VolumeImageDependencyTests-1072874558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:38:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-00bb4299-7900-4c6e-9ed6-a0c49ecd67da tempest-VolumeImageDependencyTests-1072874558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:38:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-00bb4299-7900-4c6e-9ed6-a0c49ecd67da tempest-VolumeImageDependencyTests-1072874558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:49 devstack sudo[105580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:38:49 devstack sudo[105580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-0f91a22e-4702-4469-b64c-cd67ed90c233 tempest-CinderUnicodeTest-231430199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:38:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-0f91a22e-4702-4469-b64c-cd67ed90c233 tempest-CinderUnicodeTest-231430199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:38:49 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-0f91a22e-4702-4469-b64c-cd67ed90c233 tempest-CinderUnicodeTest-231430199 None] Creating offline snapshot 2ba0f94c-c8e8-4f23-9f6c-fd736be2f0df of volume 1b3d0337-533b-46c6-8822-6e27c2b8a616 {{(pid=86553) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 09:38:49 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe87f1f5-a61c-4f7c-b989-c3bb357d8877]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:38:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0f91a22e-4702-4469-b64c-cd67ed90c233 tempest-CinderUnicodeTest-231430199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1b3d0337-533b-46c6-8822-6e27c2b8a616 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:49 devstack sudo[105582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1b3d0337-533b-46c6-8822-6e27c2b8a616 Sep 28 09:38:49 devstack sudo[105582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:49 devstack sudo[105580]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-00bb4299-7900-4c6e-9ed6-a0c49ecd67da tempest-VolumeImageDependencyTests-1072874558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.363s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:49 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-00bb4299-7900-4c6e-9ed6-a0c49ecd67da tempest-VolumeImageDependencyTests-1072874558 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:38:49 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-00bb4299-7900-4c6e-9ed6-a0c49ecd67da tempest-VolumeImageDependencyTests-1072874558 None] Deleted volume successfully. Sep 28 09:38:49 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-00bb4299-7900-4c6e-9ed6-a0c49ecd67da tempest-VolumeImageDependencyTests-1072874558 None] Lock "cinder-bb193ad4-ba54-48fb-a2d5-9b92b5d41058-delete_volume" released by "delete_volume" :: held 1.387s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:38:49 devstack sudo[105582]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0f91a22e-4702-4469-b64c-cd67ed90c233 tempest-CinderUnicodeTest-231430199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1b3d0337-533b-46c6-8822-6e27c2b8a616" returned: 0 in 0.520s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0f91a22e-4702-4469-b64c-cd67ed90c233 tempest-CinderUnicodeTest-231430199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1b3d0337-533b-46c6-8822-6e27c2b8a616,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1b3d0337-533b-46c6-8822-6e27c2b8a616.2ba0f94c-c8e8-4f23-9f6c-fd736be2f0df 1G {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:49 devstack sudo[105588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1b3d0337-533b-46c6-8822-6e27c2b8a616,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1b3d0337-533b-46c6-8822-6e27c2b8a616.2ba0f94c-c8e8-4f23-9f6c-fd736be2f0df 1G Sep 28 09:38:49 devstack sudo[105588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:50 devstack sudo[105588]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0f91a22e-4702-4469-b64c-cd67ed90c233 tempest-CinderUnicodeTest-231430199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1b3d0337-533b-46c6-8822-6e27c2b8a616,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1b3d0337-533b-46c6-8822-6e27c2b8a616.2ba0f94c-c8e8-4f23-9f6c-fd736be2f0df 1G" returned: 0 in 0.524s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0f91a22e-4702-4469-b64c-cd67ed90c233 tempest-CinderUnicodeTest-231430199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b3d0337-533b-46c6-8822-6e27c2b8a616 -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1b3d0337-533b-46c6-8822-6e27c2b8a616.2ba0f94c-c8e8-4f23-9f6c-fd736be2f0df {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:50 devstack sudo[105594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b3d0337-533b-46c6-8822-6e27c2b8a616 -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1b3d0337-533b-46c6-8822-6e27c2b8a616.2ba0f94c-c8e8-4f23-9f6c-fd736be2f0df Sep 28 09:38:50 devstack sudo[105594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:50 devstack sudo[105594]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0f91a22e-4702-4469-b64c-cd67ed90c233 tempest-CinderUnicodeTest-231430199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b3d0337-533b-46c6-8822-6e27c2b8a616 -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1b3d0337-533b-46c6-8822-6e27c2b8a616.2ba0f94c-c8e8-4f23-9f6c-fd736be2f0df" returned: 0 in 0.344s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:50 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-0f91a22e-4702-4469-b64c-cd67ed90c233 tempest-CinderUnicodeTest-231430199 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1b3d0337-533b-46c6-8822-6e27c2b8a616.2ba0f94c-c8e8-4f23-9f6c-fd736be2f0df is being set with open permissions: ugo+rw Sep 28 09:38:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0f91a22e-4702-4469-b64c-cd67ed90c233 tempest-CinderUnicodeTest-231430199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1b3d0337-533b-46c6-8822-6e27c2b8a616.2ba0f94c-c8e8-4f23-9f6c-fd736be2f0df {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:50 devstack sudo[105599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1b3d0337-533b-46c6-8822-6e27c2b8a616.2ba0f94c-c8e8-4f23-9f6c-fd736be2f0df Sep 28 09:38:50 devstack sudo[105599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:50 devstack sudo[105599]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0f91a22e-4702-4469-b64c-cd67ed90c233 tempest-CinderUnicodeTest-231430199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1b3d0337-533b-46c6-8822-6e27c2b8a616.2ba0f94c-c8e8-4f23-9f6c-fd736be2f0df" returned: 0 in 0.267s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0f91a22e-4702-4469-b64c-cd67ed90c233 tempest-CinderUnicodeTest-231430199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1b3d0337-533b-46c6-8822-6e27c2b8a616.info {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:50 devstack sudo[105602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1b3d0337-533b-46c6-8822-6e27c2b8a616.info Sep 28 09:38:50 devstack sudo[105602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:51 devstack sudo[105602]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:51 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0f91a22e-4702-4469-b64c-cd67ed90c233 tempest-CinderUnicodeTest-231430199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1b3d0337-533b-46c6-8822-6e27c2b8a616.info" returned: 0 in 0.332s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:51 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-0f91a22e-4702-4469-b64c-cd67ed90c233 tempest-CinderUnicodeTest-231430199 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1b3d0337-533b-46c6-8822-6e27c2b8a616.info is being set with open permissions: ugo+rw Sep 28 09:38:51 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0f91a22e-4702-4469-b64c-cd67ed90c233 tempest-CinderUnicodeTest-231430199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1b3d0337-533b-46c6-8822-6e27c2b8a616.info {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:51 devstack sudo[105605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1b3d0337-533b-46c6-8822-6e27c2b8a616.info Sep 28 09:38:51 devstack sudo[105605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:51 devstack sudo[105605]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:51 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0f91a22e-4702-4469-b64c-cd67ed90c233 tempest-CinderUnicodeTest-231430199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1b3d0337-533b-46c6-8822-6e27c2b8a616.info" returned: 0 in 0.283s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:51 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-0f91a22e-4702-4469-b64c-cd67ed90c233 tempest-CinderUnicodeTest-231430199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.409s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:38:51 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-0f91a22e-4702-4469-b64c-cd67ed90c233 tempest-CinderUnicodeTest-231430199 None] Create snapshot completed successfully Sep 28 09:38:52 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-de6ef454-5021-4459-ba18-c76a98a18134 tempest-CinderUnicodeTest-231430199 None] Acquiring lock "cinder-2ba0f94c-c8e8-4f23-9f6c-fd736be2f0df-delete_snapshot" by "delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:38:52 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-de6ef454-5021-4459-ba18-c76a98a18134 tempest-CinderUnicodeTest-231430199 None] Lock "cinder-2ba0f94c-c8e8-4f23-9f6c-fd736be2f0df-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:38:52 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-de6ef454-5021-4459-ba18-c76a98a18134 tempest-CinderUnicodeTest-231430199 None] Acquiring lock "cinder-quobyte-1b3d0337-533b-46c6-8822-6e27c2b8a616" by "delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:38:52 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-de6ef454-5021-4459-ba18-c76a98a18134 tempest-CinderUnicodeTest-231430199 None] Lock "cinder-quobyte-1b3d0337-533b-46c6-8822-6e27c2b8a616" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:38:52 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-de6ef454-5021-4459-ba18-c76a98a18134 tempest-CinderUnicodeTest-231430199 None] Acquiring lock "cinder-quobyte-2ba0f94c-c8e8-4f23-9f6c-fd736be2f0df" by "_delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:38:52 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-de6ef454-5021-4459-ba18-c76a98a18134 tempest-CinderUnicodeTest-231430199 None] Lock "cinder-quobyte-2ba0f94c-c8e8-4f23-9f6c-fd736be2f0df" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:38:52 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-de6ef454-5021-4459-ba18-c76a98a18134 tempest-CinderUnicodeTest-231430199 None] Deleting offline snapshot 2ba0f94c-c8e8-4f23-9f6c-fd736be2f0df of volume 1b3d0337-533b-46c6-8822-6e27c2b8a616 {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 09:38:52 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-de6ef454-5021-4459-ba18-c76a98a18134 tempest-CinderUnicodeTest-231430199 None] snapshot_file for this snap is: volume-1b3d0337-533b-46c6-8822-6e27c2b8a616.2ba0f94c-c8e8-4f23-9f6c-fd736be2f0df {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 09:38:52 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec998fb9-c128-4771-a39b-45a589900a35]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:38:52 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-de6ef454-5021-4459-ba18-c76a98a18134 tempest-CinderUnicodeTest-231430199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1b3d0337-533b-46c6-8822-6e27c2b8a616.2ba0f94c-c8e8-4f23-9f6c-fd736be2f0df {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:52 devstack sudo[105608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1b3d0337-533b-46c6-8822-6e27c2b8a616.2ba0f94c-c8e8-4f23-9f6c-fd736be2f0df Sep 28 09:38:52 devstack sudo[105608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:52 devstack sudo[105608]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:52 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-de6ef454-5021-4459-ba18-c76a98a18134 tempest-CinderUnicodeTest-231430199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1b3d0337-533b-46c6-8822-6e27c2b8a616.2ba0f94c-c8e8-4f23-9f6c-fd736be2f0df" returned: 0 in 0.392s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:52 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-de6ef454-5021-4459-ba18-c76a98a18134 tempest-CinderUnicodeTest-231430199 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b3d0337-533b-46c6-8822-6e27c2b8a616(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86553) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 09:38:52 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c8c40d-0023-43b1-a8ee-015fc43b52dd]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:38:52 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-de6ef454-5021-4459-ba18-c76a98a18134 tempest-CinderUnicodeTest-231430199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1b3d0337-533b-46c6-8822-6e27c2b8a616 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:52 devstack sudo[105613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1b3d0337-533b-46c6-8822-6e27c2b8a616 Sep 28 09:38:52 devstack sudo[105613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:53 devstack sudo[105613]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:53 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-de6ef454-5021-4459-ba18-c76a98a18134 tempest-CinderUnicodeTest-231430199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1b3d0337-533b-46c6-8822-6e27c2b8a616" returned: 0 in 0.432s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:53 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-de6ef454-5021-4459-ba18-c76a98a18134 tempest-CinderUnicodeTest-231430199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1b3d0337-533b-46c6-8822-6e27c2b8a616.2ba0f94c-c8e8-4f23-9f6c-fd736be2f0df {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:53 devstack sudo[105618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1b3d0337-533b-46c6-8822-6e27c2b8a616.2ba0f94c-c8e8-4f23-9f6c-fd736be2f0df Sep 28 09:38:53 devstack sudo[105618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:53 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-69995bee-c837-4668-8fcc-5636d2ccf8ce tempest-TestStampPattern-708957854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:38:53 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-69995bee-c837-4668-8fcc-5636d2ccf8ce tempest-TestStampPattern-708957854 None] Flow 'volume_create_manager' (acc046e3-d7be-4aaa-85a5-3936acf406e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:38:53 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-69995bee-c837-4668-8fcc-5636d2ccf8ce tempest-TestStampPattern-708957854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4decec9b-b741-418f-b5bc-29a3667d9e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:53 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-69995bee-c837-4668-8fcc-5636d2ccf8ce tempest-TestStampPattern-708957854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4decec9b-b741-418f-b5bc-29a3667d9e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:38:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1508971841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34229eeb-2cb0-41f9-8e66-3059b7ab39eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db4af088e25c49ae8289bcaf8acf0e68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:38:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1029b85b-8cdd-41df-be71-5eb500190aee,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:38:54Z,use_quota=True,user_id='2537de10964c48f685376d89e5bebdf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:53 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-69995bee-c837-4668-8fcc-5636d2ccf8ce tempest-TestStampPattern-708957854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59797a1e-d6c2-44b5-bebf-74dcb413f277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:53 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-69995bee-c837-4668-8fcc-5636d2ccf8ce tempest-TestStampPattern-708957854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59797a1e-d6c2-44b5-bebf-74dcb413f277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:53 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-69995bee-c837-4668-8fcc-5636d2ccf8ce tempest-TestStampPattern-708957854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baebaff5-9e26-4e8c-aecd-60454f79ca8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:53 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-69995bee-c837-4668-8fcc-5636d2ccf8ce tempest-TestStampPattern-708957854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baebaff5-9e26-4e8c-aecd-60454f79ca8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '34229eeb-2cb0-41f9-8e66-3059b7ab39eb', 'volume_name': 'volume-34229eeb-2cb0-41f9-8e66-3059b7ab39eb', 'volume_size': 1, 'snapshot_id': '1029b85b-8cdd-41df-be71-5eb500190aee'}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:53 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-69995bee-c837-4668-8fcc-5636d2ccf8ce tempest-TestStampPattern-708957854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c623964c-35f8-40c6-bcb2-cd19ea758af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:53 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-69995bee-c837-4668-8fcc-5636d2ccf8ce tempest-TestStampPattern-708957854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c623964c-35f8-40c6-bcb2-cd19ea758af1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:53 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-69995bee-c837-4668-8fcc-5636d2ccf8ce tempest-TestStampPattern-708957854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2a1329f-7717-4f3c-bd5a-0318778a269b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:53 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-69995bee-c837-4668-8fcc-5636d2ccf8ce tempest-TestStampPattern-708957854 None] Volume 34229eeb-2cb0-41f9-8e66-3059b7ab39eb: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-34229eeb-2cb0-41f9-8e66-3059b7ab39eb', 'volume_size': 1, 'snapshot_id': '1029b85b-8cdd-41df-be71-5eb500190aee'} Sep 28 09:38:53 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-69995bee-c837-4668-8fcc-5636d2ccf8ce tempest-TestStampPattern-708957854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:38:53 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-69995bee-c837-4668-8fcc-5636d2ccf8ce tempest-TestStampPattern-708957854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:38:53 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-69995bee-c837-4668-8fcc-5636d2ccf8ce tempest-TestStampPattern-708957854 None] Acquiring lock "cinder-quobyte-1029b85b-8cdd-41df-be71-5eb500190aee-34229eeb-2cb0-41f9-8e66-3059b7ab39eb" by "_create_volume_from_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:38:53 devstack sudo[105618]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:53 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-de6ef454-5021-4459-ba18-c76a98a18134 tempest-CinderUnicodeTest-231430199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1b3d0337-533b-46c6-8822-6e27c2b8a616.2ba0f94c-c8e8-4f23-9f6c-fd736be2f0df" returned: 0 in 0.496s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:53 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-de6ef454-5021-4459-ba18-c76a98a18134 tempest-CinderUnicodeTest-231430199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1b3d0337-533b-46c6-8822-6e27c2b8a616.2ba0f94c-c8e8-4f23-9f6c-fd736be2f0df {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:53 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-69995bee-c837-4668-8fcc-5636d2ccf8ce tempest-TestStampPattern-708957854 None] Lock "cinder-quobyte-1029b85b-8cdd-41df-be71-5eb500190aee-34229eeb-2cb0-41f9-8e66-3059b7ab39eb" acquired by "_create_volume_from_snapshot" :: waited 0.046s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:38:53 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-69995bee-c837-4668-8fcc-5636d2ccf8ce tempest-TestStampPattern-708957854 None] Creating volume 34229eeb-2cb0-41f9-8e66-3059b7ab39eb from snapshot 1029b85b-8cdd-41df-be71-5eb500190aee {{(pid=86553) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 09:38:53 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-69995bee-c837-4668-8fcc-5636d2ccf8ce tempest-TestStampPattern-708957854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:38:53 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-69995bee-c837-4668-8fcc-5636d2ccf8ce tempest-TestStampPattern-708957854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:38:53 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-69995bee-c837-4668-8fcc-5636d2ccf8ce tempest-TestStampPattern-708957854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:38:53 devstack sudo[105624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1b3d0337-533b-46c6-8822-6e27c2b8a616.2ba0f94c-c8e8-4f23-9f6c-fd736be2f0df Sep 28 09:38:53 devstack sudo[105624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:53 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-69995bee-c837-4668-8fcc-5636d2ccf8ce tempest-TestStampPattern-708957854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:38:53 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-69995bee-c837-4668-8fcc-5636d2ccf8ce tempest-TestStampPattern-708957854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:38:53 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-69995bee-c837-4668-8fcc-5636d2ccf8ce tempest-TestStampPattern-708957854 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:38:53 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-69995bee-c837-4668-8fcc-5636d2ccf8ce tempest-TestStampPattern-708957854 None] Acquiring lock "cinder-quobyte-34229eeb-2cb0-41f9-8e66-3059b7ab39eb" by "_copy_volume_from_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:38:53 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-a50fc1af-19e5-4f4c-908c-4ecc02db6295 tempest-ProjectReaderTests-1061496652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:38:53 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-a50fc1af-19e5-4f4c-908c-4ecc02db6295 tempest-ProjectReaderTests-1061496652 None] Flow 'volume_create_manager' (2fbca1c6-5b3e-4cef-a9ca-b91560d55181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:38:53 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-a50fc1af-19e5-4f4c-908c-4ecc02db6295 tempest-ProjectReaderTests-1061496652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6fc418b-967b-42b1-abb8-cc8190245d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:53 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-69995bee-c837-4668-8fcc-5636d2ccf8ce tempest-TestStampPattern-708957854 None] Lock "cinder-quobyte-34229eeb-2cb0-41f9-8e66-3059b7ab39eb" acquired by "_copy_volume_from_snapshot" :: waited 0.066s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:38:53 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-69995bee-c837-4668-8fcc-5636d2ccf8ce tempest-TestStampPattern-708957854 None] snapshot: 1029b85b-8cdd-41df-be71-5eb500190aee, volume: 34229eeb-2cb0-41f9-8e66-3059b7ab39eb, {{(pid=86553) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 09:38:53 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-69995bee-c837-4668-8fcc-5636d2ccf8ce tempest-TestStampPattern-708957854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:38:53 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-69995bee-c837-4668-8fcc-5636d2ccf8ce tempest-TestStampPattern-708957854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:38:53 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-69995bee-c837-4668-8fcc-5636d2ccf8ce tempest-TestStampPattern-708957854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:38:53 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-69995bee-c837-4668-8fcc-5636d2ccf8ce tempest-TestStampPattern-708957854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:38:53 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-69995bee-c837-4668-8fcc-5636d2ccf8ce tempest-TestStampPattern-708957854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:38:53 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-a50fc1af-19e5-4f4c-908c-4ecc02db6295 tempest-ProjectReaderTests-1061496652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6fc418b-967b-42b1-abb8-cc8190245d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:38:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1877621579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a30fe86c-24e8-4071-8ced-24a5dd095e91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42fd504cecf7452db30446b88998bc05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:38:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:38:54Z,use_quota=True,user_id='c835e8117f0e4144bce278ca1449c95c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:53 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-a50fc1af-19e5-4f4c-908c-4ecc02db6295 tempest-ProjectReaderTests-1061496652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (030a90e5-fc84-4a1f-8044-74409f31db88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:53 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-a50fc1af-19e5-4f4c-908c-4ecc02db6295 tempest-ProjectReaderTests-1061496652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (030a90e5-fc84-4a1f-8044-74409f31db88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:53 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-a50fc1af-19e5-4f4c-908c-4ecc02db6295 tempest-ProjectReaderTests-1061496652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15a68153-3f16-4514-b191-55b02926a47f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:53 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-a50fc1af-19e5-4f4c-908c-4ecc02db6295 tempest-ProjectReaderTests-1061496652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15a68153-3f16-4514-b191-55b02926a47f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a30fe86c-24e8-4071-8ced-24a5dd095e91', 'volume_name': 'volume-a30fe86c-24e8-4071-8ced-24a5dd095e91', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:53 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-a50fc1af-19e5-4f4c-908c-4ecc02db6295 tempest-ProjectReaderTests-1061496652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23c30f76-5e64-474b-9dc1-1d40e5d7ddfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:53 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-a50fc1af-19e5-4f4c-908c-4ecc02db6295 tempest-ProjectReaderTests-1061496652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23c30f76-5e64-474b-9dc1-1d40e5d7ddfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:38:53 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-a50fc1af-19e5-4f4c-908c-4ecc02db6295 tempest-ProjectReaderTests-1061496652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b267260-2c12-433a-8732-8a366d348c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:38:53 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-a50fc1af-19e5-4f4c-908c-4ecc02db6295 tempest-ProjectReaderTests-1061496652 None] Volume a30fe86c-24e8-4071-8ced-24a5dd095e91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a30fe86c-24e8-4071-8ced-24a5dd095e91', 'volume_size': 1} Sep 28 09:38:53 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-a50fc1af-19e5-4f4c-908c-4ecc02db6295 tempest-ProjectReaderTests-1061496652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:38:53 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[e39e9918-661d-439f-b27f-92b1dcffff89]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:38:53 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-69995bee-c837-4668-8fcc-5636d2ccf8ce tempest-TestStampPattern-708957854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f8848ae3-33f7-4d6a-98ec-13d3d4d35dbd.1029b85b-8cdd-41df-be71-5eb500190aee {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:54 devstack sudo[105624]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:54 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-de6ef454-5021-4459-ba18-c76a98a18134 tempest-CinderUnicodeTest-231430199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1b3d0337-533b-46c6-8822-6e27c2b8a616.2ba0f94c-c8e8-4f23-9f6c-fd736be2f0df" returned: 0 in 0.290s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:54 devstack sudo[105626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f8848ae3-33f7-4d6a-98ec-13d3d4d35dbd.1029b85b-8cdd-41df-be71-5eb500190aee Sep 28 09:38:54 devstack sudo[105626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:54 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-de6ef454-5021-4459-ba18-c76a98a18134 tempest-CinderUnicodeTest-231430199 None] Lock "cinder-quobyte-2ba0f94c-c8e8-4f23-9f6c-fd736be2f0df" released by "_delete_snapshot" :: held 1.758s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:38:54 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-de6ef454-5021-4459-ba18-c76a98a18134 tempest-CinderUnicodeTest-231430199 None] Lock "cinder-quobyte-1b3d0337-533b-46c6-8822-6e27c2b8a616" released by "delete_snapshot" :: held 1.787s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:38:54 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-de6ef454-5021-4459-ba18-c76a98a18134 tempest-CinderUnicodeTest-231430199 None] Created reservations ['997d7c62-3c9a-4e33-8dc0-69edee535912', 'fd1eae37-b781-4551-bf20-f641344ebb00', 'bb82b066-324d-4fb7-a40b-d7bd624612bc', '3ce9d517-3095-4d38-acc7-883727e8133c'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:38:54 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-de6ef454-5021-4459-ba18-c76a98a18134 tempest-CinderUnicodeTest-231430199 None] Delete snapshot completed successfully. Sep 28 09:38:54 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-de6ef454-5021-4459-ba18-c76a98a18134 tempest-CinderUnicodeTest-231430199 None] Lock "cinder-2ba0f94c-c8e8-4f23-9f6c-fd736be2f0df-delete_snapshot" released by "delete_snapshot" :: held 1.962s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:38:54 devstack sudo[105626]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:54 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-69995bee-c837-4668-8fcc-5636d2ccf8ce tempest-TestStampPattern-708957854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f8848ae3-33f7-4d6a-98ec-13d3d4d35dbd.1029b85b-8cdd-41df-be71-5eb500190aee" returned: 0 in 0.402s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:54 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-69995bee-c837-4668-8fcc-5636d2ccf8ce tempest-TestStampPattern-708957854 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8848ae3-33f7-4d6a-98ec-13d3d4d35dbd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86553) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 09:38:54 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[252f4d6d-1470-4458-8099-6abce4a1a13e]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:38:54 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-69995bee-c837-4668-8fcc-5636d2ccf8ce tempest-TestStampPattern-708957854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f8848ae3-33f7-4d6a-98ec-13d3d4d35dbd {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:54 devstack sudo[105632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f8848ae3-33f7-4d6a-98ec-13d3d4d35dbd Sep 28 09:38:54 devstack sudo[105632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:54 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-2beb2a1d-d5ee-4cb1-9cfc-8eaa58c9b945 tempest-CinderUnicodeTest-231430199 None] Acquiring lock "cinder-1b3d0337-533b-46c6-8822-6e27c2b8a616-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:38:54 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-2beb2a1d-d5ee-4cb1-9cfc-8eaa58c9b945 tempest-CinderUnicodeTest-231430199 None] Lock "cinder-1b3d0337-533b-46c6-8822-6e27c2b8a616-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:38:54 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-2beb2a1d-d5ee-4cb1-9cfc-8eaa58c9b945 tempest-CinderUnicodeTest-231430199 None] Acquiring lock "cinder-quobyte-1b3d0337-533b-46c6-8822-6e27c2b8a616" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:38:54 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-2beb2a1d-d5ee-4cb1-9cfc-8eaa58c9b945 tempest-CinderUnicodeTest-231430199 None] Lock "cinder-quobyte-1b3d0337-533b-46c6-8822-6e27c2b8a616" acquired by "delete_volume" :: waited 0.029s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:38:54 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[64e292c9-794b-4a30-a385-6144a02f0d03]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:38:54 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2beb2a1d-d5ee-4cb1-9cfc-8eaa58c9b945 tempest-CinderUnicodeTest-231430199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1b3d0337-533b-46c6-8822-6e27c2b8a616 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:54 devstack sudo[105637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1b3d0337-533b-46c6-8822-6e27c2b8a616 Sep 28 09:38:54 devstack sudo[105637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:54 devstack sudo[105632]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:54 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-69995bee-c837-4668-8fcc-5636d2ccf8ce tempest-TestStampPattern-708957854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f8848ae3-33f7-4d6a-98ec-13d3d4d35dbd" returned: 0 in 0.480s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:54 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-69995bee-c837-4668-8fcc-5636d2ccf8ce tempest-TestStampPattern-708957854 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f8848ae3-33f7-4d6a-98ec-13d3d4d35dbd {{(pid=86553) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 09:38:54 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-69995bee-c837-4668-8fcc-5636d2ccf8ce tempest-TestStampPattern-708957854 None] Creating direct copy from snapshot {{(pid=86553) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 09:38:54 devstack cinder-volume[86553]: DEBUG cinder.utils [None req-69995bee-c837-4668-8fcc-5636d2ccf8ce tempest-TestStampPattern-708957854 None] Path /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-34229eeb-2cb0-41f9-8e66-3059b7ab39eb not found in is_blk_device check {{(pid=86553) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 09:38:54 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-69995bee-c837-4668-8fcc-5636d2ccf8ce tempest-TestStampPattern-708957854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f8848ae3-33f7-4d6a-98ec-13d3d4d35dbd /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-34229eeb-2cb0-41f9-8e66-3059b7ab39eb {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:54 devstack sudo[105642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f8848ae3-33f7-4d6a-98ec-13d3d4d35dbd /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-34229eeb-2cb0-41f9-8e66-3059b7ab39eb Sep 28 09:38:54 devstack sudo[105642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:55 devstack sudo[105637]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:55 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2beb2a1d-d5ee-4cb1-9cfc-8eaa58c9b945 tempest-CinderUnicodeTest-231430199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1b3d0337-533b-46c6-8822-6e27c2b8a616" returned: 0 in 0.465s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:55 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2beb2a1d-d5ee-4cb1-9cfc-8eaa58c9b945 tempest-CinderUnicodeTest-231430199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1b3d0337-533b-46c6-8822-6e27c2b8a616 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:55 devstack sudo[105650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1b3d0337-533b-46c6-8822-6e27c2b8a616 Sep 28 09:38:55 devstack sudo[105650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:55 devstack sudo[105650]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:55 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2beb2a1d-d5ee-4cb1-9cfc-8eaa58c9b945 tempest-CinderUnicodeTest-231430199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1b3d0337-533b-46c6-8822-6e27c2b8a616" returned: 0 in 0.308s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:55 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-2beb2a1d-d5ee-4cb1-9cfc-8eaa58c9b945 tempest-CinderUnicodeTest-231430199 None] Lock "cinder-quobyte-1b3d0337-533b-46c6-8822-6e27c2b8a616" released by "delete_volume" :: held 0.870s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:38:55 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-2beb2a1d-d5ee-4cb1-9cfc-8eaa58c9b945 tempest-CinderUnicodeTest-231430199 None] Created reservations ['bceaa44f-e3e1-4b03-955f-827f651af292', '1d674190-d594-48cb-86a5-5f893409b417', '0e76a724-0ce6-4817-a33f-3ec6dccac8f9', '2cb5eba0-b4a1-43d9-b633-75c62c6ea5e5'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:38:55 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-2beb2a1d-d5ee-4cb1-9cfc-8eaa58c9b945 tempest-CinderUnicodeTest-231430199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:38:55 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-2beb2a1d-d5ee-4cb1-9cfc-8eaa58c9b945 tempest-CinderUnicodeTest-231430199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:38:55 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-2beb2a1d-d5ee-4cb1-9cfc-8eaa58c9b945 tempest-CinderUnicodeTest-231430199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:38:55 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-2beb2a1d-d5ee-4cb1-9cfc-8eaa58c9b945 tempest-CinderUnicodeTest-231430199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:38:55 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-2beb2a1d-d5ee-4cb1-9cfc-8eaa58c9b945 tempest-CinderUnicodeTest-231430199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:38:55 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2beb2a1d-d5ee-4cb1-9cfc-8eaa58c9b945 tempest-CinderUnicodeTest-231430199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:55 devstack sudo[105658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:38:55 devstack sudo[105658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:55 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-730101ec-3ff3-42aa-ba93-8ddf56be0210 tempest-CinderUnicodeTest-231430199 None] Acquiring lock "cinder-ade8553e-26fc-4742-be74-9e4891c57e04-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:38:55 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-730101ec-3ff3-42aa-ba93-8ddf56be0210 tempest-CinderUnicodeTest-231430199 None] Lock "cinder-ade8553e-26fc-4742-be74-9e4891c57e04-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:38:56 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-730101ec-3ff3-42aa-ba93-8ddf56be0210 tempest-CinderUnicodeTest-231430199 None] Acquiring lock "cinder-quobyte-ade8553e-26fc-4742-be74-9e4891c57e04" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:38:56 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-730101ec-3ff3-42aa-ba93-8ddf56be0210 tempest-CinderUnicodeTest-231430199 None] Lock "cinder-quobyte-ade8553e-26fc-4742-be74-9e4891c57e04" acquired by "delete_volume" :: waited 0.035s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:38:56 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[404bf4b6-4874-4f8c-a903-19bd2af7e922]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:38:56 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-730101ec-3ff3-42aa-ba93-8ddf56be0210 tempest-CinderUnicodeTest-231430199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-ade8553e-26fc-4742-be74-9e4891c57e04 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:56 devstack sudo[105662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-ade8553e-26fc-4742-be74-9e4891c57e04 Sep 28 09:38:56 devstack sudo[105662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:56 devstack sudo[105658]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:56 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2beb2a1d-d5ee-4cb1-9cfc-8eaa58c9b945 tempest-CinderUnicodeTest-231430199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.641s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:56 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-2beb2a1d-d5ee-4cb1-9cfc-8eaa58c9b945 tempest-CinderUnicodeTest-231430199 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:38:56 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-2beb2a1d-d5ee-4cb1-9cfc-8eaa58c9b945 tempest-CinderUnicodeTest-231430199 None] Deleted volume successfully. Sep 28 09:38:56 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-2beb2a1d-d5ee-4cb1-9cfc-8eaa58c9b945 tempest-CinderUnicodeTest-231430199 None] Lock "cinder-1b3d0337-533b-46c6-8822-6e27c2b8a616-delete_volume" released by "delete_volume" :: held 1.934s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:38:56 devstack sudo[105662]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:56 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-730101ec-3ff3-42aa-ba93-8ddf56be0210 tempest-CinderUnicodeTest-231430199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-ade8553e-26fc-4742-be74-9e4891c57e04" returned: 0 in 0.664s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:56 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-730101ec-3ff3-42aa-ba93-8ddf56be0210 tempest-CinderUnicodeTest-231430199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-ade8553e-26fc-4742-be74-9e4891c57e04 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:56 devstack sudo[105668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-ade8553e-26fc-4742-be74-9e4891c57e04 Sep 28 09:38:56 devstack sudo[105668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:57 devstack sudo[105668]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:57 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-730101ec-3ff3-42aa-ba93-8ddf56be0210 tempest-CinderUnicodeTest-231430199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-ade8553e-26fc-4742-be74-9e4891c57e04" returned: 0 in 0.720s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:57 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-730101ec-3ff3-42aa-ba93-8ddf56be0210 tempest-CinderUnicodeTest-231430199 None] Lock "cinder-quobyte-ade8553e-26fc-4742-be74-9e4891c57e04" released by "delete_volume" :: held 1.517s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:38:57 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-730101ec-3ff3-42aa-ba93-8ddf56be0210 tempest-CinderUnicodeTest-231430199 None] Created reservations ['4e9df730-d5e9-4b80-893b-4e2da033e3bc', '8dd0431e-24e7-47a8-af1f-374f566d92c8', 'f8e20427-b368-415e-a941-972178c1025a', '8f7e4bfa-da0b-43bb-8d25-bf31c8615ed2'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:38:57 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-730101ec-3ff3-42aa-ba93-8ddf56be0210 tempest-CinderUnicodeTest-231430199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:38:57 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-730101ec-3ff3-42aa-ba93-8ddf56be0210 tempest-CinderUnicodeTest-231430199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:38:57 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-730101ec-3ff3-42aa-ba93-8ddf56be0210 tempest-CinderUnicodeTest-231430199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:38:57 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-730101ec-3ff3-42aa-ba93-8ddf56be0210 tempest-CinderUnicodeTest-231430199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:38:57 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-730101ec-3ff3-42aa-ba93-8ddf56be0210 tempest-CinderUnicodeTest-231430199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:38:57 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-730101ec-3ff3-42aa-ba93-8ddf56be0210 tempest-CinderUnicodeTest-231430199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:38:58 devstack sudo[105672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:38:58 devstack sudo[105672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:38:59 devstack sudo[105672]: pam_unix(sudo:session): session closed for user root Sep 28 09:38:59 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-730101ec-3ff3-42aa-ba93-8ddf56be0210 tempest-CinderUnicodeTest-231430199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 1.209s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:38:59 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-730101ec-3ff3-42aa-ba93-8ddf56be0210 tempest-CinderUnicodeTest-231430199 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:38:59 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-730101ec-3ff3-42aa-ba93-8ddf56be0210 tempest-CinderUnicodeTest-231430199 None] Deleted volume successfully. Sep 28 09:38:59 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-730101ec-3ff3-42aa-ba93-8ddf56be0210 tempest-CinderUnicodeTest-231430199 None] Lock "cinder-ade8553e-26fc-4742-be74-9e4891c57e04-delete_volume" released by "delete_volume" :: held 3.306s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:39:05 devstack sudo[105642]: pam_unix(sudo:session): session closed for user root Sep 28 09:39:05 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-69995bee-c837-4668-8fcc-5636d2ccf8ce tempest-TestStampPattern-708957854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f8848ae3-33f7-4d6a-98ec-13d3d4d35dbd /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-34229eeb-2cb0-41f9-8e66-3059b7ab39eb" returned: 0 in 10.492s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:39:05 devstack cinder-volume[86553]: DEBUG cinder.image.image_utils [None req-69995bee-c837-4668-8fcc-5636d2ccf8ce tempest-TestStampPattern-708957854 None] Image conversion details: src /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f8848ae3-33f7-4d6a-98ec-13d3d4d35dbd, size 1024.00 MB, duration 10.49 sec, destination /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-34229eeb-2cb0-41f9-8e66-3059b7ab39eb {{(pid=86553) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 09:39:05 devstack cinder-volume[86553]: INFO cinder.image.image_utils [None req-69995bee-c837-4668-8fcc-5636d2ccf8ce tempest-TestStampPattern-708957854 None] Converted 1024.00 MB image at 97.59 MB/s Sep 28 09:39:05 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-69995bee-c837-4668-8fcc-5636d2ccf8ce tempest-TestStampPattern-708957854 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-34229eeb-2cb0-41f9-8e66-3059b7ab39eb is being set with open permissions: ugo+rw Sep 28 09:39:05 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-69995bee-c837-4668-8fcc-5636d2ccf8ce tempest-TestStampPattern-708957854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-34229eeb-2cb0-41f9-8e66-3059b7ab39eb {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:39:05 devstack sudo[105743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-34229eeb-2cb0-41f9-8e66-3059b7ab39eb Sep 28 09:39:05 devstack sudo[105743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:39:05 devstack sudo[105743]: pam_unix(sudo:session): session closed for user root Sep 28 09:39:05 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-69995bee-c837-4668-8fcc-5636d2ccf8ce tempest-TestStampPattern-708957854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-34229eeb-2cb0-41f9-8e66-3059b7ab39eb" returned: 0 in 0.269s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:39:05 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-69995bee-c837-4668-8fcc-5636d2ccf8ce tempest-TestStampPattern-708957854 None] Lock "cinder-quobyte-34229eeb-2cb0-41f9-8e66-3059b7ab39eb" released by "_copy_volume_from_snapshot" :: held 11.795s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:39:05 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-69995bee-c837-4668-8fcc-5636d2ccf8ce tempest-TestStampPattern-708957854 None] Lock "cinder-quobyte-1029b85b-8cdd-41df-be71-5eb500190aee-34229eeb-2cb0-41f9-8e66-3059b7ab39eb" released by "_create_volume_from_snapshot" :: held 11.925s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:39:05 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-69995bee-c837-4668-8fcc-5636d2ccf8ce tempest-TestStampPattern-708957854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.972s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:39:05 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-a50fc1af-19e5-4f4c-908c-4ecc02db6295 tempest-ProjectReaderTests-1061496652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.747s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:39:05 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-a50fc1af-19e5-4f4c-908c-4ecc02db6295 tempest-ProjectReaderTests-1061496652 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:38:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1877621579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a30fe86c-24e8-4071-8ced-24a5dd095e91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42fd504cecf7452db30446b88998bc05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:38:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:38:54Z,use_quota=True,user_id='c835e8117f0e4144bce278ca1449c95c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:39:05 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-a50fc1af-19e5-4f4c-908c-4ecc02db6295 tempest-ProjectReaderTests-1061496652 None] Creating volume a30fe86c-24e8-4071-8ced-24a5dd095e91 {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:39:05 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-a50fc1af-19e5-4f4c-908c-4ecc02db6295 tempest-ProjectReaderTests-1061496652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:39:05 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-a50fc1af-19e5-4f4c-908c-4ecc02db6295 tempest-ProjectReaderTests-1061496652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:39:05 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-a50fc1af-19e5-4f4c-908c-4ecc02db6295 tempest-ProjectReaderTests-1061496652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:39:05 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-a50fc1af-19e5-4f4c-908c-4ecc02db6295 tempest-ProjectReaderTests-1061496652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:39:05 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-a50fc1af-19e5-4f4c-908c-4ecc02db6295 tempest-ProjectReaderTests-1061496652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:39:05 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-a50fc1af-19e5-4f4c-908c-4ecc02db6295 tempest-ProjectReaderTests-1061496652 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:39:05 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-a50fc1af-19e5-4f4c-908c-4ecc02db6295 tempest-ProjectReaderTests-1061496652 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:39:05 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a50fc1af-19e5-4f4c-908c-4ecc02db6295 tempest-ProjectReaderTests-1061496652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a30fe86c-24e8-4071-8ced-24a5dd095e91 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:39:05 devstack sudo[105756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a30fe86c-24e8-4071-8ced-24a5dd095e91 1073741824 Sep 28 09:39:05 devstack sudo[105756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:39:05 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-69995bee-c837-4668-8fcc-5636d2ccf8ce tempest-TestStampPattern-708957854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2a1329f-7717-4f3c-bd5a-0318778a269b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34229eeb-2cb0-41f9-8e66-3059b7ab39eb', 'volume_size': 1, 'snapshot_id': '1029b85b-8cdd-41df-be71-5eb500190aee'}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:39:05 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-69995bee-c837-4668-8fcc-5636d2ccf8ce tempest-TestStampPattern-708957854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bc30675-bbba-4732-a584-f41509f9e426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:39:05 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-69995bee-c837-4668-8fcc-5636d2ccf8ce tempest-TestStampPattern-708957854 None] Volume volume-34229eeb-2cb0-41f9-8e66-3059b7ab39eb (34229eeb-2cb0-41f9-8e66-3059b7ab39eb): created successfully Sep 28 09:39:05 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-69995bee-c837-4668-8fcc-5636d2ccf8ce tempest-TestStampPattern-708957854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bc30675-bbba-4732-a584-f41509f9e426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:39:05 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-69995bee-c837-4668-8fcc-5636d2ccf8ce tempest-TestStampPattern-708957854 None] Flow 'volume_create_manager' (acc046e3-d7be-4aaa-85a5-3936acf406e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:39:05 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-69995bee-c837-4668-8fcc-5636d2ccf8ce tempest-TestStampPattern-708957854 None] Created volume successfully. Sep 28 09:39:06 devstack sudo[105756]: pam_unix(sudo:session): session closed for user root Sep 28 09:39:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a50fc1af-19e5-4f4c-908c-4ecc02db6295 tempest-ProjectReaderTests-1061496652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a30fe86c-24e8-4071-8ced-24a5dd095e91 1073741824" returned: 0 in 0.627s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:39:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a50fc1af-19e5-4f4c-908c-4ecc02db6295 tempest-ProjectReaderTests-1061496652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a30fe86c-24e8-4071-8ced-24a5dd095e91 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:39:06 devstack sudo[105772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a30fe86c-24e8-4071-8ced-24a5dd095e91 Sep 28 09:39:06 devstack sudo[105772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:39:06 devstack sudo[105772]: pam_unix(sudo:session): session closed for user root Sep 28 09:39:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a50fc1af-19e5-4f4c-908c-4ecc02db6295 tempest-ProjectReaderTests-1061496652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a30fe86c-24e8-4071-8ced-24a5dd095e91" returned: 0 in 0.297s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:39:06 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-a50fc1af-19e5-4f4c-908c-4ecc02db6295 tempest-ProjectReaderTests-1061496652 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:39:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-a50fc1af-19e5-4f4c-908c-4ecc02db6295 tempest-ProjectReaderTests-1061496652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:39:06 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-a50fc1af-19e5-4f4c-908c-4ecc02db6295 tempest-ProjectReaderTests-1061496652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b267260-2c12-433a-8732-8a366d348c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a30fe86c-24e8-4071-8ced-24a5dd095e91', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:39:06 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-a50fc1af-19e5-4f4c-908c-4ecc02db6295 tempest-ProjectReaderTests-1061496652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baa41051-c0e5-4573-bd08-d603b7dcd919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:39:06 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-a50fc1af-19e5-4f4c-908c-4ecc02db6295 tempest-ProjectReaderTests-1061496652 None] Volume volume-a30fe86c-24e8-4071-8ced-24a5dd095e91 (a30fe86c-24e8-4071-8ced-24a5dd095e91): created successfully Sep 28 09:39:06 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-a50fc1af-19e5-4f4c-908c-4ecc02db6295 tempest-ProjectReaderTests-1061496652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baa41051-c0e5-4573-bd08-d603b7dcd919) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:39:06 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-a50fc1af-19e5-4f4c-908c-4ecc02db6295 tempest-ProjectReaderTests-1061496652 None] Flow 'volume_create_manager' (2fbca1c6-5b3e-4cef-a9ca-b91560d55181) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:39:06 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-a50fc1af-19e5-4f4c-908c-4ecc02db6295 tempest-ProjectReaderTests-1061496652 None] Created volume successfully. Sep 28 09:39:07 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-3f9a776d-0a35-412b-a5b0-b5feea742045 tempest-ProjectReaderTests-1061496652 None] Acquiring lock "cinder-a30fe86c-24e8-4071-8ced-24a5dd095e91-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:39:07 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-3f9a776d-0a35-412b-a5b0-b5feea742045 tempest-ProjectReaderTests-1061496652 None] Lock "cinder-a30fe86c-24e8-4071-8ced-24a5dd095e91-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:39:07 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-3f9a776d-0a35-412b-a5b0-b5feea742045 tempest-ProjectReaderTests-1061496652 None] Acquiring lock "cinder-quobyte-a30fe86c-24e8-4071-8ced-24a5dd095e91" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:39:07 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-3f9a776d-0a35-412b-a5b0-b5feea742045 tempest-ProjectReaderTests-1061496652 None] Lock "cinder-quobyte-a30fe86c-24e8-4071-8ced-24a5dd095e91" acquired by "delete_volume" :: waited 0.025s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:39:07 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[c36f8546-72a6-4d2c-8a23-a372d960a208]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:39:07 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3f9a776d-0a35-412b-a5b0-b5feea742045 tempest-ProjectReaderTests-1061496652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a30fe86c-24e8-4071-8ced-24a5dd095e91 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:39:07 devstack sudo[105777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a30fe86c-24e8-4071-8ced-24a5dd095e91 Sep 28 09:39:07 devstack sudo[105777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:39:08 devstack sudo[105777]: pam_unix(sudo:session): session closed for user root Sep 28 09:39:08 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3f9a776d-0a35-412b-a5b0-b5feea742045 tempest-ProjectReaderTests-1061496652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a30fe86c-24e8-4071-8ced-24a5dd095e91" returned: 0 in 0.472s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:39:08 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3f9a776d-0a35-412b-a5b0-b5feea742045 tempest-ProjectReaderTests-1061496652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a30fe86c-24e8-4071-8ced-24a5dd095e91 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:39:08 devstack sudo[105783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a30fe86c-24e8-4071-8ced-24a5dd095e91 Sep 28 09:39:08 devstack sudo[105783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:39:08 devstack sudo[105783]: pam_unix(sudo:session): session closed for user root Sep 28 09:39:08 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3f9a776d-0a35-412b-a5b0-b5feea742045 tempest-ProjectReaderTests-1061496652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a30fe86c-24e8-4071-8ced-24a5dd095e91" returned: 0 in 0.335s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:39:08 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-3f9a776d-0a35-412b-a5b0-b5feea742045 tempest-ProjectReaderTests-1061496652 None] Lock "cinder-quobyte-a30fe86c-24e8-4071-8ced-24a5dd095e91" released by "delete_volume" :: held 0.879s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:39:08 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-3f9a776d-0a35-412b-a5b0-b5feea742045 tempest-ProjectReaderTests-1061496652 None] Created reservations ['7315873a-9dd0-424f-874b-b9da893e06d1', '5999ff56-6d7a-4f89-8c7d-e08a62056e61', '8b99c813-d63e-4d35-860c-abe259bf7ba8', '3791b84e-4150-4d1e-9614-99f1dae061f9'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:39:08 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-3f9a776d-0a35-412b-a5b0-b5feea742045 tempest-ProjectReaderTests-1061496652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:39:08 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-3f9a776d-0a35-412b-a5b0-b5feea742045 tempest-ProjectReaderTests-1061496652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:39:08 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-3f9a776d-0a35-412b-a5b0-b5feea742045 tempest-ProjectReaderTests-1061496652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:39:08 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-3f9a776d-0a35-412b-a5b0-b5feea742045 tempest-ProjectReaderTests-1061496652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:39:08 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-3f9a776d-0a35-412b-a5b0-b5feea742045 tempest-ProjectReaderTests-1061496652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:39:08 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3f9a776d-0a35-412b-a5b0-b5feea742045 tempest-ProjectReaderTests-1061496652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:39:08 devstack sudo[105786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:39:08 devstack sudo[105786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:39:08 devstack sudo[105786]: pam_unix(sudo:session): session closed for user root Sep 28 09:39:08 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3f9a776d-0a35-412b-a5b0-b5feea742045 tempest-ProjectReaderTests-1061496652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.379s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:39:08 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-3f9a776d-0a35-412b-a5b0-b5feea742045 tempest-ProjectReaderTests-1061496652 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:39:09 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-3f9a776d-0a35-412b-a5b0-b5feea742045 tempest-ProjectReaderTests-1061496652 None] Deleted volume successfully. Sep 28 09:39:09 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-3f9a776d-0a35-412b-a5b0-b5feea742045 tempest-ProjectReaderTests-1061496652 None] Lock "cinder-a30fe86c-24e8-4071-8ced-24a5dd095e91-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:39:09 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-10eb2893-b920-440e-af23-7c8f6a598bed tempest-ProjectReaderTests-1061496652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:39:09 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-10eb2893-b920-440e-af23-7c8f6a598bed tempest-ProjectReaderTests-1061496652 None] Flow 'volume_create_manager' (11a1ce07-6dc8-4f89-8b23-65f99a4b9f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:39:09 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-10eb2893-b920-440e-af23-7c8f6a598bed tempest-ProjectReaderTests-1061496652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76b6dba0-97a3-4ab3-81ae-d939c81dd925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:39:09 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-10eb2893-b920-440e-af23-7c8f6a598bed tempest-ProjectReaderTests-1061496652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76b6dba0-97a3-4ab3-81ae-d939c81dd925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:39:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-812986469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a918271-2fb5-4990-8790-518ffdf864c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42fd504cecf7452db30446b88998bc05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:39:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:39:09Z,use_quota=True,user_id='c835e8117f0e4144bce278ca1449c95c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:39:09 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-10eb2893-b920-440e-af23-7c8f6a598bed tempest-ProjectReaderTests-1061496652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31cfcea5-a98e-4afa-bfd0-c6f2ac603245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:39:09 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-10eb2893-b920-440e-af23-7c8f6a598bed tempest-ProjectReaderTests-1061496652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31cfcea5-a98e-4afa-bfd0-c6f2ac603245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:39:09 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-10eb2893-b920-440e-af23-7c8f6a598bed tempest-ProjectReaderTests-1061496652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34e09251-31bf-4775-8e60-cd3d4eed3bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:39:09 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-10eb2893-b920-440e-af23-7c8f6a598bed tempest-ProjectReaderTests-1061496652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34e09251-31bf-4775-8e60-cd3d4eed3bae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a918271-2fb5-4990-8790-518ffdf864c7', 'volume_name': 'volume-4a918271-2fb5-4990-8790-518ffdf864c7', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:39:09 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-10eb2893-b920-440e-af23-7c8f6a598bed tempest-ProjectReaderTests-1061496652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb3e6dcf-737c-471b-8b42-1d28a722beae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:39:09 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-10eb2893-b920-440e-af23-7c8f6a598bed tempest-ProjectReaderTests-1061496652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb3e6dcf-737c-471b-8b42-1d28a722beae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:39:09 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-10eb2893-b920-440e-af23-7c8f6a598bed tempest-ProjectReaderTests-1061496652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10a9676b-9b84-4df8-9446-57c8d2c0739f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:39:09 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-10eb2893-b920-440e-af23-7c8f6a598bed tempest-ProjectReaderTests-1061496652 None] Volume 4a918271-2fb5-4990-8790-518ffdf864c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a918271-2fb5-4990-8790-518ffdf864c7', 'volume_size': 1} Sep 28 09:39:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-10eb2893-b920-440e-af23-7c8f6a598bed tempest-ProjectReaderTests-1061496652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:39:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-10eb2893-b920-440e-af23-7c8f6a598bed tempest-ProjectReaderTests-1061496652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:39:09 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-10eb2893-b920-440e-af23-7c8f6a598bed tempest-ProjectReaderTests-1061496652 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:39:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-812986469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a918271-2fb5-4990-8790-518ffdf864c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42fd504cecf7452db30446b88998bc05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:39:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:39:09Z,use_quota=True,user_id='c835e8117f0e4144bce278ca1449c95c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:39:09 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-10eb2893-b920-440e-af23-7c8f6a598bed tempest-ProjectReaderTests-1061496652 None] Creating volume 4a918271-2fb5-4990-8790-518ffdf864c7 {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:39:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-10eb2893-b920-440e-af23-7c8f6a598bed tempest-ProjectReaderTests-1061496652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:39:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-10eb2893-b920-440e-af23-7c8f6a598bed tempest-ProjectReaderTests-1061496652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:39:09 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-10eb2893-b920-440e-af23-7c8f6a598bed tempest-ProjectReaderTests-1061496652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:39:09 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-10eb2893-b920-440e-af23-7c8f6a598bed tempest-ProjectReaderTests-1061496652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:39:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-10eb2893-b920-440e-af23-7c8f6a598bed tempest-ProjectReaderTests-1061496652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:39:09 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-10eb2893-b920-440e-af23-7c8f6a598bed tempest-ProjectReaderTests-1061496652 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:39:09 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-10eb2893-b920-440e-af23-7c8f6a598bed tempest-ProjectReaderTests-1061496652 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:39:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-10eb2893-b920-440e-af23-7c8f6a598bed tempest-ProjectReaderTests-1061496652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-4a918271-2fb5-4990-8790-518ffdf864c7 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:39:09 devstack sudo[105789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-4a918271-2fb5-4990-8790-518ffdf864c7 1073741824 Sep 28 09:39:09 devstack sudo[105789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:39:10 devstack sudo[105789]: pam_unix(sudo:session): session closed for user root Sep 28 09:39:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-10eb2893-b920-440e-af23-7c8f6a598bed tempest-ProjectReaderTests-1061496652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-4a918271-2fb5-4990-8790-518ffdf864c7 1073741824" returned: 0 in 0.559s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:39:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-10eb2893-b920-440e-af23-7c8f6a598bed tempest-ProjectReaderTests-1061496652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-4a918271-2fb5-4990-8790-518ffdf864c7 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:39:10 devstack sudo[105795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-4a918271-2fb5-4990-8790-518ffdf864c7 Sep 28 09:39:10 devstack sudo[105795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:39:10 devstack sudo[105795]: pam_unix(sudo:session): session closed for user root Sep 28 09:39:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-10eb2893-b920-440e-af23-7c8f6a598bed tempest-ProjectReaderTests-1061496652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-4a918271-2fb5-4990-8790-518ffdf864c7" returned: 0 in 0.302s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:39:10 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-10eb2893-b920-440e-af23-7c8f6a598bed tempest-ProjectReaderTests-1061496652 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:39:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-10eb2893-b920-440e-af23-7c8f6a598bed tempest-ProjectReaderTests-1061496652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:39:10 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-10eb2893-b920-440e-af23-7c8f6a598bed tempest-ProjectReaderTests-1061496652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10a9676b-9b84-4df8-9446-57c8d2c0739f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a918271-2fb5-4990-8790-518ffdf864c7', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:39:10 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-10eb2893-b920-440e-af23-7c8f6a598bed tempest-ProjectReaderTests-1061496652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57f8431f-38a3-4af5-972a-2951dab8853e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:39:10 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-10eb2893-b920-440e-af23-7c8f6a598bed tempest-ProjectReaderTests-1061496652 None] Volume volume-4a918271-2fb5-4990-8790-518ffdf864c7 (4a918271-2fb5-4990-8790-518ffdf864c7): created successfully Sep 28 09:39:10 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-10eb2893-b920-440e-af23-7c8f6a598bed tempest-ProjectReaderTests-1061496652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57f8431f-38a3-4af5-972a-2951dab8853e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:39:10 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-10eb2893-b920-440e-af23-7c8f6a598bed tempest-ProjectReaderTests-1061496652 None] Flow 'volume_create_manager' (11a1ce07-6dc8-4f89-8b23-65f99a4b9f96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:39:10 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-10eb2893-b920-440e-af23-7c8f6a598bed tempest-ProjectReaderTests-1061496652 None] Created volume successfully. Sep 28 09:39:11 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-5fcd503d-2216-41a8-b3de-c3540b08a0ec tempest-ProjectReaderTests-1061496652 None] Acquiring lock "cinder-4a918271-2fb5-4990-8790-518ffdf864c7-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:39:11 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-5fcd503d-2216-41a8-b3de-c3540b08a0ec tempest-ProjectReaderTests-1061496652 None] Lock "cinder-4a918271-2fb5-4990-8790-518ffdf864c7-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:39:11 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-5fcd503d-2216-41a8-b3de-c3540b08a0ec tempest-ProjectReaderTests-1061496652 None] Acquiring lock "cinder-quobyte-4a918271-2fb5-4990-8790-518ffdf864c7" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:39:11 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-5fcd503d-2216-41a8-b3de-c3540b08a0ec tempest-ProjectReaderTests-1061496652 None] Lock "cinder-quobyte-4a918271-2fb5-4990-8790-518ffdf864c7" acquired by "delete_volume" :: waited 0.019s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:39:11 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf78bff-4865-4103-bdff-9cbbb05cddc0]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:39:11 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-5fcd503d-2216-41a8-b3de-c3540b08a0ec tempest-ProjectReaderTests-1061496652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-4a918271-2fb5-4990-8790-518ffdf864c7 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:39:11 devstack sudo[105800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-4a918271-2fb5-4990-8790-518ffdf864c7 Sep 28 09:39:11 devstack sudo[105800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:39:12 devstack sudo[105800]: pam_unix(sudo:session): session closed for user root Sep 28 09:39:12 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-5fcd503d-2216-41a8-b3de-c3540b08a0ec tempest-ProjectReaderTests-1061496652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-4a918271-2fb5-4990-8790-518ffdf864c7" returned: 0 in 0.374s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:39:12 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-5fcd503d-2216-41a8-b3de-c3540b08a0ec tempest-ProjectReaderTests-1061496652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-4a918271-2fb5-4990-8790-518ffdf864c7 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:39:12 devstack sudo[105805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-4a918271-2fb5-4990-8790-518ffdf864c7 Sep 28 09:39:12 devstack sudo[105805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:39:12 devstack sudo[105805]: pam_unix(sudo:session): session closed for user root Sep 28 09:39:12 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-5fcd503d-2216-41a8-b3de-c3540b08a0ec tempest-ProjectReaderTests-1061496652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-4a918271-2fb5-4990-8790-518ffdf864c7" returned: 0 in 0.262s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:39:12 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-5fcd503d-2216-41a8-b3de-c3540b08a0ec tempest-ProjectReaderTests-1061496652 None] Lock "cinder-quobyte-4a918271-2fb5-4990-8790-518ffdf864c7" released by "delete_volume" :: held 0.688s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:39:12 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-5fcd503d-2216-41a8-b3de-c3540b08a0ec tempest-ProjectReaderTests-1061496652 None] Created reservations ['85a44f73-4ce7-4f95-a284-14b745127b82', '0777b96a-a474-436e-812c-876beab845a9', '22dfb209-4ba3-4943-b32a-60d60d4d55a7', 'a5d96c11-79ab-47ec-809c-766ea3a55a11'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:39:12 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-5fcd503d-2216-41a8-b3de-c3540b08a0ec tempest-ProjectReaderTests-1061496652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:39:12 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-5fcd503d-2216-41a8-b3de-c3540b08a0ec tempest-ProjectReaderTests-1061496652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:39:12 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-5fcd503d-2216-41a8-b3de-c3540b08a0ec tempest-ProjectReaderTests-1061496652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:39:12 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-5fcd503d-2216-41a8-b3de-c3540b08a0ec tempest-ProjectReaderTests-1061496652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:39:12 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-5fcd503d-2216-41a8-b3de-c3540b08a0ec tempest-ProjectReaderTests-1061496652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:39:12 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-5fcd503d-2216-41a8-b3de-c3540b08a0ec tempest-ProjectReaderTests-1061496652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:39:12 devstack sudo[105808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:39:12 devstack sudo[105808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:39:12 devstack sudo[105808]: pam_unix(sudo:session): session closed for user root Sep 28 09:39:12 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-5fcd503d-2216-41a8-b3de-c3540b08a0ec tempest-ProjectReaderTests-1061496652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.269s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:39:12 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-5fcd503d-2216-41a8-b3de-c3540b08a0ec tempest-ProjectReaderTests-1061496652 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:39:12 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-5fcd503d-2216-41a8-b3de-c3540b08a0ec tempest-ProjectReaderTests-1061496652 None] Deleted volume successfully. Sep 28 09:39:12 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-5fcd503d-2216-41a8-b3de-c3540b08a0ec tempest-ProjectReaderTests-1061496652 None] Lock "cinder-4a918271-2fb5-4990-8790-518ffdf864c7-delete_volume" released by "delete_volume" :: held 1.222s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:39:21 devstack cinder-volume[86553]: DEBUG oslo_service.periodic_task [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86553) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 09:39:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:39:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:39:21 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:39:21 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:39:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:39:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:39:21 devstack sudo[105825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:39:21 devstack sudo[105825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:39:21 devstack sudo[105825]: pam_unix(sudo:session): session closed for user root Sep 28 09:39:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.248s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:39:21 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:39:21 devstack cinder-volume[86553]: DEBUG oslo_service.periodic_task [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Running periodic task VolumeManager._thread_info {{(pid=86553) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 09:39:21 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] thread count: 28 {{(pid=86553) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 09:39:21 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] thread info: [<_MainThread(MainThread, started 134684877779072)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86553) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 09:39:22 devstack cinder-volume[86553]: DEBUG dbcounter [-] [86553] Writing DB stats cinder:SELECT=68,cinder:UPDATE=66,cinder:INSERT=21,cinder:DELETE=7 {{(pid=86553) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 09:39:22 devstack cinder-volume[86553]: DEBUG dbcounter [-] [86553] Writing DB stats cinder:SELECT=48,cinder:INSERT=20,cinder:UPDATE=70,cinder:DELETE=6 {{(pid=86553) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 09:39:25 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa4ea51f-0c53-463b-86af-e6b342081b2f tempest-ProjectReaderTests-307687838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:39:25 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-fa4ea51f-0c53-463b-86af-e6b342081b2f tempest-ProjectReaderTests-307687838 None] Flow 'volume_create_manager' (211080df-5afa-44fe-92f0-f76e2d42ae55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:39:25 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-fa4ea51f-0c53-463b-86af-e6b342081b2f tempest-ProjectReaderTests-307687838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09705cfa-c202-49b6-a9ea-5dee4c2a0b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:39:25 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-fa4ea51f-0c53-463b-86af-e6b342081b2f tempest-ProjectReaderTests-307687838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09705cfa-c202-49b6-a9ea-5dee4c2a0b30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:39:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1122093624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=746a102d-0604-4d8d-931c-c73c0623eb28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5214755575f24066b6f63bb25f37d933',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:39:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:39:25Z,use_quota=True,user_id='bb25e93d58c747fe86fa714c976da8c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:39:25 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-fa4ea51f-0c53-463b-86af-e6b342081b2f tempest-ProjectReaderTests-307687838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e015764f-4bfc-4350-905d-1a12093209d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:39:25 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-fa4ea51f-0c53-463b-86af-e6b342081b2f tempest-ProjectReaderTests-307687838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e015764f-4bfc-4350-905d-1a12093209d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:39:25 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-fa4ea51f-0c53-463b-86af-e6b342081b2f tempest-ProjectReaderTests-307687838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (669f6d1b-c7fa-49dc-a3b4-d485bd0f1a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:39:25 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-fa4ea51f-0c53-463b-86af-e6b342081b2f tempest-ProjectReaderTests-307687838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (669f6d1b-c7fa-49dc-a3b4-d485bd0f1a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '746a102d-0604-4d8d-931c-c73c0623eb28', 'volume_name': 'volume-746a102d-0604-4d8d-931c-c73c0623eb28', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:39:25 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-fa4ea51f-0c53-463b-86af-e6b342081b2f tempest-ProjectReaderTests-307687838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8607103-6295-44be-8715-dc50473b04e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:39:25 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-fa4ea51f-0c53-463b-86af-e6b342081b2f tempest-ProjectReaderTests-307687838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8607103-6295-44be-8715-dc50473b04e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:39:25 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-fa4ea51f-0c53-463b-86af-e6b342081b2f tempest-ProjectReaderTests-307687838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48cec695-2bad-43dc-99b8-b78d13ec0a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:39:25 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-fa4ea51f-0c53-463b-86af-e6b342081b2f tempest-ProjectReaderTests-307687838 None] Volume 746a102d-0604-4d8d-931c-c73c0623eb28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-746a102d-0604-4d8d-931c-c73c0623eb28', 'volume_size': 1} Sep 28 09:39:25 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-fa4ea51f-0c53-463b-86af-e6b342081b2f tempest-ProjectReaderTests-307687838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:39:25 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-fa4ea51f-0c53-463b-86af-e6b342081b2f tempest-ProjectReaderTests-307687838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:39:25 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-fa4ea51f-0c53-463b-86af-e6b342081b2f tempest-ProjectReaderTests-307687838 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:39:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1122093624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=746a102d-0604-4d8d-931c-c73c0623eb28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5214755575f24066b6f63bb25f37d933',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:39:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:39:25Z,use_quota=True,user_id='bb25e93d58c747fe86fa714c976da8c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:39:25 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-fa4ea51f-0c53-463b-86af-e6b342081b2f tempest-ProjectReaderTests-307687838 None] Creating volume 746a102d-0604-4d8d-931c-c73c0623eb28 {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:39:25 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-fa4ea51f-0c53-463b-86af-e6b342081b2f tempest-ProjectReaderTests-307687838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:39:25 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-fa4ea51f-0c53-463b-86af-e6b342081b2f tempest-ProjectReaderTests-307687838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:39:25 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-fa4ea51f-0c53-463b-86af-e6b342081b2f tempest-ProjectReaderTests-307687838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:39:25 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-fa4ea51f-0c53-463b-86af-e6b342081b2f tempest-ProjectReaderTests-307687838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:39:25 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-fa4ea51f-0c53-463b-86af-e6b342081b2f tempest-ProjectReaderTests-307687838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:39:25 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-fa4ea51f-0c53-463b-86af-e6b342081b2f tempest-ProjectReaderTests-307687838 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:39:25 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-fa4ea51f-0c53-463b-86af-e6b342081b2f tempest-ProjectReaderTests-307687838 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:39:25 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-fa4ea51f-0c53-463b-86af-e6b342081b2f tempest-ProjectReaderTests-307687838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-746a102d-0604-4d8d-931c-c73c0623eb28 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:39:25 devstack sudo[105879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-746a102d-0604-4d8d-931c-c73c0623eb28 1073741824 Sep 28 09:39:25 devstack sudo[105879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:39:25 devstack sudo[105879]: pam_unix(sudo:session): session closed for user root Sep 28 09:39:25 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-fa4ea51f-0c53-463b-86af-e6b342081b2f tempest-ProjectReaderTests-307687838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-746a102d-0604-4d8d-931c-c73c0623eb28 1073741824" returned: 0 in 0.407s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:39:25 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-fa4ea51f-0c53-463b-86af-e6b342081b2f tempest-ProjectReaderTests-307687838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-746a102d-0604-4d8d-931c-c73c0623eb28 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:39:25 devstack sudo[105885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-746a102d-0604-4d8d-931c-c73c0623eb28 Sep 28 09:39:25 devstack sudo[105885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:39:26 devstack sudo[105885]: pam_unix(sudo:session): session closed for user root Sep 28 09:39:26 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-fa4ea51f-0c53-463b-86af-e6b342081b2f tempest-ProjectReaderTests-307687838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-746a102d-0604-4d8d-931c-c73c0623eb28" returned: 0 in 0.249s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:39:26 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-fa4ea51f-0c53-463b-86af-e6b342081b2f tempest-ProjectReaderTests-307687838 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:39:26 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-fa4ea51f-0c53-463b-86af-e6b342081b2f tempest-ProjectReaderTests-307687838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:39:26 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-fa4ea51f-0c53-463b-86af-e6b342081b2f tempest-ProjectReaderTests-307687838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48cec695-2bad-43dc-99b8-b78d13ec0a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-746a102d-0604-4d8d-931c-c73c0623eb28', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:39:26 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-fa4ea51f-0c53-463b-86af-e6b342081b2f tempest-ProjectReaderTests-307687838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e8d21aa-2dcd-438a-bbba-37ac0fa94b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:39:26 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-fa4ea51f-0c53-463b-86af-e6b342081b2f tempest-ProjectReaderTests-307687838 None] Volume volume-746a102d-0604-4d8d-931c-c73c0623eb28 (746a102d-0604-4d8d-931c-c73c0623eb28): created successfully Sep 28 09:39:26 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-fa4ea51f-0c53-463b-86af-e6b342081b2f tempest-ProjectReaderTests-307687838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e8d21aa-2dcd-438a-bbba-37ac0fa94b8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:39:26 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-fa4ea51f-0c53-463b-86af-e6b342081b2f tempest-ProjectReaderTests-307687838 None] Flow 'volume_create_manager' (211080df-5afa-44fe-92f0-f76e2d42ae55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:39:26 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-fa4ea51f-0c53-463b-86af-e6b342081b2f tempest-ProjectReaderTests-307687838 None] Created volume successfully. Sep 28 09:39:26 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-10595489-cf61-4d0c-8b74-1798adeaee77 tempest-ProjectReaderTests-307687838 None] Acquiring lock "cinder-746a102d-0604-4d8d-931c-c73c0623eb28-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:39:26 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-10595489-cf61-4d0c-8b74-1798adeaee77 tempest-ProjectReaderTests-307687838 None] Lock "cinder-746a102d-0604-4d8d-931c-c73c0623eb28-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:39:26 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-10595489-cf61-4d0c-8b74-1798adeaee77 tempest-ProjectReaderTests-307687838 None] Acquiring lock "cinder-quobyte-746a102d-0604-4d8d-931c-c73c0623eb28" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:39:26 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-10595489-cf61-4d0c-8b74-1798adeaee77 tempest-ProjectReaderTests-307687838 None] Lock "cinder-quobyte-746a102d-0604-4d8d-931c-c73c0623eb28" acquired by "delete_volume" :: waited 0.018s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:39:26 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff0e394e-27f8-4d6e-84a8-bd882d1fae73]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:39:26 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-10595489-cf61-4d0c-8b74-1798adeaee77 tempest-ProjectReaderTests-307687838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-746a102d-0604-4d8d-931c-c73c0623eb28 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:39:26 devstack sudo[105888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-746a102d-0604-4d8d-931c-c73c0623eb28 Sep 28 09:39:26 devstack sudo[105888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:39:26 devstack sudo[105888]: pam_unix(sudo:session): session closed for user root Sep 28 09:39:26 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-10595489-cf61-4d0c-8b74-1798adeaee77 tempest-ProjectReaderTests-307687838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-746a102d-0604-4d8d-931c-c73c0623eb28" returned: 0 in 0.362s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:39:26 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-10595489-cf61-4d0c-8b74-1798adeaee77 tempest-ProjectReaderTests-307687838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-746a102d-0604-4d8d-931c-c73c0623eb28 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:39:26 devstack sudo[105893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-746a102d-0604-4d8d-931c-c73c0623eb28 Sep 28 09:39:26 devstack sudo[105893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:39:27 devstack sudo[105893]: pam_unix(sudo:session): session closed for user root Sep 28 09:39:27 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-10595489-cf61-4d0c-8b74-1798adeaee77 tempest-ProjectReaderTests-307687838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-746a102d-0604-4d8d-931c-c73c0623eb28" returned: 0 in 0.247s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:39:27 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-10595489-cf61-4d0c-8b74-1798adeaee77 tempest-ProjectReaderTests-307687838 None] Lock "cinder-quobyte-746a102d-0604-4d8d-931c-c73c0623eb28" released by "delete_volume" :: held 0.652s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:39:27 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-10595489-cf61-4d0c-8b74-1798adeaee77 tempest-ProjectReaderTests-307687838 None] Created reservations ['f06510bd-806a-43ec-b503-cffdeb4a732e', 'e2e8e8f3-a113-4653-a473-38054d305869', '314dfcc6-bcdb-45a2-a5c6-e85409e1a848', '88516cc2-c058-4726-9fd4-a5b6bddbd11d'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:39:27 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-10595489-cf61-4d0c-8b74-1798adeaee77 tempest-ProjectReaderTests-307687838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:39:27 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-10595489-cf61-4d0c-8b74-1798adeaee77 tempest-ProjectReaderTests-307687838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:39:27 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-10595489-cf61-4d0c-8b74-1798adeaee77 tempest-ProjectReaderTests-307687838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:39:27 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-10595489-cf61-4d0c-8b74-1798adeaee77 tempest-ProjectReaderTests-307687838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:39:27 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-10595489-cf61-4d0c-8b74-1798adeaee77 tempest-ProjectReaderTests-307687838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:39:27 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-10595489-cf61-4d0c-8b74-1798adeaee77 tempest-ProjectReaderTests-307687838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:39:27 devstack sudo[105896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:39:27 devstack sudo[105896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:39:27 devstack sudo[105896]: pam_unix(sudo:session): session closed for user root Sep 28 09:39:27 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-10595489-cf61-4d0c-8b74-1798adeaee77 tempest-ProjectReaderTests-307687838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.260s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:39:27 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-10595489-cf61-4d0c-8b74-1798adeaee77 tempest-ProjectReaderTests-307687838 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:39:27 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-10595489-cf61-4d0c-8b74-1798adeaee77 tempest-ProjectReaderTests-307687838 None] Deleted volume successfully. Sep 28 09:39:27 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-10595489-cf61-4d0c-8b74-1798adeaee77 tempest-ProjectReaderTests-307687838 None] Lock "cinder-746a102d-0604-4d8d-931c-c73c0623eb28-delete_volume" released by "delete_volume" :: held 1.163s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:39:28 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f1fa697-db63-4a1b-8710-824296e8fcef tempest-ProjectReaderTests-307687838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:39:28 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-1f1fa697-db63-4a1b-8710-824296e8fcef tempest-ProjectReaderTests-307687838 None] Flow 'volume_create_manager' (afa86920-bbb2-46c9-97fa-2745fc77bfa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:39:28 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-1f1fa697-db63-4a1b-8710-824296e8fcef tempest-ProjectReaderTests-307687838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78e4b3f7-4019-4299-a9d6-413c64e74eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:39:28 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-1f1fa697-db63-4a1b-8710-824296e8fcef tempest-ProjectReaderTests-307687838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78e4b3f7-4019-4299-a9d6-413c64e74eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:39:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1030774990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5a9bdf1-305f-42a1-ad5b-338218a57da3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5214755575f24066b6f63bb25f37d933',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:39:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:39:28Z,use_quota=True,user_id='bb25e93d58c747fe86fa714c976da8c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:39:28 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-1f1fa697-db63-4a1b-8710-824296e8fcef tempest-ProjectReaderTests-307687838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1389fbb6-880e-4b31-a67f-3cf251a7a94d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:39:28 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-1f1fa697-db63-4a1b-8710-824296e8fcef tempest-ProjectReaderTests-307687838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1389fbb6-880e-4b31-a67f-3cf251a7a94d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:39:28 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-1f1fa697-db63-4a1b-8710-824296e8fcef tempest-ProjectReaderTests-307687838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcdf82f4-8b91-4b25-97d9-e2708936666c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:39:28 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-1f1fa697-db63-4a1b-8710-824296e8fcef tempest-ProjectReaderTests-307687838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcdf82f4-8b91-4b25-97d9-e2708936666c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5a9bdf1-305f-42a1-ad5b-338218a57da3', 'volume_name': 'volume-e5a9bdf1-305f-42a1-ad5b-338218a57da3', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:39:28 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-1f1fa697-db63-4a1b-8710-824296e8fcef tempest-ProjectReaderTests-307687838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b85952ee-a814-4277-b3ba-20820a3d4919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:39:28 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-1f1fa697-db63-4a1b-8710-824296e8fcef tempest-ProjectReaderTests-307687838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b85952ee-a814-4277-b3ba-20820a3d4919) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:39:28 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-1f1fa697-db63-4a1b-8710-824296e8fcef tempest-ProjectReaderTests-307687838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09a8d6d8-c4ab-4d44-acea-0070718e5a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:39:28 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-1f1fa697-db63-4a1b-8710-824296e8fcef tempest-ProjectReaderTests-307687838 None] Volume e5a9bdf1-305f-42a1-ad5b-338218a57da3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5a9bdf1-305f-42a1-ad5b-338218a57da3', 'volume_size': 1} Sep 28 09:39:28 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-1f1fa697-db63-4a1b-8710-824296e8fcef tempest-ProjectReaderTests-307687838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:39:28 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-1f1fa697-db63-4a1b-8710-824296e8fcef tempest-ProjectReaderTests-307687838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:39:28 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-1f1fa697-db63-4a1b-8710-824296e8fcef tempest-ProjectReaderTests-307687838 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:39:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1030774990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5a9bdf1-305f-42a1-ad5b-338218a57da3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5214755575f24066b6f63bb25f37d933',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:39:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:39:28Z,use_quota=True,user_id='bb25e93d58c747fe86fa714c976da8c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:39:28 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-1f1fa697-db63-4a1b-8710-824296e8fcef tempest-ProjectReaderTests-307687838 None] Creating volume e5a9bdf1-305f-42a1-ad5b-338218a57da3 {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:39:28 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-1f1fa697-db63-4a1b-8710-824296e8fcef tempest-ProjectReaderTests-307687838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:39:28 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-1f1fa697-db63-4a1b-8710-824296e8fcef tempest-ProjectReaderTests-307687838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:39:28 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-1f1fa697-db63-4a1b-8710-824296e8fcef tempest-ProjectReaderTests-307687838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:39:28 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-1f1fa697-db63-4a1b-8710-824296e8fcef tempest-ProjectReaderTests-307687838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:39:28 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-1f1fa697-db63-4a1b-8710-824296e8fcef tempest-ProjectReaderTests-307687838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:39:28 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-1f1fa697-db63-4a1b-8710-824296e8fcef tempest-ProjectReaderTests-307687838 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:39:28 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-1f1fa697-db63-4a1b-8710-824296e8fcef tempest-ProjectReaderTests-307687838 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:39:28 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1f1fa697-db63-4a1b-8710-824296e8fcef tempest-ProjectReaderTests-307687838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-e5a9bdf1-305f-42a1-ad5b-338218a57da3 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:39:28 devstack sudo[105900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-e5a9bdf1-305f-42a1-ad5b-338218a57da3 1073741824 Sep 28 09:39:28 devstack sudo[105900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:39:28 devstack sudo[105900]: pam_unix(sudo:session): session closed for user root Sep 28 09:39:28 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1f1fa697-db63-4a1b-8710-824296e8fcef tempest-ProjectReaderTests-307687838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-e5a9bdf1-305f-42a1-ad5b-338218a57da3 1073741824" returned: 0 in 0.419s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:39:28 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1f1fa697-db63-4a1b-8710-824296e8fcef tempest-ProjectReaderTests-307687838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-e5a9bdf1-305f-42a1-ad5b-338218a57da3 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:39:28 devstack sudo[105905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-e5a9bdf1-305f-42a1-ad5b-338218a57da3 Sep 28 09:39:28 devstack sudo[105905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:39:28 devstack sudo[105905]: pam_unix(sudo:session): session closed for user root Sep 28 09:39:28 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1f1fa697-db63-4a1b-8710-824296e8fcef tempest-ProjectReaderTests-307687838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-e5a9bdf1-305f-42a1-ad5b-338218a57da3" returned: 0 in 0.247s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:39:28 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-1f1fa697-db63-4a1b-8710-824296e8fcef tempest-ProjectReaderTests-307687838 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:39:28 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-1f1fa697-db63-4a1b-8710-824296e8fcef tempest-ProjectReaderTests-307687838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:39:28 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-1f1fa697-db63-4a1b-8710-824296e8fcef tempest-ProjectReaderTests-307687838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09a8d6d8-c4ab-4d44-acea-0070718e5a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5a9bdf1-305f-42a1-ad5b-338218a57da3', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:39:28 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-1f1fa697-db63-4a1b-8710-824296e8fcef tempest-ProjectReaderTests-307687838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25c33a7e-4726-48d8-aea1-fd3a27949e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:39:28 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-1f1fa697-db63-4a1b-8710-824296e8fcef tempest-ProjectReaderTests-307687838 None] Volume volume-e5a9bdf1-305f-42a1-ad5b-338218a57da3 (e5a9bdf1-305f-42a1-ad5b-338218a57da3): created successfully Sep 28 09:39:28 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-1f1fa697-db63-4a1b-8710-824296e8fcef tempest-ProjectReaderTests-307687838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25c33a7e-4726-48d8-aea1-fd3a27949e11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:39:28 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-1f1fa697-db63-4a1b-8710-824296e8fcef tempest-ProjectReaderTests-307687838 None] Flow 'volume_create_manager' (afa86920-bbb2-46c9-97fa-2745fc77bfa7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:39:28 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-1f1fa697-db63-4a1b-8710-824296e8fcef tempest-ProjectReaderTests-307687838 None] Created volume successfully. Sep 28 09:39:29 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-27412b39-1a06-490d-8f43-72fa1f5615ce tempest-ProjectReaderTests-307687838 None] Acquiring lock "cinder-e5a9bdf1-305f-42a1-ad5b-338218a57da3-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:39:29 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-27412b39-1a06-490d-8f43-72fa1f5615ce tempest-ProjectReaderTests-307687838 None] Lock "cinder-e5a9bdf1-305f-42a1-ad5b-338218a57da3-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:39:29 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-27412b39-1a06-490d-8f43-72fa1f5615ce tempest-ProjectReaderTests-307687838 None] Acquiring lock "cinder-quobyte-e5a9bdf1-305f-42a1-ad5b-338218a57da3" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:39:29 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-27412b39-1a06-490d-8f43-72fa1f5615ce tempest-ProjectReaderTests-307687838 None] Lock "cinder-quobyte-e5a9bdf1-305f-42a1-ad5b-338218a57da3" acquired by "delete_volume" :: waited 0.015s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:39:29 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ae99d4-e58b-43d8-aa3e-8e876341ab41]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:39:29 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-27412b39-1a06-490d-8f43-72fa1f5615ce tempest-ProjectReaderTests-307687838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-e5a9bdf1-305f-42a1-ad5b-338218a57da3 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:39:29 devstack sudo[105908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-e5a9bdf1-305f-42a1-ad5b-338218a57da3 Sep 28 09:39:29 devstack sudo[105908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:39:29 devstack sudo[105908]: pam_unix(sudo:session): session closed for user root Sep 28 09:39:29 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-27412b39-1a06-490d-8f43-72fa1f5615ce tempest-ProjectReaderTests-307687838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-e5a9bdf1-305f-42a1-ad5b-338218a57da3" returned: 0 in 0.374s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:39:29 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-27412b39-1a06-490d-8f43-72fa1f5615ce tempest-ProjectReaderTests-307687838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-e5a9bdf1-305f-42a1-ad5b-338218a57da3 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:39:29 devstack sudo[105914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-e5a9bdf1-305f-42a1-ad5b-338218a57da3 Sep 28 09:39:29 devstack sudo[105914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:39:29 devstack sudo[105914]: pam_unix(sudo:session): session closed for user root Sep 28 09:39:29 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-27412b39-1a06-490d-8f43-72fa1f5615ce tempest-ProjectReaderTests-307687838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-e5a9bdf1-305f-42a1-ad5b-338218a57da3" returned: 0 in 0.263s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:39:29 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-27412b39-1a06-490d-8f43-72fa1f5615ce tempest-ProjectReaderTests-307687838 None] Lock "cinder-quobyte-e5a9bdf1-305f-42a1-ad5b-338218a57da3" released by "delete_volume" :: held 0.683s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:39:29 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-27412b39-1a06-490d-8f43-72fa1f5615ce tempest-ProjectReaderTests-307687838 None] Created reservations ['1af98a95-7e76-46e4-8484-596b704eebf7', '74a7b631-aa6c-460f-b851-3539c49af119', '26ea429e-3442-4474-bd73-731d63a9c37e', '18ea564c-60d8-42fe-a643-06590748e213'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:39:29 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-27412b39-1a06-490d-8f43-72fa1f5615ce tempest-ProjectReaderTests-307687838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:39:29 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-27412b39-1a06-490d-8f43-72fa1f5615ce tempest-ProjectReaderTests-307687838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:39:29 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-27412b39-1a06-490d-8f43-72fa1f5615ce tempest-ProjectReaderTests-307687838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:39:29 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-27412b39-1a06-490d-8f43-72fa1f5615ce tempest-ProjectReaderTests-307687838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:39:29 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-27412b39-1a06-490d-8f43-72fa1f5615ce tempest-ProjectReaderTests-307687838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:39:29 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-27412b39-1a06-490d-8f43-72fa1f5615ce tempest-ProjectReaderTests-307687838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:39:29 devstack sudo[105918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:39:29 devstack sudo[105918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:39:30 devstack sudo[105918]: pam_unix(sudo:session): session closed for user root Sep 28 09:39:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-27412b39-1a06-490d-8f43-72fa1f5615ce tempest-ProjectReaderTests-307687838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.275s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:39:30 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-27412b39-1a06-490d-8f43-72fa1f5615ce tempest-ProjectReaderTests-307687838 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:39:30 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-27412b39-1a06-490d-8f43-72fa1f5615ce tempest-ProjectReaderTests-307687838 None] Deleted volume successfully. Sep 28 09:39:30 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-27412b39-1a06-490d-8f43-72fa1f5615ce tempest-ProjectReaderTests-307687838 None] Lock "cinder-e5a9bdf1-305f-42a1-ad5b-338218a57da3-delete_volume" released by "delete_volume" :: held 1.192s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:39:30 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6f51e0d-7ae4-45e9-af9c-78b3e03e313e tempest-ProjectReaderTests-307687838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:39:30 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e6f51e0d-7ae4-45e9-af9c-78b3e03e313e tempest-ProjectReaderTests-307687838 None] Flow 'volume_create_manager' (e00f80d4-57f5-496d-91bd-94c07397c247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:39:30 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e6f51e0d-7ae4-45e9-af9c-78b3e03e313e tempest-ProjectReaderTests-307687838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2482acd7-f8a3-419b-a20e-2c2992098186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:39:30 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e6f51e0d-7ae4-45e9-af9c-78b3e03e313e tempest-ProjectReaderTests-307687838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2482acd7-f8a3-419b-a20e-2c2992098186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:39:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1962072063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ddda5bd-0831-45e1-986e-27db412c3c7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5214755575f24066b6f63bb25f37d933',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:39:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:39:31Z,use_quota=True,user_id='bb25e93d58c747fe86fa714c976da8c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:39:30 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e6f51e0d-7ae4-45e9-af9c-78b3e03e313e tempest-ProjectReaderTests-307687838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15493f23-f4d7-4c4c-95b5-68eee5d363e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:39:30 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e6f51e0d-7ae4-45e9-af9c-78b3e03e313e tempest-ProjectReaderTests-307687838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15493f23-f4d7-4c4c-95b5-68eee5d363e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:39:30 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e6f51e0d-7ae4-45e9-af9c-78b3e03e313e tempest-ProjectReaderTests-307687838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33d7aa8a-3b7c-40a7-9bc9-e843d76291f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:39:30 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e6f51e0d-7ae4-45e9-af9c-78b3e03e313e tempest-ProjectReaderTests-307687838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33d7aa8a-3b7c-40a7-9bc9-e843d76291f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ddda5bd-0831-45e1-986e-27db412c3c7c', 'volume_name': 'volume-5ddda5bd-0831-45e1-986e-27db412c3c7c', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:39:30 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e6f51e0d-7ae4-45e9-af9c-78b3e03e313e tempest-ProjectReaderTests-307687838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (486616e7-3fa2-41ba-af6a-39ff9365a017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:39:30 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e6f51e0d-7ae4-45e9-af9c-78b3e03e313e tempest-ProjectReaderTests-307687838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (486616e7-3fa2-41ba-af6a-39ff9365a017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:39:30 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e6f51e0d-7ae4-45e9-af9c-78b3e03e313e tempest-ProjectReaderTests-307687838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe52fac9-192e-4db8-9250-c39d4b2ea5ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:39:30 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-e6f51e0d-7ae4-45e9-af9c-78b3e03e313e tempest-ProjectReaderTests-307687838 None] Volume 5ddda5bd-0831-45e1-986e-27db412c3c7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ddda5bd-0831-45e1-986e-27db412c3c7c', 'volume_size': 1} Sep 28 09:39:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-e6f51e0d-7ae4-45e9-af9c-78b3e03e313e tempest-ProjectReaderTests-307687838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:39:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-e6f51e0d-7ae4-45e9-af9c-78b3e03e313e tempest-ProjectReaderTests-307687838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:39:30 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-e6f51e0d-7ae4-45e9-af9c-78b3e03e313e tempest-ProjectReaderTests-307687838 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:39:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1962072063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ddda5bd-0831-45e1-986e-27db412c3c7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5214755575f24066b6f63bb25f37d933',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:39:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:39:31Z,use_quota=True,user_id='bb25e93d58c747fe86fa714c976da8c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:39:30 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-e6f51e0d-7ae4-45e9-af9c-78b3e03e313e tempest-ProjectReaderTests-307687838 None] Creating volume 5ddda5bd-0831-45e1-986e-27db412c3c7c {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:39:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-e6f51e0d-7ae4-45e9-af9c-78b3e03e313e tempest-ProjectReaderTests-307687838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:39:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-e6f51e0d-7ae4-45e9-af9c-78b3e03e313e tempest-ProjectReaderTests-307687838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:39:30 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-e6f51e0d-7ae4-45e9-af9c-78b3e03e313e tempest-ProjectReaderTests-307687838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:39:30 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-e6f51e0d-7ae4-45e9-af9c-78b3e03e313e tempest-ProjectReaderTests-307687838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:39:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-e6f51e0d-7ae4-45e9-af9c-78b3e03e313e tempest-ProjectReaderTests-307687838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:39:30 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-e6f51e0d-7ae4-45e9-af9c-78b3e03e313e tempest-ProjectReaderTests-307687838 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:39:30 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-e6f51e0d-7ae4-45e9-af9c-78b3e03e313e tempest-ProjectReaderTests-307687838 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:39:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e6f51e0d-7ae4-45e9-af9c-78b3e03e313e tempest-ProjectReaderTests-307687838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-5ddda5bd-0831-45e1-986e-27db412c3c7c 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:39:30 devstack sudo[105925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-5ddda5bd-0831-45e1-986e-27db412c3c7c 1073741824 Sep 28 09:39:30 devstack sudo[105925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:39:31 devstack sudo[105925]: pam_unix(sudo:session): session closed for user root Sep 28 09:39:31 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e6f51e0d-7ae4-45e9-af9c-78b3e03e313e tempest-ProjectReaderTests-307687838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-5ddda5bd-0831-45e1-986e-27db412c3c7c 1073741824" returned: 0 in 0.539s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:39:31 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e6f51e0d-7ae4-45e9-af9c-78b3e03e313e tempest-ProjectReaderTests-307687838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-5ddda5bd-0831-45e1-986e-27db412c3c7c {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:39:31 devstack sudo[105940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-5ddda5bd-0831-45e1-986e-27db412c3c7c Sep 28 09:39:31 devstack sudo[105940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:39:31 devstack sudo[105940]: pam_unix(sudo:session): session closed for user root Sep 28 09:39:31 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e6f51e0d-7ae4-45e9-af9c-78b3e03e313e tempest-ProjectReaderTests-307687838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-5ddda5bd-0831-45e1-986e-27db412c3c7c" returned: 0 in 0.280s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:39:31 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-e6f51e0d-7ae4-45e9-af9c-78b3e03e313e tempest-ProjectReaderTests-307687838 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:39:31 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-e6f51e0d-7ae4-45e9-af9c-78b3e03e313e tempest-ProjectReaderTests-307687838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:39:31 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e6f51e0d-7ae4-45e9-af9c-78b3e03e313e tempest-ProjectReaderTests-307687838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe52fac9-192e-4db8-9250-c39d4b2ea5ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ddda5bd-0831-45e1-986e-27db412c3c7c', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:39:31 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e6f51e0d-7ae4-45e9-af9c-78b3e03e313e tempest-ProjectReaderTests-307687838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0080fad0-3601-4af8-82a3-ddf4c150c8c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:39:31 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-e6f51e0d-7ae4-45e9-af9c-78b3e03e313e tempest-ProjectReaderTests-307687838 None] Volume volume-5ddda5bd-0831-45e1-986e-27db412c3c7c (5ddda5bd-0831-45e1-986e-27db412c3c7c): created successfully Sep 28 09:39:31 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e6f51e0d-7ae4-45e9-af9c-78b3e03e313e tempest-ProjectReaderTests-307687838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0080fad0-3601-4af8-82a3-ddf4c150c8c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:39:31 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e6f51e0d-7ae4-45e9-af9c-78b3e03e313e tempest-ProjectReaderTests-307687838 None] Flow 'volume_create_manager' (e00f80d4-57f5-496d-91bd-94c07397c247) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:39:31 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-b20602a1-d056-48be-9685-0be5f82a8871 req-a0f000c3-7d71-4c7d-8f68-ff978d8672eb tempest-TestStampPattern-708957854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:39:31 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-b20602a1-d056-48be-9685-0be5f82a8871 req-a0f000c3-7d71-4c7d-8f68-ff978d8672eb tempest-TestStampPattern-708957854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:39:31 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-e6f51e0d-7ae4-45e9-af9c-78b3e03e313e tempest-ProjectReaderTests-307687838 None] Created volume successfully. Sep 28 09:39:31 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [req-b20602a1-d056-48be-9685-0be5f82a8871 req-a0f000c3-7d71-4c7d-8f68-ff978d8672eb tempest-TestStampPattern-708957854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:39:31 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [req-b20602a1-d056-48be-9685-0be5f82a8871 req-a0f000c3-7d71-4c7d-8f68-ff978d8672eb tempest-TestStampPattern-708957854 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d', 'name': 'volume-34229eeb-2cb0-41f9-8e66-3059b7ab39eb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '167ecf9c-af65-4cbd-9536-ce20e9211e12', 'enforce_multipath': True} {{(pid=86553) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 09:39:31 devstack cinder-volume[86553]: INFO cinder.volume.manager [req-b20602a1-d056-48be-9685-0be5f82a8871 req-a0f000c3-7d71-4c7d-8f68-ff978d8672eb tempest-TestStampPattern-708957854 None] attachment_update completed successfully. Sep 28 09:39:32 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-e246fb21-b96b-4026-83e7-4de07c13f581 tempest-ProjectReaderTests-307687838 None] Acquiring lock "cinder-5ddda5bd-0831-45e1-986e-27db412c3c7c-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:39:32 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-e246fb21-b96b-4026-83e7-4de07c13f581 tempest-ProjectReaderTests-307687838 None] Lock "cinder-5ddda5bd-0831-45e1-986e-27db412c3c7c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:39:32 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-e246fb21-b96b-4026-83e7-4de07c13f581 tempest-ProjectReaderTests-307687838 None] Acquiring lock "cinder-quobyte-5ddda5bd-0831-45e1-986e-27db412c3c7c" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:39:32 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-e246fb21-b96b-4026-83e7-4de07c13f581 tempest-ProjectReaderTests-307687838 None] Lock "cinder-quobyte-5ddda5bd-0831-45e1-986e-27db412c3c7c" acquired by "delete_volume" :: waited 0.015s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:39:32 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[a132f784-2e0e-4f58-8ca3-4b63d1afbbf9]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:39:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e246fb21-b96b-4026-83e7-4de07c13f581 tempest-ProjectReaderTests-307687838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-5ddda5bd-0831-45e1-986e-27db412c3c7c {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:39:33 devstack sudo[106366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-5ddda5bd-0831-45e1-986e-27db412c3c7c Sep 28 09:39:33 devstack sudo[106366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:39:33 devstack sudo[106366]: pam_unix(sudo:session): session closed for user root Sep 28 09:39:33 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e246fb21-b96b-4026-83e7-4de07c13f581 tempest-ProjectReaderTests-307687838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-5ddda5bd-0831-45e1-986e-27db412c3c7c" returned: 0 in 0.364s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:39:33 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e246fb21-b96b-4026-83e7-4de07c13f581 tempest-ProjectReaderTests-307687838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-5ddda5bd-0831-45e1-986e-27db412c3c7c {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:39:33 devstack sudo[106371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-5ddda5bd-0831-45e1-986e-27db412c3c7c Sep 28 09:39:33 devstack sudo[106371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:39:33 devstack sudo[106371]: pam_unix(sudo:session): session closed for user root Sep 28 09:39:33 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e246fb21-b96b-4026-83e7-4de07c13f581 tempest-ProjectReaderTests-307687838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-5ddda5bd-0831-45e1-986e-27db412c3c7c" returned: 0 in 0.258s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:39:33 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-e246fb21-b96b-4026-83e7-4de07c13f581 tempest-ProjectReaderTests-307687838 None] Lock "cinder-quobyte-5ddda5bd-0831-45e1-986e-27db412c3c7c" released by "delete_volume" :: held 0.668s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:39:33 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-e246fb21-b96b-4026-83e7-4de07c13f581 tempest-ProjectReaderTests-307687838 None] Created reservations ['d2ce660b-19f1-427e-97e1-a6d76ef4164e', '61fb0499-e8c0-4e5a-a73c-4852adb0b4b2', '1cf74e24-59dc-4ea1-ad5c-7fa159a625cd', 'bb2ed829-8863-4484-9c98-9fe624e481b3'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:39:33 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-e246fb21-b96b-4026-83e7-4de07c13f581 tempest-ProjectReaderTests-307687838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:39:33 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-e246fb21-b96b-4026-83e7-4de07c13f581 tempest-ProjectReaderTests-307687838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:39:33 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-e246fb21-b96b-4026-83e7-4de07c13f581 tempest-ProjectReaderTests-307687838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:39:33 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-e246fb21-b96b-4026-83e7-4de07c13f581 tempest-ProjectReaderTests-307687838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:39:33 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-e246fb21-b96b-4026-83e7-4de07c13f581 tempest-ProjectReaderTests-307687838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:39:33 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e246fb21-b96b-4026-83e7-4de07c13f581 tempest-ProjectReaderTests-307687838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:39:33 devstack sudo[106376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:39:33 devstack sudo[106376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:39:33 devstack sudo[106376]: pam_unix(sudo:session): session closed for user root Sep 28 09:39:33 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e246fb21-b96b-4026-83e7-4de07c13f581 tempest-ProjectReaderTests-307687838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.264s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:39:33 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-e246fb21-b96b-4026-83e7-4de07c13f581 tempest-ProjectReaderTests-307687838 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:39:33 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-e246fb21-b96b-4026-83e7-4de07c13f581 tempest-ProjectReaderTests-307687838 None] Deleted volume successfully. Sep 28 09:39:33 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-e246fb21-b96b-4026-83e7-4de07c13f581 tempest-ProjectReaderTests-307687838 None] Lock "cinder-5ddda5bd-0831-45e1-986e-27db412c3c7c-delete_volume" released by "delete_volume" :: held 1.133s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:39:34 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-93447200-b64f-4bf7-b7c5-34c9e3528810 tempest-ProjectReaderTests-307687838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:39:34 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-93447200-b64f-4bf7-b7c5-34c9e3528810 tempest-ProjectReaderTests-307687838 None] Flow 'volume_create_manager' (01a421c3-0ca3-4a00-9eb0-76368a05875c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:39:34 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-93447200-b64f-4bf7-b7c5-34c9e3528810 tempest-ProjectReaderTests-307687838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f9c7751-4a4b-4c8f-9b2d-f80e1a500ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:39:34 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-93447200-b64f-4bf7-b7c5-34c9e3528810 tempest-ProjectReaderTests-307687838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f9c7751-4a4b-4c8f-9b2d-f80e1a500ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:39:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1225177222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5b7bc6c-b6b2-450c-8e3c-273ea7558569,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5214755575f24066b6f63bb25f37d933',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:39:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:39:34Z,use_quota=True,user_id='bb25e93d58c747fe86fa714c976da8c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:39:34 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-93447200-b64f-4bf7-b7c5-34c9e3528810 tempest-ProjectReaderTests-307687838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82146ed1-78c4-4071-a19a-5e482acedf3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:39:34 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-93447200-b64f-4bf7-b7c5-34c9e3528810 tempest-ProjectReaderTests-307687838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82146ed1-78c4-4071-a19a-5e482acedf3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:39:34 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-93447200-b64f-4bf7-b7c5-34c9e3528810 tempest-ProjectReaderTests-307687838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfa7f2ed-d2c5-4397-9584-46d9215fbb4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:39:34 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-93447200-b64f-4bf7-b7c5-34c9e3528810 tempest-ProjectReaderTests-307687838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfa7f2ed-d2c5-4397-9584-46d9215fbb4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5b7bc6c-b6b2-450c-8e3c-273ea7558569', 'volume_name': 'volume-b5b7bc6c-b6b2-450c-8e3c-273ea7558569', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:39:34 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-93447200-b64f-4bf7-b7c5-34c9e3528810 tempest-ProjectReaderTests-307687838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (626b28b5-14e0-4b02-83f5-854243243faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:39:34 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-93447200-b64f-4bf7-b7c5-34c9e3528810 tempest-ProjectReaderTests-307687838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (626b28b5-14e0-4b02-83f5-854243243faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:39:34 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-93447200-b64f-4bf7-b7c5-34c9e3528810 tempest-ProjectReaderTests-307687838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ceeb179-e874-44db-86b4-312e377d9bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:39:34 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-93447200-b64f-4bf7-b7c5-34c9e3528810 tempest-ProjectReaderTests-307687838 None] Volume b5b7bc6c-b6b2-450c-8e3c-273ea7558569: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5b7bc6c-b6b2-450c-8e3c-273ea7558569', 'volume_size': 1} Sep 28 09:39:34 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-93447200-b64f-4bf7-b7c5-34c9e3528810 tempest-ProjectReaderTests-307687838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:39:34 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-93447200-b64f-4bf7-b7c5-34c9e3528810 tempest-ProjectReaderTests-307687838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:39:34 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-93447200-b64f-4bf7-b7c5-34c9e3528810 tempest-ProjectReaderTests-307687838 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:39:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1225177222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5b7bc6c-b6b2-450c-8e3c-273ea7558569,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5214755575f24066b6f63bb25f37d933',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:39:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:39:34Z,use_quota=True,user_id='bb25e93d58c747fe86fa714c976da8c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:39:34 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-93447200-b64f-4bf7-b7c5-34c9e3528810 tempest-ProjectReaderTests-307687838 None] Creating volume b5b7bc6c-b6b2-450c-8e3c-273ea7558569 {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:39:34 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-93447200-b64f-4bf7-b7c5-34c9e3528810 tempest-ProjectReaderTests-307687838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:39:34 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-93447200-b64f-4bf7-b7c5-34c9e3528810 tempest-ProjectReaderTests-307687838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:39:34 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-93447200-b64f-4bf7-b7c5-34c9e3528810 tempest-ProjectReaderTests-307687838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:39:34 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-93447200-b64f-4bf7-b7c5-34c9e3528810 tempest-ProjectReaderTests-307687838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:39:34 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-93447200-b64f-4bf7-b7c5-34c9e3528810 tempest-ProjectReaderTests-307687838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:39:34 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-93447200-b64f-4bf7-b7c5-34c9e3528810 tempest-ProjectReaderTests-307687838 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:39:34 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-93447200-b64f-4bf7-b7c5-34c9e3528810 tempest-ProjectReaderTests-307687838 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:39:34 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-93447200-b64f-4bf7-b7c5-34c9e3528810 tempest-ProjectReaderTests-307687838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b5b7bc6c-b6b2-450c-8e3c-273ea7558569 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:39:34 devstack sudo[106393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b5b7bc6c-b6b2-450c-8e3c-273ea7558569 1073741824 Sep 28 09:39:34 devstack sudo[106393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:39:35 devstack sudo[106393]: pam_unix(sudo:session): session closed for user root Sep 28 09:39:35 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-93447200-b64f-4bf7-b7c5-34c9e3528810 tempest-ProjectReaderTests-307687838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b5b7bc6c-b6b2-450c-8e3c-273ea7558569 1073741824" returned: 0 in 0.492s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:39:35 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-93447200-b64f-4bf7-b7c5-34c9e3528810 tempest-ProjectReaderTests-307687838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b5b7bc6c-b6b2-450c-8e3c-273ea7558569 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:39:35 devstack sudo[106400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b5b7bc6c-b6b2-450c-8e3c-273ea7558569 Sep 28 09:39:35 devstack sudo[106400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:39:35 devstack sudo[106400]: pam_unix(sudo:session): session closed for user root Sep 28 09:39:35 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-93447200-b64f-4bf7-b7c5-34c9e3528810 tempest-ProjectReaderTests-307687838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b5b7bc6c-b6b2-450c-8e3c-273ea7558569" returned: 0 in 0.277s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:39:35 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-93447200-b64f-4bf7-b7c5-34c9e3528810 tempest-ProjectReaderTests-307687838 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:39:35 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-93447200-b64f-4bf7-b7c5-34c9e3528810 tempest-ProjectReaderTests-307687838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:39:35 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-93447200-b64f-4bf7-b7c5-34c9e3528810 tempest-ProjectReaderTests-307687838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ceeb179-e874-44db-86b4-312e377d9bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5b7bc6c-b6b2-450c-8e3c-273ea7558569', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:39:35 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-93447200-b64f-4bf7-b7c5-34c9e3528810 tempest-ProjectReaderTests-307687838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2df77c0a-e63a-4e54-b576-6627aa938a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:39:35 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-93447200-b64f-4bf7-b7c5-34c9e3528810 tempest-ProjectReaderTests-307687838 None] Volume volume-b5b7bc6c-b6b2-450c-8e3c-273ea7558569 (b5b7bc6c-b6b2-450c-8e3c-273ea7558569): created successfully Sep 28 09:39:35 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-93447200-b64f-4bf7-b7c5-34c9e3528810 tempest-ProjectReaderTests-307687838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2df77c0a-e63a-4e54-b576-6627aa938a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:39:35 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-93447200-b64f-4bf7-b7c5-34c9e3528810 tempest-ProjectReaderTests-307687838 None] Flow 'volume_create_manager' (01a421c3-0ca3-4a00-9eb0-76368a05875c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:39:35 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-93447200-b64f-4bf7-b7c5-34c9e3528810 tempest-ProjectReaderTests-307687838 None] Created volume successfully. Sep 28 09:39:35 devstack cinder-volume[86553]: INFO cinder.volume.manager [req-0dce908d-22b8-4d8c-b51c-0332988539b3 req-e4c49bfc-7d39-45e4-8fd2-68c9584b2ff3 tempest-TestStampPattern-708957854 None] Terminate volume connection completed successfully. Sep 28 09:39:35 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [req-0dce908d-22b8-4d8c-b51c-0332988539b3 req-e4c49bfc-7d39-45e4-8fd2-68c9584b2ff3 tempest-TestStampPattern-708957854 None] Deleting attachment 167ecf9c-af65-4cbd-9536-ce20e9211e12. {{(pid=86553) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 09:39:36 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-dfc6075c-9e98-4654-bda8-587a71795d0b tempest-ProjectReaderTests-307687838 None] Acquiring lock "cinder-b5b7bc6c-b6b2-450c-8e3c-273ea7558569-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:39:36 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-dfc6075c-9e98-4654-bda8-587a71795d0b tempest-ProjectReaderTests-307687838 None] Lock "cinder-b5b7bc6c-b6b2-450c-8e3c-273ea7558569-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:39:36 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-dfc6075c-9e98-4654-bda8-587a71795d0b tempest-ProjectReaderTests-307687838 None] Acquiring lock "cinder-quobyte-b5b7bc6c-b6b2-450c-8e3c-273ea7558569" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:39:36 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-dfc6075c-9e98-4654-bda8-587a71795d0b tempest-ProjectReaderTests-307687838 None] Lock "cinder-quobyte-b5b7bc6c-b6b2-450c-8e3c-273ea7558569" acquired by "delete_volume" :: waited 0.034s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:39:36 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f599b8a-3a61-4f68-9934-588ad8025101]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:39:36 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-dfc6075c-9e98-4654-bda8-587a71795d0b tempest-ProjectReaderTests-307687838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b5b7bc6c-b6b2-450c-8e3c-273ea7558569 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:39:37 devstack sudo[106435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b5b7bc6c-b6b2-450c-8e3c-273ea7558569 Sep 28 09:39:37 devstack sudo[106435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:39:37 devstack sudo[106435]: pam_unix(sudo:session): session closed for user root Sep 28 09:39:37 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-dfc6075c-9e98-4654-bda8-587a71795d0b tempest-ProjectReaderTests-307687838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b5b7bc6c-b6b2-450c-8e3c-273ea7558569" returned: 0 in 0.532s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:39:37 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-dfc6075c-9e98-4654-bda8-587a71795d0b tempest-ProjectReaderTests-307687838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b5b7bc6c-b6b2-450c-8e3c-273ea7558569 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:39:37 devstack sudo[106447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b5b7bc6c-b6b2-450c-8e3c-273ea7558569 Sep 28 09:39:37 devstack sudo[106447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:39:37 devstack sudo[106447]: pam_unix(sudo:session): session closed for user root Sep 28 09:39:37 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-dfc6075c-9e98-4654-bda8-587a71795d0b tempest-ProjectReaderTests-307687838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b5b7bc6c-b6b2-450c-8e3c-273ea7558569" returned: 0 in 0.313s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:39:37 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-dfc6075c-9e98-4654-bda8-587a71795d0b tempest-ProjectReaderTests-307687838 None] Lock "cinder-quobyte-b5b7bc6c-b6b2-450c-8e3c-273ea7558569" released by "delete_volume" :: held 0.953s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:39:37 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-dfc6075c-9e98-4654-bda8-587a71795d0b tempest-ProjectReaderTests-307687838 None] Created reservations ['fabda6e4-0ee7-48a5-930f-f271e16226d7', '664a328c-a273-4b72-9db0-76e9c7de4591', '0e6e53c1-70be-42f3-a44d-97e46356e1ca', 'c92a15b3-edc0-4ac2-a52c-d8aa45d452e2'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:39:37 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-dfc6075c-9e98-4654-bda8-587a71795d0b tempest-ProjectReaderTests-307687838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:39:37 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-dfc6075c-9e98-4654-bda8-587a71795d0b tempest-ProjectReaderTests-307687838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:39:37 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-dfc6075c-9e98-4654-bda8-587a71795d0b tempest-ProjectReaderTests-307687838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:39:37 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-dfc6075c-9e98-4654-bda8-587a71795d0b tempest-ProjectReaderTests-307687838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:39:37 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-dfc6075c-9e98-4654-bda8-587a71795d0b tempest-ProjectReaderTests-307687838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:39:37 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-dfc6075c-9e98-4654-bda8-587a71795d0b tempest-ProjectReaderTests-307687838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:39:38 devstack sudo[106469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:39:38 devstack sudo[106469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:39:38 devstack sudo[106469]: pam_unix(sudo:session): session closed for user root Sep 28 09:39:38 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-dfc6075c-9e98-4654-bda8-587a71795d0b tempest-ProjectReaderTests-307687838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.280s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:39:38 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-dfc6075c-9e98-4654-bda8-587a71795d0b tempest-ProjectReaderTests-307687838 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:39:38 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-dfc6075c-9e98-4654-bda8-587a71795d0b tempest-ProjectReaderTests-307687838 None] Deleted volume successfully. Sep 28 09:39:38 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-dfc6075c-9e98-4654-bda8-587a71795d0b tempest-ProjectReaderTests-307687838 None] Lock "cinder-b5b7bc6c-b6b2-450c-8e3c-273ea7558569-delete_volume" released by "delete_volume" :: held 1.544s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:39:39 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-9ae74f80-f57c-4b90-9e35-6b7632698a5a tempest-TestStampPattern-708957854 None] Acquiring lock "cinder-34229eeb-2cb0-41f9-8e66-3059b7ab39eb-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:39:39 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-9ae74f80-f57c-4b90-9e35-6b7632698a5a tempest-TestStampPattern-708957854 None] Lock "cinder-34229eeb-2cb0-41f9-8e66-3059b7ab39eb-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:39:39 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-9ae74f80-f57c-4b90-9e35-6b7632698a5a tempest-TestStampPattern-708957854 None] Acquiring lock "cinder-quobyte-34229eeb-2cb0-41f9-8e66-3059b7ab39eb" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:39:39 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-9ae74f80-f57c-4b90-9e35-6b7632698a5a tempest-TestStampPattern-708957854 None] Lock "cinder-quobyte-34229eeb-2cb0-41f9-8e66-3059b7ab39eb" acquired by "delete_volume" :: waited 0.015s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:39:39 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2fa8ac7-b648-4992-8d19-cc083feab9f1]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:39:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-9ae74f80-f57c-4b90-9e35-6b7632698a5a tempest-TestStampPattern-708957854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-34229eeb-2cb0-41f9-8e66-3059b7ab39eb {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:39:40 devstack sudo[106475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-34229eeb-2cb0-41f9-8e66-3059b7ab39eb Sep 28 09:39:40 devstack sudo[106475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:39:40 devstack sudo[106475]: pam_unix(sudo:session): session closed for user root Sep 28 09:39:40 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-9ae74f80-f57c-4b90-9e35-6b7632698a5a tempest-TestStampPattern-708957854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-34229eeb-2cb0-41f9-8e66-3059b7ab39eb" returned: 0 in 0.436s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:39:40 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-9ae74f80-f57c-4b90-9e35-6b7632698a5a tempest-TestStampPattern-708957854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-34229eeb-2cb0-41f9-8e66-3059b7ab39eb {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:39:40 devstack sudo[106480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-34229eeb-2cb0-41f9-8e66-3059b7ab39eb Sep 28 09:39:40 devstack sudo[106480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:39:40 devstack sudo[106480]: pam_unix(sudo:session): session closed for user root Sep 28 09:39:40 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-9ae74f80-f57c-4b90-9e35-6b7632698a5a tempest-TestStampPattern-708957854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-34229eeb-2cb0-41f9-8e66-3059b7ab39eb" returned: 0 in 0.285s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:39:40 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-9ae74f80-f57c-4b90-9e35-6b7632698a5a tempest-TestStampPattern-708957854 None] Lock "cinder-quobyte-34229eeb-2cb0-41f9-8e66-3059b7ab39eb" released by "delete_volume" :: held 0.774s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:39:40 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-9ae74f80-f57c-4b90-9e35-6b7632698a5a tempest-TestStampPattern-708957854 None] Created reservations ['9ffde68f-8a86-4f39-8693-727a21c9affa', 'bf9d9736-3b55-4006-a318-53b3cbf97489', 'b2597422-ec85-470f-ac97-f73926077514', '77b510e5-cf1e-4e1e-a0ab-0351328004de'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:39:40 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-9ae74f80-f57c-4b90-9e35-6b7632698a5a tempest-TestStampPattern-708957854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:39:40 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-9ae74f80-f57c-4b90-9e35-6b7632698a5a tempest-TestStampPattern-708957854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:39:40 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-9ae74f80-f57c-4b90-9e35-6b7632698a5a tempest-TestStampPattern-708957854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:39:40 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-9ae74f80-f57c-4b90-9e35-6b7632698a5a tempest-TestStampPattern-708957854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:39:40 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-9ae74f80-f57c-4b90-9e35-6b7632698a5a tempest-TestStampPattern-708957854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:39:40 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-9ae74f80-f57c-4b90-9e35-6b7632698a5a tempest-TestStampPattern-708957854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:39:40 devstack sudo[106483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:39:40 devstack sudo[106483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:39:40 devstack sudo[106483]: pam_unix(sudo:session): session closed for user root Sep 28 09:39:40 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-9ae74f80-f57c-4b90-9e35-6b7632698a5a tempest-TestStampPattern-708957854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.260s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:39:40 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-9ae74f80-f57c-4b90-9e35-6b7632698a5a tempest-TestStampPattern-708957854 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:39:40 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-9ae74f80-f57c-4b90-9e35-6b7632698a5a tempest-TestStampPattern-708957854 None] Deleted volume successfully. Sep 28 09:39:41 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-9ae74f80-f57c-4b90-9e35-6b7632698a5a tempest-TestStampPattern-708957854 None] Lock "cinder-34229eeb-2cb0-41f9-8e66-3059b7ab39eb-delete_volume" released by "delete_volume" :: held 1.220s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:39:41 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-493eb471-c444-4516-870a-370180519115 tempest-TestStampPattern-708957854 None] Acquiring lock "cinder-1029b85b-8cdd-41df-be71-5eb500190aee-delete_snapshot" by "delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:39:41 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-493eb471-c444-4516-870a-370180519115 tempest-TestStampPattern-708957854 None] Lock "cinder-1029b85b-8cdd-41df-be71-5eb500190aee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:39:41 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-493eb471-c444-4516-870a-370180519115 tempest-TestStampPattern-708957854 None] Acquiring lock "cinder-quobyte-f8848ae3-33f7-4d6a-98ec-13d3d4d35dbd" by "delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:39:41 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-493eb471-c444-4516-870a-370180519115 tempest-TestStampPattern-708957854 None] Lock "cinder-quobyte-f8848ae3-33f7-4d6a-98ec-13d3d4d35dbd" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:39:41 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-493eb471-c444-4516-870a-370180519115 tempest-TestStampPattern-708957854 None] Acquiring lock "cinder-quobyte-1029b85b-8cdd-41df-be71-5eb500190aee" by "_delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:39:41 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-493eb471-c444-4516-870a-370180519115 tempest-TestStampPattern-708957854 None] Lock "cinder-quobyte-1029b85b-8cdd-41df-be71-5eb500190aee" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:39:41 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-493eb471-c444-4516-870a-370180519115 tempest-TestStampPattern-708957854 None] Deleting offline snapshot 1029b85b-8cdd-41df-be71-5eb500190aee of volume f8848ae3-33f7-4d6a-98ec-13d3d4d35dbd {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 09:39:41 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-493eb471-c444-4516-870a-370180519115 tempest-TestStampPattern-708957854 None] snapshot_file for this snap is: volume-f8848ae3-33f7-4d6a-98ec-13d3d4d35dbd.1029b85b-8cdd-41df-be71-5eb500190aee {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 09:39:41 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b3ec32-fe10-4a0f-9070-2dad232baf83]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:39:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-493eb471-c444-4516-870a-370180519115 tempest-TestStampPattern-708957854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f8848ae3-33f7-4d6a-98ec-13d3d4d35dbd.1029b85b-8cdd-41df-be71-5eb500190aee {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:39:41 devstack sudo[106486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f8848ae3-33f7-4d6a-98ec-13d3d4d35dbd.1029b85b-8cdd-41df-be71-5eb500190aee Sep 28 09:39:41 devstack sudo[106486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:39:41 devstack sudo[106486]: pam_unix(sudo:session): session closed for user root Sep 28 09:39:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-493eb471-c444-4516-870a-370180519115 tempest-TestStampPattern-708957854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f8848ae3-33f7-4d6a-98ec-13d3d4d35dbd.1029b85b-8cdd-41df-be71-5eb500190aee" returned: 0 in 0.361s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:39:41 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-493eb471-c444-4516-870a-370180519115 tempest-TestStampPattern-708957854 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8848ae3-33f7-4d6a-98ec-13d3d4d35dbd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86553) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 09:39:41 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d3abba-fb9c-4196-b535-2bd60b04b280]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:39:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-493eb471-c444-4516-870a-370180519115 tempest-TestStampPattern-708957854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f8848ae3-33f7-4d6a-98ec-13d3d4d35dbd {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:39:41 devstack sudo[106491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f8848ae3-33f7-4d6a-98ec-13d3d4d35dbd Sep 28 09:39:41 devstack sudo[106491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:39:42 devstack sudo[106491]: pam_unix(sudo:session): session closed for user root Sep 28 09:39:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-493eb471-c444-4516-870a-370180519115 tempest-TestStampPattern-708957854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f8848ae3-33f7-4d6a-98ec-13d3d4d35dbd" returned: 0 in 0.524s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:39:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-493eb471-c444-4516-870a-370180519115 tempest-TestStampPattern-708957854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f8848ae3-33f7-4d6a-98ec-13d3d4d35dbd.1029b85b-8cdd-41df-be71-5eb500190aee {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:39:42 devstack sudo[106496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f8848ae3-33f7-4d6a-98ec-13d3d4d35dbd.1029b85b-8cdd-41df-be71-5eb500190aee Sep 28 09:39:42 devstack sudo[106496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:39:42 devstack sudo[106496]: pam_unix(sudo:session): session closed for user root Sep 28 09:39:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-493eb471-c444-4516-870a-370180519115 tempest-TestStampPattern-708957854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f8848ae3-33f7-4d6a-98ec-13d3d4d35dbd.1029b85b-8cdd-41df-be71-5eb500190aee" returned: 0 in 0.327s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:39:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-493eb471-c444-4516-870a-370180519115 tempest-TestStampPattern-708957854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f8848ae3-33f7-4d6a-98ec-13d3d4d35dbd.1029b85b-8cdd-41df-be71-5eb500190aee {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:39:42 devstack sudo[106501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f8848ae3-33f7-4d6a-98ec-13d3d4d35dbd.1029b85b-8cdd-41df-be71-5eb500190aee Sep 28 09:39:42 devstack sudo[106501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:39:42 devstack sudo[106501]: pam_unix(sudo:session): session closed for user root Sep 28 09:39:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-493eb471-c444-4516-870a-370180519115 tempest-TestStampPattern-708957854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f8848ae3-33f7-4d6a-98ec-13d3d4d35dbd.1029b85b-8cdd-41df-be71-5eb500190aee" returned: 0 in 0.248s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:39:42 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-493eb471-c444-4516-870a-370180519115 tempest-TestStampPattern-708957854 None] Lock "cinder-quobyte-1029b85b-8cdd-41df-be71-5eb500190aee" released by "_delete_snapshot" :: held 1.558s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:39:42 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-493eb471-c444-4516-870a-370180519115 tempest-TestStampPattern-708957854 None] Lock "cinder-quobyte-f8848ae3-33f7-4d6a-98ec-13d3d4d35dbd" released by "delete_snapshot" :: held 1.582s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:39:42 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-493eb471-c444-4516-870a-370180519115 tempest-TestStampPattern-708957854 None] Created reservations ['a3897685-fcd9-49f4-9a70-9e9817469e24', 'b8c8ac3c-73be-48d3-a9fd-8b1902366740', 'e25b40fa-60a9-40cd-a0d1-f22f4ca55684', 'ef118463-a25a-48ea-9f9e-8d197f1ad878'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:39:42 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-493eb471-c444-4516-870a-370180519115 tempest-TestStampPattern-708957854 None] Delete snapshot completed successfully. Sep 28 09:39:42 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-493eb471-c444-4516-870a-370180519115 tempest-TestStampPattern-708957854 None] Lock "cinder-1029b85b-8cdd-41df-be71-5eb500190aee-delete_snapshot" released by "delete_snapshot" :: held 1.713s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:39:46 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-4e99e01f-5c6c-4572-9c16-48018e98ddd9 tempest-TestStampPattern-708957854 None] Acquiring lock "cinder-f8848ae3-33f7-4d6a-98ec-13d3d4d35dbd-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:39:46 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-4e99e01f-5c6c-4572-9c16-48018e98ddd9 tempest-TestStampPattern-708957854 None] Lock "cinder-f8848ae3-33f7-4d6a-98ec-13d3d4d35dbd-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:39:46 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-4e99e01f-5c6c-4572-9c16-48018e98ddd9 tempest-TestStampPattern-708957854 None] Acquiring lock "cinder-quobyte-f8848ae3-33f7-4d6a-98ec-13d3d4d35dbd" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:39:46 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-4e99e01f-5c6c-4572-9c16-48018e98ddd9 tempest-TestStampPattern-708957854 None] Lock "cinder-quobyte-f8848ae3-33f7-4d6a-98ec-13d3d4d35dbd" acquired by "delete_volume" :: waited 0.014s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:39:46 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[907a8a1b-6e0a-4edc-849e-ff5f8cadbcb5]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:39:46 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-4e99e01f-5c6c-4572-9c16-48018e98ddd9 tempest-TestStampPattern-708957854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f8848ae3-33f7-4d6a-98ec-13d3d4d35dbd {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:39:47 devstack sudo[106535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f8848ae3-33f7-4d6a-98ec-13d3d4d35dbd Sep 28 09:39:47 devstack sudo[106535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:39:47 devstack sudo[106535]: pam_unix(sudo:session): session closed for user root Sep 28 09:39:47 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-4e99e01f-5c6c-4572-9c16-48018e98ddd9 tempest-TestStampPattern-708957854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f8848ae3-33f7-4d6a-98ec-13d3d4d35dbd" returned: 0 in 0.372s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:39:47 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-4e99e01f-5c6c-4572-9c16-48018e98ddd9 tempest-TestStampPattern-708957854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f8848ae3-33f7-4d6a-98ec-13d3d4d35dbd {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:39:47 devstack sudo[106540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f8848ae3-33f7-4d6a-98ec-13d3d4d35dbd Sep 28 09:39:47 devstack sudo[106540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:39:47 devstack sudo[106540]: pam_unix(sudo:session): session closed for user root Sep 28 09:39:47 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-4e99e01f-5c6c-4572-9c16-48018e98ddd9 tempest-TestStampPattern-708957854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f8848ae3-33f7-4d6a-98ec-13d3d4d35dbd" returned: 0 in 0.250s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:39:47 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-4e99e01f-5c6c-4572-9c16-48018e98ddd9 tempest-TestStampPattern-708957854 None] Lock "cinder-quobyte-f8848ae3-33f7-4d6a-98ec-13d3d4d35dbd" released by "delete_volume" :: held 0.681s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:39:47 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-4e99e01f-5c6c-4572-9c16-48018e98ddd9 tempest-TestStampPattern-708957854 None] Created reservations ['24f8e3bb-9d3e-4b01-b0e4-ef2ec03cb80b', '3332d956-dcd1-4cee-8ffd-0e4040b61703', 'a2d28384-0530-4971-ab50-8f8a7808e431', '3cfc76bd-3da8-4994-bf99-bc9834deba68'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:39:47 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-4e99e01f-5c6c-4572-9c16-48018e98ddd9 tempest-TestStampPattern-708957854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:39:47 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-4e99e01f-5c6c-4572-9c16-48018e98ddd9 tempest-TestStampPattern-708957854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:39:47 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-4e99e01f-5c6c-4572-9c16-48018e98ddd9 tempest-TestStampPattern-708957854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:39:47 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-4e99e01f-5c6c-4572-9c16-48018e98ddd9 tempest-TestStampPattern-708957854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:39:47 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-4e99e01f-5c6c-4572-9c16-48018e98ddd9 tempest-TestStampPattern-708957854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:39:47 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-4e99e01f-5c6c-4572-9c16-48018e98ddd9 tempest-TestStampPattern-708957854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:39:47 devstack sudo[106543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:39:47 devstack sudo[106543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:39:47 devstack sudo[106543]: pam_unix(sudo:session): session closed for user root Sep 28 09:39:47 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-4e99e01f-5c6c-4572-9c16-48018e98ddd9 tempest-TestStampPattern-708957854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.237s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:39:47 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-4e99e01f-5c6c-4572-9c16-48018e98ddd9 tempest-TestStampPattern-708957854 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:39:47 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-4e99e01f-5c6c-4572-9c16-48018e98ddd9 tempest-TestStampPattern-708957854 None] Deleted volume successfully. Sep 28 09:39:47 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-4e99e01f-5c6c-4572-9c16-48018e98ddd9 tempest-TestStampPattern-708957854 None] Lock "cinder-f8848ae3-33f7-4d6a-98ec-13d3d4d35dbd-delete_volume" released by "delete_volume" :: held 1.107s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:39:57 devstack cinder-volume[86553]: DEBUG dbcounter [-] [86553] Writing DB stats cinder:SELECT=49,cinder:INSERT=18,cinder:UPDATE=71,cinder:DELETE=3 {{(pid=86553) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 09:39:57 devstack cinder-volume[86553]: DEBUG dbcounter [-] [86553] Writing DB stats cinder:SELECT=53,cinder:UPDATE=63,cinder:DELETE=7,cinder:INSERT=14 {{(pid=86553) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 09:40:08 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-45977491-3d50-4021-b17c-3ae88db110c9 tempest-VolumeDependencyTests-227757527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:40:08 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-45977491-3d50-4021-b17c-3ae88db110c9 tempest-VolumeDependencyTests-227757527 None] Flow 'volume_create_manager' (4396581f-b1f1-44fa-8bcf-5d576d8bc83b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:40:08 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-45977491-3d50-4021-b17c-3ae88db110c9 tempest-VolumeDependencyTests-227757527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eed0d418-06c1-4234-8ba7-b8ff43093d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:08 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-45977491-3d50-4021-b17c-3ae88db110c9 tempest-VolumeDependencyTests-227757527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eed0d418-06c1-4234-8ba7-b8ff43093d70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:40:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1901526193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c94b30a9-8c03-4988-806c-5d173f02cb9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8284c11562c04297924d501b3a8cf842',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:40:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:40:08Z,use_quota=True,user_id='fee80bcd04f54a19a5d0178f938343eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:08 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-45977491-3d50-4021-b17c-3ae88db110c9 tempest-VolumeDependencyTests-227757527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f97d9e0-e1c7-45d7-99e5-669aaef64e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:08 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-45977491-3d50-4021-b17c-3ae88db110c9 tempest-VolumeDependencyTests-227757527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f97d9e0-e1c7-45d7-99e5-669aaef64e34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:08 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-45977491-3d50-4021-b17c-3ae88db110c9 tempest-VolumeDependencyTests-227757527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e0a80d1-9f96-42cf-966d-c1b711683a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:08 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-45977491-3d50-4021-b17c-3ae88db110c9 tempest-VolumeDependencyTests-227757527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e0a80d1-9f96-42cf-966d-c1b711683a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c94b30a9-8c03-4988-806c-5d173f02cb9e', 'volume_name': 'volume-c94b30a9-8c03-4988-806c-5d173f02cb9e', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:08 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-45977491-3d50-4021-b17c-3ae88db110c9 tempest-VolumeDependencyTests-227757527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a932957-a6c3-4b87-9cc7-d2f0dd3c03ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:08 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-45977491-3d50-4021-b17c-3ae88db110c9 tempest-VolumeDependencyTests-227757527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a932957-a6c3-4b87-9cc7-d2f0dd3c03ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:08 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-45977491-3d50-4021-b17c-3ae88db110c9 tempest-VolumeDependencyTests-227757527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ab40d4c-219f-4f74-9488-0b0a1c469248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:08 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-45977491-3d50-4021-b17c-3ae88db110c9 tempest-VolumeDependencyTests-227757527 None] Volume c94b30a9-8c03-4988-806c-5d173f02cb9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c94b30a9-8c03-4988-806c-5d173f02cb9e', 'volume_size': 1} Sep 28 09:40:08 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-45977491-3d50-4021-b17c-3ae88db110c9 tempest-VolumeDependencyTests-227757527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:40:08 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-45977491-3d50-4021-b17c-3ae88db110c9 tempest-VolumeDependencyTests-227757527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:40:08 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-45977491-3d50-4021-b17c-3ae88db110c9 tempest-VolumeDependencyTests-227757527 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:40:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1901526193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c94b30a9-8c03-4988-806c-5d173f02cb9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8284c11562c04297924d501b3a8cf842',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:40:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:40:08Z,use_quota=True,user_id='fee80bcd04f54a19a5d0178f938343eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:40:08 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-45977491-3d50-4021-b17c-3ae88db110c9 tempest-VolumeDependencyTests-227757527 None] Creating volume c94b30a9-8c03-4988-806c-5d173f02cb9e {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:40:08 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-45977491-3d50-4021-b17c-3ae88db110c9 tempest-VolumeDependencyTests-227757527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:40:08 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-45977491-3d50-4021-b17c-3ae88db110c9 tempest-VolumeDependencyTests-227757527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:40:08 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-45977491-3d50-4021-b17c-3ae88db110c9 tempest-VolumeDependencyTests-227757527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:40:08 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-45977491-3d50-4021-b17c-3ae88db110c9 tempest-VolumeDependencyTests-227757527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:40:08 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-45977491-3d50-4021-b17c-3ae88db110c9 tempest-VolumeDependencyTests-227757527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:40:08 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-45977491-3d50-4021-b17c-3ae88db110c9 tempest-VolumeDependencyTests-227757527 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:40:08 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-45977491-3d50-4021-b17c-3ae88db110c9 tempest-VolumeDependencyTests-227757527 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:40:08 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-45977491-3d50-4021-b17c-3ae88db110c9 tempest-VolumeDependencyTests-227757527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c94b30a9-8c03-4988-806c-5d173f02cb9e 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:08 devstack sudo[106592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c94b30a9-8c03-4988-806c-5d173f02cb9e 1073741824 Sep 28 09:40:08 devstack sudo[106592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:08 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac18bd94-da61-4a2c-88a6-b7b9d62955a3 tempest-CreateVolumesFromImageTest-299095373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:40:08 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ac18bd94-da61-4a2c-88a6-b7b9d62955a3 tempest-CreateVolumesFromImageTest-299095373 None] Flow 'volume_create_manager' (aa8265e6-76d7-486a-a8d4-2c850878c3a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:40:08 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ac18bd94-da61-4a2c-88a6-b7b9d62955a3 tempest-CreateVolumesFromImageTest-299095373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdc6ec1c-6c93-4c25-9eb6-531ceb39705e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:08 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ac18bd94-da61-4a2c-88a6-b7b9d62955a3 tempest-CreateVolumesFromImageTest-299095373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdc6ec1c-6c93-4c25-9eb6-531ceb39705e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:40:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1232557630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6848fe0-4faf-4a47-b4a8-76a998729c55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0be3a80f756a457aa049212c07360c37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:40:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:40:08Z,use_quota=True,user_id='f75a690d08b74a238312fac5743c358a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:08 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ac18bd94-da61-4a2c-88a6-b7b9d62955a3 tempest-CreateVolumesFromImageTest-299095373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78b44335-d228-4054-9370-091b494e2bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:08 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ac18bd94-da61-4a2c-88a6-b7b9d62955a3 tempest-CreateVolumesFromImageTest-299095373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78b44335-d228-4054-9370-091b494e2bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:08 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ac18bd94-da61-4a2c-88a6-b7b9d62955a3 tempest-CreateVolumesFromImageTest-299095373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66411eec-70d9-41c0-a42a-cdf50b0b7d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:08 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ac18bd94-da61-4a2c-88a6-b7b9d62955a3 tempest-CreateVolumesFromImageTest-299095373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66411eec-70d9-41c0-a42a-cdf50b0b7d60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6848fe0-4faf-4a47-b4a8-76a998729c55', 'volume_name': 'volume-c6848fe0-4faf-4a47-b4a8-76a998729c55', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:08 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ac18bd94-da61-4a2c-88a6-b7b9d62955a3 tempest-CreateVolumesFromImageTest-299095373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3570a47-d8d8-43ef-b134-5b3c17e46775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:08 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ac18bd94-da61-4a2c-88a6-b7b9d62955a3 tempest-CreateVolumesFromImageTest-299095373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3570a47-d8d8-43ef-b134-5b3c17e46775) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:08 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ac18bd94-da61-4a2c-88a6-b7b9d62955a3 tempest-CreateVolumesFromImageTest-299095373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7b2bc5c-1f72-4ea9-91bc-7237831e1469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:08 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-ac18bd94-da61-4a2c-88a6-b7b9d62955a3 tempest-CreateVolumesFromImageTest-299095373 None] Volume c6848fe0-4faf-4a47-b4a8-76a998729c55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6848fe0-4faf-4a47-b4a8-76a998729c55', 'volume_size': 1} Sep 28 09:40:08 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ac18bd94-da61-4a2c-88a6-b7b9d62955a3 tempest-CreateVolumesFromImageTest-299095373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:40:08 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-556dc626-842e-46ae-97e7-8b8c43ccdddd tempest-CreateVolumesFromImageTest-299095373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:40:08 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-556dc626-842e-46ae-97e7-8b8c43ccdddd tempest-CreateVolumesFromImageTest-299095373 None] Flow 'volume_create_manager' (87d226e3-81d1-4968-b9b2-d6ac570c42db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:40:08 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-556dc626-842e-46ae-97e7-8b8c43ccdddd tempest-CreateVolumesFromImageTest-299095373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef7ecea6-acec-40d1-8b44-3de61a2b34cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:08 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-556dc626-842e-46ae-97e7-8b8c43ccdddd tempest-CreateVolumesFromImageTest-299095373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef7ecea6-acec-40d1-8b44-3de61a2b34cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:40:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1143419399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03411c80-24d2-48cb-ba94-eee3f807554b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0be3a80f756a457aa049212c07360c37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:40:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:40:09Z,use_quota=True,user_id='f75a690d08b74a238312fac5743c358a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:08 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-556dc626-842e-46ae-97e7-8b8c43ccdddd tempest-CreateVolumesFromImageTest-299095373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89ea49e0-dc2f-4156-af36-1fed905fc069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:08 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-556dc626-842e-46ae-97e7-8b8c43ccdddd tempest-CreateVolumesFromImageTest-299095373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89ea49e0-dc2f-4156-af36-1fed905fc069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:08 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-556dc626-842e-46ae-97e7-8b8c43ccdddd tempest-CreateVolumesFromImageTest-299095373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2159f75-63d5-4fd0-9195-b662da1c2241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:08 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-556dc626-842e-46ae-97e7-8b8c43ccdddd tempest-CreateVolumesFromImageTest-299095373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2159f75-63d5-4fd0-9195-b662da1c2241) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03411c80-24d2-48cb-ba94-eee3f807554b', 'volume_name': 'volume-03411c80-24d2-48cb-ba94-eee3f807554b', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:08 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-556dc626-842e-46ae-97e7-8b8c43ccdddd tempest-CreateVolumesFromImageTest-299095373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (864c350c-609b-49ff-84fd-946d1bcb1b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:08 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-556dc626-842e-46ae-97e7-8b8c43ccdddd tempest-CreateVolumesFromImageTest-299095373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (864c350c-609b-49ff-84fd-946d1bcb1b7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:08 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-556dc626-842e-46ae-97e7-8b8c43ccdddd tempest-CreateVolumesFromImageTest-299095373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dc70956-ab87-4008-8d31-5067edab8460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:08 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-556dc626-842e-46ae-97e7-8b8c43ccdddd tempest-CreateVolumesFromImageTest-299095373 None] Volume 03411c80-24d2-48cb-ba94-eee3f807554b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03411c80-24d2-48cb-ba94-eee3f807554b', 'volume_size': 1} Sep 28 09:40:08 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-556dc626-842e-46ae-97e7-8b8c43ccdddd tempest-CreateVolumesFromImageTest-299095373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:40:09 devstack sudo[106592]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-45977491-3d50-4021-b17c-3ae88db110c9 tempest-VolumeDependencyTests-227757527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c94b30a9-8c03-4988-806c-5d173f02cb9e 1073741824" returned: 0 in 0.757s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-45977491-3d50-4021-b17c-3ae88db110c9 tempest-VolumeDependencyTests-227757527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c94b30a9-8c03-4988-806c-5d173f02cb9e {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:09 devstack sudo[106598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c94b30a9-8c03-4988-806c-5d173f02cb9e Sep 28 09:40:09 devstack sudo[106598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:09 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-720d94b4-8364-4c16-a6ec-68a9ffef3e50 tempest-CreateVolumesFromImageTest-299095373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:40:09 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-720d94b4-8364-4c16-a6ec-68a9ffef3e50 tempest-CreateVolumesFromImageTest-299095373 None] Flow 'volume_create_manager' (b57beacf-cbc4-4ae0-bccb-e7fd6be985cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:40:09 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-720d94b4-8364-4c16-a6ec-68a9ffef3e50 tempest-CreateVolumesFromImageTest-299095373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2213a9f7-fe85-414b-aba3-0a36688a4a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:09 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-720d94b4-8364-4c16-a6ec-68a9ffef3e50 tempest-CreateVolumesFromImageTest-299095373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2213a9f7-fe85-414b-aba3-0a36688a4a40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:40:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1439272075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=665842bf-0a2e-4e7c-b462-8a30061231a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0be3a80f756a457aa049212c07360c37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:40:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:40:09Z,use_quota=True,user_id='f75a690d08b74a238312fac5743c358a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:09 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-720d94b4-8364-4c16-a6ec-68a9ffef3e50 tempest-CreateVolumesFromImageTest-299095373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3b74621-545d-42f7-87c7-1497a2eb2702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:09 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-720d94b4-8364-4c16-a6ec-68a9ffef3e50 tempest-CreateVolumesFromImageTest-299095373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3b74621-545d-42f7-87c7-1497a2eb2702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:09 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-720d94b4-8364-4c16-a6ec-68a9ffef3e50 tempest-CreateVolumesFromImageTest-299095373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba59c21c-9be1-4371-b962-31eb480a86e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:09 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-720d94b4-8364-4c16-a6ec-68a9ffef3e50 tempest-CreateVolumesFromImageTest-299095373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba59c21c-9be1-4371-b962-31eb480a86e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '665842bf-0a2e-4e7c-b462-8a30061231a0', 'volume_name': 'volume-665842bf-0a2e-4e7c-b462-8a30061231a0', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:09 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-720d94b4-8364-4c16-a6ec-68a9ffef3e50 tempest-CreateVolumesFromImageTest-299095373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5228347-1dc8-4b3c-b8e9-b6619d9f921b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:09 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-720d94b4-8364-4c16-a6ec-68a9ffef3e50 tempest-CreateVolumesFromImageTest-299095373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5228347-1dc8-4b3c-b8e9-b6619d9f921b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:09 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-720d94b4-8364-4c16-a6ec-68a9ffef3e50 tempest-CreateVolumesFromImageTest-299095373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (001abc2a-8be9-4e6e-960c-496f637df52e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:09 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-720d94b4-8364-4c16-a6ec-68a9ffef3e50 tempest-CreateVolumesFromImageTest-299095373 None] Volume 665842bf-0a2e-4e7c-b462-8a30061231a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-665842bf-0a2e-4e7c-b462-8a30061231a0', 'volume_size': 1} Sep 28 09:40:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-720d94b4-8364-4c16-a6ec-68a9ffef3e50 tempest-CreateVolumesFromImageTest-299095373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:40:09 devstack sudo[106598]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-45977491-3d50-4021-b17c-3ae88db110c9 tempest-VolumeDependencyTests-227757527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c94b30a9-8c03-4988-806c-5d173f02cb9e" returned: 0 in 0.375s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:09 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-45977491-3d50-4021-b17c-3ae88db110c9 tempest-VolumeDependencyTests-227757527 None] <== create_volume: return (1218ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:40:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-45977491-3d50-4021-b17c-3ae88db110c9 tempest-VolumeDependencyTests-227757527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.220s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:40:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ac18bd94-da61-4a2c-88a6-b7b9d62955a3 tempest-CreateVolumesFromImageTest-299095373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.897s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:40:09 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ac18bd94-da61-4a2c-88a6-b7b9d62955a3 tempest-CreateVolumesFromImageTest-299095373 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:40:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1232557630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6848fe0-4faf-4a47-b4a8-76a998729c55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0be3a80f756a457aa049212c07360c37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:40:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:40:08Z,use_quota=True,user_id='f75a690d08b74a238312fac5743c358a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:40:09 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-ac18bd94-da61-4a2c-88a6-b7b9d62955a3 tempest-CreateVolumesFromImageTest-299095373 None] Creating volume c6848fe0-4faf-4a47-b4a8-76a998729c55 {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:40:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ac18bd94-da61-4a2c-88a6-b7b9d62955a3 tempest-CreateVolumesFromImageTest-299095373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:40:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ac18bd94-da61-4a2c-88a6-b7b9d62955a3 tempest-CreateVolumesFromImageTest-299095373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:40:09 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ac18bd94-da61-4a2c-88a6-b7b9d62955a3 tempest-CreateVolumesFromImageTest-299095373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:40:09 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ac18bd94-da61-4a2c-88a6-b7b9d62955a3 tempest-CreateVolumesFromImageTest-299095373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:40:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ac18bd94-da61-4a2c-88a6-b7b9d62955a3 tempest-CreateVolumesFromImageTest-299095373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:40:09 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ac18bd94-da61-4a2c-88a6-b7b9d62955a3 tempest-CreateVolumesFromImageTest-299095373 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:40:09 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-ac18bd94-da61-4a2c-88a6-b7b9d62955a3 tempest-CreateVolumesFromImageTest-299095373 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:40:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ac18bd94-da61-4a2c-88a6-b7b9d62955a3 tempest-CreateVolumesFromImageTest-299095373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c6848fe0-4faf-4a47-b4a8-76a998729c55 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:09 devstack sudo[106601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c6848fe0-4faf-4a47-b4a8-76a998729c55 1073741824 Sep 28 09:40:09 devstack sudo[106601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:09 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-45977491-3d50-4021-b17c-3ae88db110c9 tempest-VolumeDependencyTests-227757527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ab40d4c-219f-4f74-9488-0b0a1c469248) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c94b30a9-8c03-4988-806c-5d173f02cb9e', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:09 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-45977491-3d50-4021-b17c-3ae88db110c9 tempest-VolumeDependencyTests-227757527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c2f753b-8c39-4dba-8900-fad59ed1d2c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:09 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-45977491-3d50-4021-b17c-3ae88db110c9 tempest-VolumeDependencyTests-227757527 None] Volume volume-c94b30a9-8c03-4988-806c-5d173f02cb9e (c94b30a9-8c03-4988-806c-5d173f02cb9e): created successfully Sep 28 09:40:09 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-45977491-3d50-4021-b17c-3ae88db110c9 tempest-VolumeDependencyTests-227757527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c2f753b-8c39-4dba-8900-fad59ed1d2c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:09 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-45977491-3d50-4021-b17c-3ae88db110c9 tempest-VolumeDependencyTests-227757527 None] Flow 'volume_create_manager' (4396581f-b1f1-44fa-8bcf-5d576d8bc83b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:40:09 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-45977491-3d50-4021-b17c-3ae88db110c9 tempest-VolumeDependencyTests-227757527 None] Created volume successfully. Sep 28 09:40:09 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-71b66f19-f85f-495f-bfe0-25e3705ed702 tempest-CreateVolumesFromImageTest-299095373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:40:09 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-71b66f19-f85f-495f-bfe0-25e3705ed702 tempest-CreateVolumesFromImageTest-299095373 None] Flow 'volume_create_manager' (7e5060a5-c021-4ea3-b3df-25ee794bfcfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:40:09 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-71b66f19-f85f-495f-bfe0-25e3705ed702 tempest-CreateVolumesFromImageTest-299095373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc3281cb-fd76-46a3-aebb-7f0bf1cb8f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:10 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-71b66f19-f85f-495f-bfe0-25e3705ed702 tempest-CreateVolumesFromImageTest-299095373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc3281cb-fd76-46a3-aebb-7f0bf1cb8f07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:40:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1797001332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc4b4192-1af3-4daa-bb42-06e69053fa90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0be3a80f756a457aa049212c07360c37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:40:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:40:10Z,use_quota=True,user_id='f75a690d08b74a238312fac5743c358a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:10 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-71b66f19-f85f-495f-bfe0-25e3705ed702 tempest-CreateVolumesFromImageTest-299095373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83fc42f6-441b-4803-9430-add2eaa82cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:10 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-71b66f19-f85f-495f-bfe0-25e3705ed702 tempest-CreateVolumesFromImageTest-299095373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83fc42f6-441b-4803-9430-add2eaa82cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:10 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-71b66f19-f85f-495f-bfe0-25e3705ed702 tempest-CreateVolumesFromImageTest-299095373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e180d212-cec3-4788-bd70-c2bf975b3664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:10 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-71b66f19-f85f-495f-bfe0-25e3705ed702 tempest-CreateVolumesFromImageTest-299095373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e180d212-cec3-4788-bd70-c2bf975b3664) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc4b4192-1af3-4daa-bb42-06e69053fa90', 'volume_name': 'volume-dc4b4192-1af3-4daa-bb42-06e69053fa90', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:10 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-71b66f19-f85f-495f-bfe0-25e3705ed702 tempest-CreateVolumesFromImageTest-299095373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (033287e3-4960-4393-b5fb-8461fbe61625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:10 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-71b66f19-f85f-495f-bfe0-25e3705ed702 tempest-CreateVolumesFromImageTest-299095373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (033287e3-4960-4393-b5fb-8461fbe61625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:10 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-71b66f19-f85f-495f-bfe0-25e3705ed702 tempest-CreateVolumesFromImageTest-299095373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24b018fd-2f41-4ffd-bc95-92c59b4df784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:10 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-71b66f19-f85f-495f-bfe0-25e3705ed702 tempest-CreateVolumesFromImageTest-299095373 None] Volume dc4b4192-1af3-4daa-bb42-06e69053fa90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc4b4192-1af3-4daa-bb42-06e69053fa90', 'volume_size': 1} Sep 28 09:40:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-71b66f19-f85f-495f-bfe0-25e3705ed702 tempest-CreateVolumesFromImageTest-299095373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:40:10 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-604ced46-5b7e-4701-bd67-0437f21d7fe9 tempest-CreateVolumesFromImageTest-299095373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:40:10 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-604ced46-5b7e-4701-bd67-0437f21d7fe9 tempest-CreateVolumesFromImageTest-299095373 None] Flow 'volume_create_manager' (c29cddff-a8b7-4541-8db4-150fa3e4fc68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:40:10 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-604ced46-5b7e-4701-bd67-0437f21d7fe9 tempest-CreateVolumesFromImageTest-299095373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e000d403-4f70-49aa-9c3d-f12203a03bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:10 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-604ced46-5b7e-4701-bd67-0437f21d7fe9 tempest-CreateVolumesFromImageTest-299095373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e000d403-4f70-49aa-9c3d-f12203a03bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:40:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2042851659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7668aafc-f890-4880-b885-9391ab4ce59e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0be3a80f756a457aa049212c07360c37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:40:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:40:10Z,use_quota=True,user_id='f75a690d08b74a238312fac5743c358a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:10 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-604ced46-5b7e-4701-bd67-0437f21d7fe9 tempest-CreateVolumesFromImageTest-299095373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c4be5ce-afb4-4b54-8da3-e2288bc336a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:10 devstack sudo[106601]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:10 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-604ced46-5b7e-4701-bd67-0437f21d7fe9 tempest-CreateVolumesFromImageTest-299095373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c4be5ce-afb4-4b54-8da3-e2288bc336a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:10 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-604ced46-5b7e-4701-bd67-0437f21d7fe9 tempest-CreateVolumesFromImageTest-299095373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (412c2818-e9ce-472d-bc97-4290b6ccf333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:10 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-604ced46-5b7e-4701-bd67-0437f21d7fe9 tempest-CreateVolumesFromImageTest-299095373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (412c2818-e9ce-472d-bc97-4290b6ccf333) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7668aafc-f890-4880-b885-9391ab4ce59e', 'volume_name': 'volume-7668aafc-f890-4880-b885-9391ab4ce59e', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:10 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-604ced46-5b7e-4701-bd67-0437f21d7fe9 tempest-CreateVolumesFromImageTest-299095373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e6fc045-c97e-43be-833c-6780820efc2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:10 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-604ced46-5b7e-4701-bd67-0437f21d7fe9 tempest-CreateVolumesFromImageTest-299095373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e6fc045-c97e-43be-833c-6780820efc2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:10 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-604ced46-5b7e-4701-bd67-0437f21d7fe9 tempest-CreateVolumesFromImageTest-299095373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d016ad9-1ae5-451c-ad48-638bad6aa3ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:10 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-604ced46-5b7e-4701-bd67-0437f21d7fe9 tempest-CreateVolumesFromImageTest-299095373 None] Volume 7668aafc-f890-4880-b885-9391ab4ce59e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7668aafc-f890-4880-b885-9391ab4ce59e', 'volume_size': 1} Sep 28 09:40:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-604ced46-5b7e-4701-bd67-0437f21d7fe9 tempest-CreateVolumesFromImageTest-299095373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:40:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ac18bd94-da61-4a2c-88a6-b7b9d62955a3 tempest-CreateVolumesFromImageTest-299095373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c6848fe0-4faf-4a47-b4a8-76a998729c55 1073741824" returned: 0 in 0.771s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ac18bd94-da61-4a2c-88a6-b7b9d62955a3 tempest-CreateVolumesFromImageTest-299095373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c6848fe0-4faf-4a47-b4a8-76a998729c55 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:10 devstack sudo[106607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c6848fe0-4faf-4a47-b4a8-76a998729c55 Sep 28 09:40:10 devstack sudo[106607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-a1b56544-b078-453f-b8b6-3cce5696d06b tempest-VolumeDependencyTests-227757527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:40:10 devstack sudo[106607]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ac18bd94-da61-4a2c-88a6-b7b9d62955a3 tempest-CreateVolumesFromImageTest-299095373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c6848fe0-4faf-4a47-b4a8-76a998729c55" returned: 0 in 0.299s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:10 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ac18bd94-da61-4a2c-88a6-b7b9d62955a3 tempest-CreateVolumesFromImageTest-299095373 None] <== create_volume: return (1127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:40:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ac18bd94-da61-4a2c-88a6-b7b9d62955a3 tempest-CreateVolumesFromImageTest-299095373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:40:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-556dc626-842e-46ae-97e7-8b8c43ccdddd tempest-CreateVolumesFromImageTest-299095373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.867s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:40:10 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-556dc626-842e-46ae-97e7-8b8c43ccdddd tempest-CreateVolumesFromImageTest-299095373 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:40:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1143419399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03411c80-24d2-48cb-ba94-eee3f807554b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0be3a80f756a457aa049212c07360c37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:40:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:40:09Z,use_quota=True,user_id='f75a690d08b74a238312fac5743c358a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:40:10 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-556dc626-842e-46ae-97e7-8b8c43ccdddd tempest-CreateVolumesFromImageTest-299095373 None] Creating volume 03411c80-24d2-48cb-ba94-eee3f807554b {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:40:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-556dc626-842e-46ae-97e7-8b8c43ccdddd tempest-CreateVolumesFromImageTest-299095373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:40:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-556dc626-842e-46ae-97e7-8b8c43ccdddd tempest-CreateVolumesFromImageTest-299095373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:40:10 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-556dc626-842e-46ae-97e7-8b8c43ccdddd tempest-CreateVolumesFromImageTest-299095373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:40:10 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-556dc626-842e-46ae-97e7-8b8c43ccdddd tempest-CreateVolumesFromImageTest-299095373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:40:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-556dc626-842e-46ae-97e7-8b8c43ccdddd tempest-CreateVolumesFromImageTest-299095373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:40:10 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-556dc626-842e-46ae-97e7-8b8c43ccdddd tempest-CreateVolumesFromImageTest-299095373 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:40:10 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-556dc626-842e-46ae-97e7-8b8c43ccdddd tempest-CreateVolumesFromImageTest-299095373 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:40:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-556dc626-842e-46ae-97e7-8b8c43ccdddd tempest-CreateVolumesFromImageTest-299095373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-03411c80-24d2-48cb-ba94-eee3f807554b 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:10 devstack sudo[106610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-03411c80-24d2-48cb-ba94-eee3f807554b 1073741824 Sep 28 09:40:10 devstack sudo[106610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:10 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ac18bd94-da61-4a2c-88a6-b7b9d62955a3 tempest-CreateVolumesFromImageTest-299095373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7b2bc5c-1f72-4ea9-91bc-7237831e1469) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6848fe0-4faf-4a47-b4a8-76a998729c55', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:10 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ac18bd94-da61-4a2c-88a6-b7b9d62955a3 tempest-CreateVolumesFromImageTest-299095373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b6f065e-ce8a-49c3-b09e-4075d63d155d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:10 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-ac18bd94-da61-4a2c-88a6-b7b9d62955a3 tempest-CreateVolumesFromImageTest-299095373 None] Volume volume-c6848fe0-4faf-4a47-b4a8-76a998729c55 (c6848fe0-4faf-4a47-b4a8-76a998729c55): created successfully Sep 28 09:40:10 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ac18bd94-da61-4a2c-88a6-b7b9d62955a3 tempest-CreateVolumesFromImageTest-299095373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b6f065e-ce8a-49c3-b09e-4075d63d155d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:10 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ac18bd94-da61-4a2c-88a6-b7b9d62955a3 tempest-CreateVolumesFromImageTest-299095373 None] Flow 'volume_create_manager' (aa8265e6-76d7-486a-a8d4-2c850878c3a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:40:10 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-ac18bd94-da61-4a2c-88a6-b7b9d62955a3 tempest-CreateVolumesFromImageTest-299095373 None] Created volume successfully. Sep 28 09:40:11 devstack sudo[106610]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:11 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-556dc626-842e-46ae-97e7-8b8c43ccdddd tempest-CreateVolumesFromImageTest-299095373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-03411c80-24d2-48cb-ba94-eee3f807554b 1073741824" returned: 0 in 0.522s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:11 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-556dc626-842e-46ae-97e7-8b8c43ccdddd tempest-CreateVolumesFromImageTest-299095373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-03411c80-24d2-48cb-ba94-eee3f807554b {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:11 devstack sudo[106616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-03411c80-24d2-48cb-ba94-eee3f807554b Sep 28 09:40:11 devstack sudo[106616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:11 devstack sudo[106616]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:11 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-556dc626-842e-46ae-97e7-8b8c43ccdddd tempest-CreateVolumesFromImageTest-299095373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-03411c80-24d2-48cb-ba94-eee3f807554b" returned: 0 in 0.360s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:11 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-556dc626-842e-46ae-97e7-8b8c43ccdddd tempest-CreateVolumesFromImageTest-299095373 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:40:11 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-556dc626-842e-46ae-97e7-8b8c43ccdddd tempest-CreateVolumesFromImageTest-299095373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:40:11 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-720d94b4-8364-4c16-a6ec-68a9ffef3e50 tempest-CreateVolumesFromImageTest-299095373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.216s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:40:11 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-720d94b4-8364-4c16-a6ec-68a9ffef3e50 tempest-CreateVolumesFromImageTest-299095373 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:40:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1439272075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=665842bf-0a2e-4e7c-b462-8a30061231a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0be3a80f756a457aa049212c07360c37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:40:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:40:09Z,use_quota=True,user_id='f75a690d08b74a238312fac5743c358a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:40:11 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-720d94b4-8364-4c16-a6ec-68a9ffef3e50 tempest-CreateVolumesFromImageTest-299095373 None] Creating volume 665842bf-0a2e-4e7c-b462-8a30061231a0 {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:40:11 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-720d94b4-8364-4c16-a6ec-68a9ffef3e50 tempest-CreateVolumesFromImageTest-299095373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:40:11 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-720d94b4-8364-4c16-a6ec-68a9ffef3e50 tempest-CreateVolumesFromImageTest-299095373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:40:11 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-720d94b4-8364-4c16-a6ec-68a9ffef3e50 tempest-CreateVolumesFromImageTest-299095373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:40:11 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-720d94b4-8364-4c16-a6ec-68a9ffef3e50 tempest-CreateVolumesFromImageTest-299095373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:40:11 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-720d94b4-8364-4c16-a6ec-68a9ffef3e50 tempest-CreateVolumesFromImageTest-299095373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:40:11 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-720d94b4-8364-4c16-a6ec-68a9ffef3e50 tempest-CreateVolumesFromImageTest-299095373 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:40:11 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-720d94b4-8364-4c16-a6ec-68a9ffef3e50 tempest-CreateVolumesFromImageTest-299095373 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:40:11 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-720d94b4-8364-4c16-a6ec-68a9ffef3e50 tempest-CreateVolumesFromImageTest-299095373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-665842bf-0a2e-4e7c-b462-8a30061231a0 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:11 devstack sudo[106619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-665842bf-0a2e-4e7c-b462-8a30061231a0 1073741824 Sep 28 09:40:11 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-556dc626-842e-46ae-97e7-8b8c43ccdddd tempest-CreateVolumesFromImageTest-299095373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dc70956-ab87-4008-8d31-5067edab8460) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03411c80-24d2-48cb-ba94-eee3f807554b', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:11 devstack sudo[106619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:11 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-556dc626-842e-46ae-97e7-8b8c43ccdddd tempest-CreateVolumesFromImageTest-299095373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2feb592d-28c1-4fa8-a313-30af95f50be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:11 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-556dc626-842e-46ae-97e7-8b8c43ccdddd tempest-CreateVolumesFromImageTest-299095373 None] Volume volume-03411c80-24d2-48cb-ba94-eee3f807554b (03411c80-24d2-48cb-ba94-eee3f807554b): created successfully Sep 28 09:40:11 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-556dc626-842e-46ae-97e7-8b8c43ccdddd tempest-CreateVolumesFromImageTest-299095373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2feb592d-28c1-4fa8-a313-30af95f50be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:11 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-556dc626-842e-46ae-97e7-8b8c43ccdddd tempest-CreateVolumesFromImageTest-299095373 None] Flow 'volume_create_manager' (87d226e3-81d1-4968-b9b2-d6ac570c42db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:40:11 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-556dc626-842e-46ae-97e7-8b8c43ccdddd tempest-CreateVolumesFromImageTest-299095373 None] Created volume successfully. Sep 28 09:40:12 devstack sudo[106619]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:12 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-720d94b4-8364-4c16-a6ec-68a9ffef3e50 tempest-CreateVolumesFromImageTest-299095373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-665842bf-0a2e-4e7c-b462-8a30061231a0 1073741824" returned: 0 in 0.604s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:12 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-720d94b4-8364-4c16-a6ec-68a9ffef3e50 tempest-CreateVolumesFromImageTest-299095373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-665842bf-0a2e-4e7c-b462-8a30061231a0 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:12 devstack sudo[106626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-665842bf-0a2e-4e7c-b462-8a30061231a0 Sep 28 09:40:12 devstack sudo[106626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:12 devstack sudo[106626]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:12 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-720d94b4-8364-4c16-a6ec-68a9ffef3e50 tempest-CreateVolumesFromImageTest-299095373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-665842bf-0a2e-4e7c-b462-8a30061231a0" returned: 0 in 0.271s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:12 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-720d94b4-8364-4c16-a6ec-68a9ffef3e50 tempest-CreateVolumesFromImageTest-299095373 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:40:12 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-720d94b4-8364-4c16-a6ec-68a9ffef3e50 tempest-CreateVolumesFromImageTest-299095373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:40:12 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-71b66f19-f85f-495f-bfe0-25e3705ed702 tempest-CreateVolumesFromImageTest-299095373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.599s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:40:12 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-71b66f19-f85f-495f-bfe0-25e3705ed702 tempest-CreateVolumesFromImageTest-299095373 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:40:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1797001332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc4b4192-1af3-4daa-bb42-06e69053fa90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0be3a80f756a457aa049212c07360c37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:40:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:40:10Z,use_quota=True,user_id='f75a690d08b74a238312fac5743c358a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:40:12 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-71b66f19-f85f-495f-bfe0-25e3705ed702 tempest-CreateVolumesFromImageTest-299095373 None] Creating volume dc4b4192-1af3-4daa-bb42-06e69053fa90 {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:40:12 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-71b66f19-f85f-495f-bfe0-25e3705ed702 tempest-CreateVolumesFromImageTest-299095373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:40:12 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-71b66f19-f85f-495f-bfe0-25e3705ed702 tempest-CreateVolumesFromImageTest-299095373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:40:12 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-71b66f19-f85f-495f-bfe0-25e3705ed702 tempest-CreateVolumesFromImageTest-299095373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:40:12 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-71b66f19-f85f-495f-bfe0-25e3705ed702 tempest-CreateVolumesFromImageTest-299095373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:40:12 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-71b66f19-f85f-495f-bfe0-25e3705ed702 tempest-CreateVolumesFromImageTest-299095373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:40:12 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-71b66f19-f85f-495f-bfe0-25e3705ed702 tempest-CreateVolumesFromImageTest-299095373 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:40:12 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-71b66f19-f85f-495f-bfe0-25e3705ed702 tempest-CreateVolumesFromImageTest-299095373 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:40:12 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-71b66f19-f85f-495f-bfe0-25e3705ed702 tempest-CreateVolumesFromImageTest-299095373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-dc4b4192-1af3-4daa-bb42-06e69053fa90 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:12 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-720d94b4-8364-4c16-a6ec-68a9ffef3e50 tempest-CreateVolumesFromImageTest-299095373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (001abc2a-8be9-4e6e-960c-496f637df52e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-665842bf-0a2e-4e7c-b462-8a30061231a0', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:12 devstack sudo[106629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-dc4b4192-1af3-4daa-bb42-06e69053fa90 1073741824 Sep 28 09:40:12 devstack sudo[106629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:12 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-720d94b4-8364-4c16-a6ec-68a9ffef3e50 tempest-CreateVolumesFromImageTest-299095373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d2aa770-d0a0-4a88-8d4f-3b3ae4fe9f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:12 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-720d94b4-8364-4c16-a6ec-68a9ffef3e50 tempest-CreateVolumesFromImageTest-299095373 None] Volume volume-665842bf-0a2e-4e7c-b462-8a30061231a0 (665842bf-0a2e-4e7c-b462-8a30061231a0): created successfully Sep 28 09:40:12 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-720d94b4-8364-4c16-a6ec-68a9ffef3e50 tempest-CreateVolumesFromImageTest-299095373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d2aa770-d0a0-4a88-8d4f-3b3ae4fe9f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:12 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-720d94b4-8364-4c16-a6ec-68a9ffef3e50 tempest-CreateVolumesFromImageTest-299095373 None] Flow 'volume_create_manager' (b57beacf-cbc4-4ae0-bccb-e7fd6be985cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:40:12 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-720d94b4-8364-4c16-a6ec-68a9ffef3e50 tempest-CreateVolumesFromImageTest-299095373 None] Created volume successfully. Sep 28 09:40:13 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-75164afd-6925-497b-9442-1d8440a917ca tempest-VolumeAndVolumeTypeFromImageTest-247040431 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:40:13 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-75164afd-6925-497b-9442-1d8440a917ca tempest-VolumeAndVolumeTypeFromImageTest-247040431 None] Flow 'volume_create_manager' (f5355acf-b4d7-4fb8-b6a0-a0f616fa2e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:40:13 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-75164afd-6925-497b-9442-1d8440a917ca tempest-VolumeAndVolumeTypeFromImageTest-247040431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9c30662-98bf-4906-8cec-17b561019655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:13 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-75164afd-6925-497b-9442-1d8440a917ca tempest-VolumeAndVolumeTypeFromImageTest-247040431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9c30662-98bf-4906-8cec-17b561019655) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:40:13Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3015e149-a95b-4f1b-b3a9-9e62fa936329,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8d7c322716a4d028ac38472dfbcd58a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:40:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:40:13Z,use_quota=True,user_id='2588e8a69510441faed9319af6bc80cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d633bd5-d537-4198-878d-f05f7cd05637),volume_type_id=1d633bd5-d537-4198-878d-f05f7cd05637)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:13 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-75164afd-6925-497b-9442-1d8440a917ca tempest-VolumeAndVolumeTypeFromImageTest-247040431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72cce9e6-34a4-42a3-be22-ae9da9599354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:13 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-75164afd-6925-497b-9442-1d8440a917ca tempest-VolumeAndVolumeTypeFromImageTest-247040431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72cce9e6-34a4-42a3-be22-ae9da9599354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:13 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-75164afd-6925-497b-9442-1d8440a917ca tempest-VolumeAndVolumeTypeFromImageTest-247040431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f61241ab-94ac-4987-8d98-1298d07bbd30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:13 devstack cinder-volume[86553]: DEBUG cinder.image.glance [None req-75164afd-6925-497b-9442-1d8440a917ca tempest-VolumeAndVolumeTypeFromImageTest-247040431 None] Creating Keystone auth plugin from conf {{(pid=86553) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 09:40:13 devstack sudo[106629]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:13 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-71b66f19-f85f-495f-bfe0-25e3705ed702 tempest-CreateVolumesFromImageTest-299095373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-dc4b4192-1af3-4daa-bb42-06e69053fa90 1073741824" returned: 0 in 0.552s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:13 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-71b66f19-f85f-495f-bfe0-25e3705ed702 tempest-CreateVolumesFromImageTest-299095373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-dc4b4192-1af3-4daa-bb42-06e69053fa90 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:13 devstack sudo[106635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-dc4b4192-1af3-4daa-bb42-06e69053fa90 Sep 28 09:40:13 devstack sudo[106635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:13 devstack sudo[106635]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:13 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-71b66f19-f85f-495f-bfe0-25e3705ed702 tempest-CreateVolumesFromImageTest-299095373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-dc4b4192-1af3-4daa-bb42-06e69053fa90" returned: 0 in 0.291s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:13 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-71b66f19-f85f-495f-bfe0-25e3705ed702 tempest-CreateVolumesFromImageTest-299095373 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:40:13 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-71b66f19-f85f-495f-bfe0-25e3705ed702 tempest-CreateVolumesFromImageTest-299095373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:40:13 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-604ced46-5b7e-4701-bd67-0437f21d7fe9 tempest-CreateVolumesFromImageTest-299095373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.152s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:40:13 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-604ced46-5b7e-4701-bd67-0437f21d7fe9 tempest-CreateVolumesFromImageTest-299095373 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:40:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2042851659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7668aafc-f890-4880-b885-9391ab4ce59e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0be3a80f756a457aa049212c07360c37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:40:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:40:10Z,use_quota=True,user_id='f75a690d08b74a238312fac5743c358a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:40:13 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-604ced46-5b7e-4701-bd67-0437f21d7fe9 tempest-CreateVolumesFromImageTest-299095373 None] Creating volume 7668aafc-f890-4880-b885-9391ab4ce59e {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:40:13 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-604ced46-5b7e-4701-bd67-0437f21d7fe9 tempest-CreateVolumesFromImageTest-299095373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:40:13 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-604ced46-5b7e-4701-bd67-0437f21d7fe9 tempest-CreateVolumesFromImageTest-299095373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:40:13 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-604ced46-5b7e-4701-bd67-0437f21d7fe9 tempest-CreateVolumesFromImageTest-299095373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:40:13 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-604ced46-5b7e-4701-bd67-0437f21d7fe9 tempest-CreateVolumesFromImageTest-299095373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:40:13 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-604ced46-5b7e-4701-bd67-0437f21d7fe9 tempest-CreateVolumesFromImageTest-299095373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:40:13 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-604ced46-5b7e-4701-bd67-0437f21d7fe9 tempest-CreateVolumesFromImageTest-299095373 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:40:13 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-604ced46-5b7e-4701-bd67-0437f21d7fe9 tempest-CreateVolumesFromImageTest-299095373 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:40:13 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-604ced46-5b7e-4701-bd67-0437f21d7fe9 tempest-CreateVolumesFromImageTest-299095373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-7668aafc-f890-4880-b885-9391ab4ce59e 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:13 devstack sudo[106638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-7668aafc-f890-4880-b885-9391ab4ce59e 1073741824 Sep 28 09:40:13 devstack sudo[106638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:13 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-71b66f19-f85f-495f-bfe0-25e3705ed702 tempest-CreateVolumesFromImageTest-299095373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24b018fd-2f41-4ffd-bc95-92c59b4df784) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc4b4192-1af3-4daa-bb42-06e69053fa90', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:13 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-71b66f19-f85f-495f-bfe0-25e3705ed702 tempest-CreateVolumesFromImageTest-299095373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3a4b9f9-756d-44f7-9be9-77643d1eed06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:13 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-71b66f19-f85f-495f-bfe0-25e3705ed702 tempest-CreateVolumesFromImageTest-299095373 None] Volume volume-dc4b4192-1af3-4daa-bb42-06e69053fa90 (dc4b4192-1af3-4daa-bb42-06e69053fa90): created successfully Sep 28 09:40:13 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-71b66f19-f85f-495f-bfe0-25e3705ed702 tempest-CreateVolumesFromImageTest-299095373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3a4b9f9-756d-44f7-9be9-77643d1eed06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:13 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-71b66f19-f85f-495f-bfe0-25e3705ed702 tempest-CreateVolumesFromImageTest-299095373 None] Flow 'volume_create_manager' (7e5060a5-c021-4ea3-b3df-25ee794bfcfa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:40:13 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-75164afd-6925-497b-9442-1d8440a917ca tempest-VolumeAndVolumeTypeFromImageTest-247040431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f61241ab-94ac-4987-8d98-1298d07bbd30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3015e149-a95b-4f1b-b3a9-9e62fa936329', 'volume_name': 'volume-3015e149-a95b-4f1b-b3a9-9e62fa936329', 'volume_size': 1, 'image_id': '3e30182a-f8a9-4652-9b57-86390ca167c0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3e30182a-f8a9-4652-9b57-86390ca167c0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cd74195b5785aa894a90165c24d84297', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e8d7c322716a4d028ac38472dfbcd58a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6c987648c634a5e64a1cfcc0e4c71137479c44c0fa8a8173d4a189e287d57fde31fc159c66b273eebc3b2a93a73c53130999d4eb1c199bd5335ffc30f59014f2', 'id': '3e30182a-f8a9-4652-9b57-86390ca167c0', 'created_at': datetime.datetime(2026, 9, 28, 7, 40, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 7, 40, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3e30182a-f8a9-4652-9b57-86390ca167c0/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:13 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-75164afd-6925-497b-9442-1d8440a917ca tempest-VolumeAndVolumeTypeFromImageTest-247040431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (855db84b-6afe-49ad-b3a0-af9e0533e29d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:13 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-75164afd-6925-497b-9442-1d8440a917ca tempest-VolumeAndVolumeTypeFromImageTest-247040431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (855db84b-6afe-49ad-b3a0-af9e0533e29d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:13 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-75164afd-6925-497b-9442-1d8440a917ca tempest-VolumeAndVolumeTypeFromImageTest-247040431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fefab10e-8ad5-43dd-a4de-13ee989e3821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:13 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-75164afd-6925-497b-9442-1d8440a917ca tempest-VolumeAndVolumeTypeFromImageTest-247040431 None] Volume 3015e149-a95b-4f1b-b3a9-9e62fa936329: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3015e149-a95b-4f1b-b3a9-9e62fa936329', 'volume_size': 1, 'image_id': '3e30182a-f8a9-4652-9b57-86390ca167c0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3e30182a-f8a9-4652-9b57-86390ca167c0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cd74195b5785aa894a90165c24d84297', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e8d7c322716a4d028ac38472dfbcd58a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6c987648c634a5e64a1cfcc0e4c71137479c44c0fa8a8173d4a189e287d57fde31fc159c66b273eebc3b2a93a73c53130999d4eb1c199bd5335ffc30f59014f2', 'id': '3e30182a-f8a9-4652-9b57-86390ca167c0', 'created_at': datetime.datetime(2026, 9, 28, 7, 40, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 7, 40, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3e30182a-f8a9-4652-9b57-86390ca167c0/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 28 09:40:13 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-75164afd-6925-497b-9442-1d8440a917ca tempest-VolumeAndVolumeTypeFromImageTest-247040431 None] Trying to clone 3015e149-a95b-4f1b-b3a9-9e62fa936329 from image 3e30182a-f8a9-4652-9b57-86390ca167c0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/3e30182a-f8a9-4652-9b57-86390ca167c0', 'metadata': {}}]). {{(pid=86553) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 09:40:13 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-71b66f19-f85f-495f-bfe0-25e3705ed702 tempest-CreateVolumesFromImageTest-299095373 None] Created volume successfully. Sep 28 09:40:13 devstack cinder-volume[86553]: DEBUG cinder.image.image_utils [None req-75164afd-6925-497b-9442-1d8440a917ca tempest-VolumeAndVolumeTypeFromImageTest-247040431 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3e30182a-f8a9-4652-9b57-86390ca167c0_fp8z2cvudevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86553) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 09:40:13 devstack cinder-volume[86553]: INFO cinder.image.image_utils [None req-75164afd-6925-497b-9442-1d8440a917ca tempest-VolumeAndVolumeTypeFromImageTest-247040431 None] Image download 0.00 MB at 0.00 MB/s Sep 28 09:40:13 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[f14069ec-a4b9-4403-9da3-a661f46c0e01]: (4, 'raw') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:40:13 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-75164afd-6925-497b-9442-1d8440a917ca tempest-VolumeAndVolumeTypeFromImageTest-247040431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3e30182a-f8a9-4652-9b57-86390ca167c0_fp8z2cvudevstack@QuobyteHD {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:14 devstack sudo[106642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3e30182a-f8a9-4652-9b57-86390ca167c0_fp8z2cvudevstack@QuobyteHD Sep 28 09:40:14 devstack sudo[106642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:14 devstack sudo[106638]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:14 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-604ced46-5b7e-4701-bd67-0437f21d7fe9 tempest-CreateVolumesFromImageTest-299095373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-7668aafc-f890-4880-b885-9391ab4ce59e 1073741824" returned: 0 in 0.551s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:14 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-604ced46-5b7e-4701-bd67-0437f21d7fe9 tempest-CreateVolumesFromImageTest-299095373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-7668aafc-f890-4880-b885-9391ab4ce59e {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:14 devstack sudo[106646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-7668aafc-f890-4880-b885-9391ab4ce59e Sep 28 09:40:14 devstack sudo[106646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:14 devstack sudo[106642]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:14 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-75164afd-6925-497b-9442-1d8440a917ca tempest-VolumeAndVolumeTypeFromImageTest-247040431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3e30182a-f8a9-4652-9b57-86390ca167c0_fp8z2cvudevstack@QuobyteHD" returned: 0 in 0.393s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:14 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-75164afd-6925-497b-9442-1d8440a917ca tempest-VolumeAndVolumeTypeFromImageTest-247040431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3e30182a-f8a9-4652-9b57-86390ca167c0_fp8z2cvudevstack@QuobyteHD {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:14 devstack sudo[106650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3e30182a-f8a9-4652-9b57-86390ca167c0_fp8z2cvudevstack@QuobyteHD Sep 28 09:40:14 devstack sudo[106650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:14 devstack sudo[106646]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:14 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-604ced46-5b7e-4701-bd67-0437f21d7fe9 tempest-CreateVolumesFromImageTest-299095373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-7668aafc-f890-4880-b885-9391ab4ce59e" returned: 0 in 0.277s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:14 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-604ced46-5b7e-4701-bd67-0437f21d7fe9 tempest-CreateVolumesFromImageTest-299095373 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:40:14 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-604ced46-5b7e-4701-bd67-0437f21d7fe9 tempest-CreateVolumesFromImageTest-299095373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:40:14 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-a1b56544-b078-453f-b8b6-3cce5696d06b tempest-VolumeDependencyTests-227757527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.841s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:40:14 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-a1b56544-b078-453f-b8b6-3cce5696d06b tempest-VolumeDependencyTests-227757527 None] Creating offline snapshot 8d1eff2d-0ebb-4bf2-8ffd-1f1fef7f4631 of volume c94b30a9-8c03-4988-806c-5d173f02cb9e {{(pid=86553) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 09:40:14 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-604ced46-5b7e-4701-bd67-0437f21d7fe9 tempest-CreateVolumesFromImageTest-299095373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d016ad9-1ae5-451c-ad48-638bad6aa3ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7668aafc-f890-4880-b885-9391ab4ce59e', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:14 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-604ced46-5b7e-4701-bd67-0437f21d7fe9 tempest-CreateVolumesFromImageTest-299095373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a8d11a1-2ccb-4651-acf5-f28ae0ed3b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:14 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f295cbb-336b-43f6-ad61-50ab304ac6fd]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:40:14 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a1b56544-b078-453f-b8b6-3cce5696d06b tempest-VolumeDependencyTests-227757527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c94b30a9-8c03-4988-806c-5d173f02cb9e {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:14 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-604ced46-5b7e-4701-bd67-0437f21d7fe9 tempest-CreateVolumesFromImageTest-299095373 None] Volume volume-7668aafc-f890-4880-b885-9391ab4ce59e (7668aafc-f890-4880-b885-9391ab4ce59e): created successfully Sep 28 09:40:14 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-604ced46-5b7e-4701-bd67-0437f21d7fe9 tempest-CreateVolumesFromImageTest-299095373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a8d11a1-2ccb-4651-acf5-f28ae0ed3b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:14 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-604ced46-5b7e-4701-bd67-0437f21d7fe9 tempest-CreateVolumesFromImageTest-299095373 None] Flow 'volume_create_manager' (c29cddff-a8b7-4541-8db4-150fa3e4fc68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:40:14 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-604ced46-5b7e-4701-bd67-0437f21d7fe9 tempest-CreateVolumesFromImageTest-299095373 None] Created volume successfully. Sep 28 09:40:14 devstack sudo[106650]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:14 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-75164afd-6925-497b-9442-1d8440a917ca tempest-VolumeAndVolumeTypeFromImageTest-247040431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3e30182a-f8a9-4652-9b57-86390ca167c0_fp8z2cvudevstack@QuobyteHD" returned: 1 in 0.364s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:14 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-75164afd-6925-497b-9442-1d8440a917ca tempest-VolumeAndVolumeTypeFromImageTest-247040431 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3e30182a-f8a9-4652-9b57-86390ca167c0_fp8z2cvudevstack@QuobyteHD' failed. Not Retrying. {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 09:40:14 devstack cinder-volume[86553]: DEBUG cinder.image.image_utils [None req-75164afd-6925-497b-9442-1d8440a917ca tempest-VolumeAndVolumeTypeFromImageTest-247040431 None] Temporary image 3e30182a-f8a9-4652-9b57-86390ca167c0 is fetched for user 2588e8a69510441faed9319af6bc80cd. {{(pid=86553) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 09:40:14 devstack sudo[106653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c94b30a9-8c03-4988-806c-5d173f02cb9e Sep 28 09:40:14 devstack sudo[106653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:14 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8d9488c-52cf-420c-abba-86b6cbdab1ee]: (4, 'raw') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:40:14 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-75164afd-6925-497b-9442-1d8440a917ca tempest-VolumeAndVolumeTypeFromImageTest-247040431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3e30182a-f8a9-4652-9b57-86390ca167c0_fp8z2cvudevstack@QuobyteHD {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:14 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-ac53665c-ef8a-40ba-9ccc-149efd0686ae tempest-CreateVolumesFromImageTest-299095373 None] Acquiring lock "cinder-7668aafc-f890-4880-b885-9391ab4ce59e-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:40:14 devstack sudo[106658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3e30182a-f8a9-4652-9b57-86390ca167c0_fp8z2cvudevstack@QuobyteHD Sep 28 09:40:14 devstack sudo[106658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:14 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-ac53665c-ef8a-40ba-9ccc-149efd0686ae tempest-CreateVolumesFromImageTest-299095373 None] Lock "cinder-7668aafc-f890-4880-b885-9391ab4ce59e-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:40:14 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-ac53665c-ef8a-40ba-9ccc-149efd0686ae tempest-CreateVolumesFromImageTest-299095373 None] Acquiring lock "cinder-quobyte-7668aafc-f890-4880-b885-9391ab4ce59e" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:40:15 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-ac53665c-ef8a-40ba-9ccc-149efd0686ae tempest-CreateVolumesFromImageTest-299095373 None] Lock "cinder-quobyte-7668aafc-f890-4880-b885-9391ab4ce59e" acquired by "delete_volume" :: waited 0.022s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:40:15 devstack sudo[106653]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:15 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a1b56544-b078-453f-b8b6-3cce5696d06b tempest-VolumeDependencyTests-227757527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c94b30a9-8c03-4988-806c-5d173f02cb9e" returned: 0 in 0.544s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:15 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a1b56544-b078-453f-b8b6-3cce5696d06b tempest-VolumeDependencyTests-227757527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c94b30a9-8c03-4988-806c-5d173f02cb9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c94b30a9-8c03-4988-806c-5d173f02cb9e.8d1eff2d-0ebb-4bf2-8ffd-1f1fef7f4631 1G {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:15 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aeb2760-4e1d-49a4-9b11-841ede2bbb97]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:40:15 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ac53665c-ef8a-40ba-9ccc-149efd0686ae tempest-CreateVolumesFromImageTest-299095373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-7668aafc-f890-4880-b885-9391ab4ce59e {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:15 devstack sudo[106663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c94b30a9-8c03-4988-806c-5d173f02cb9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c94b30a9-8c03-4988-806c-5d173f02cb9e.8d1eff2d-0ebb-4bf2-8ffd-1f1fef7f4631 1G Sep 28 09:40:15 devstack sudo[106663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:15 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-a97c27d7-4acb-4de6-ada7-0d32169ae673 tempest-ProjectMemberTests-186690331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:40:15 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-a97c27d7-4acb-4de6-ada7-0d32169ae673 tempest-ProjectMemberTests-186690331 None] Flow 'volume_create_manager' (57de437f-7356-46df-8fb3-1e9362c1c24a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:40:15 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-a97c27d7-4acb-4de6-ada7-0d32169ae673 tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd50a47a-e8b8-4654-9849-aa4198dbb578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:15 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-a97c27d7-4acb-4de6-ada7-0d32169ae673 tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd50a47a-e8b8-4654-9849-aa4198dbb578) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:40:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1708092337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06b7bbe5-9433-4698-b02a-c3a4fbb9415b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50c5ebfa35e84e1fa822f83efd2739e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:40:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:40:15Z,use_quota=True,user_id='029e33208bca4e258a762ad19e5ed78e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:15 devstack sudo[106658]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:15 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-a97c27d7-4acb-4de6-ada7-0d32169ae673 tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4da754f9-6110-4ccf-9893-91c72d464afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:15 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-a97c27d7-4acb-4de6-ada7-0d32169ae673 tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4da754f9-6110-4ccf-9893-91c72d464afa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:15 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-a97c27d7-4acb-4de6-ada7-0d32169ae673 tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75bd8687-18b2-42ab-839a-0809e6f42549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:15 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-a97c27d7-4acb-4de6-ada7-0d32169ae673 tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75bd8687-18b2-42ab-839a-0809e6f42549) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06b7bbe5-9433-4698-b02a-c3a4fbb9415b', 'volume_name': 'volume-06b7bbe5-9433-4698-b02a-c3a4fbb9415b', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:15 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-a97c27d7-4acb-4de6-ada7-0d32169ae673 tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1fc38f5-73cf-40cd-9a0a-887c3ac93f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:15 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-a97c27d7-4acb-4de6-ada7-0d32169ae673 tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1fc38f5-73cf-40cd-9a0a-887c3ac93f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:15 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-a97c27d7-4acb-4de6-ada7-0d32169ae673 tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc42790d-98c5-4189-9c74-4d8c2369464b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:15 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-a97c27d7-4acb-4de6-ada7-0d32169ae673 tempest-ProjectMemberTests-186690331 None] Volume 06b7bbe5-9433-4698-b02a-c3a4fbb9415b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06b7bbe5-9433-4698-b02a-c3a4fbb9415b', 'volume_size': 1} Sep 28 09:40:15 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-a97c27d7-4acb-4de6-ada7-0d32169ae673 tempest-ProjectMemberTests-186690331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:40:15 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-75164afd-6925-497b-9442-1d8440a917ca tempest-VolumeAndVolumeTypeFromImageTest-247040431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3e30182a-f8a9-4652-9b57-86390ca167c0_fp8z2cvudevstack@QuobyteHD" returned: 0 in 0.489s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:15 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-75164afd-6925-497b-9442-1d8440a917ca tempest-VolumeAndVolumeTypeFromImageTest-247040431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3e30182a-f8a9-4652-9b57-86390ca167c0_fp8z2cvudevstack@QuobyteHD {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:15 devstack sudo[106664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-7668aafc-f890-4880-b885-9391ab4ce59e Sep 28 09:40:15 devstack sudo[106664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:15 devstack sudo[106668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3e30182a-f8a9-4652-9b57-86390ca167c0_fp8z2cvudevstack@QuobyteHD Sep 28 09:40:15 devstack sudo[106668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:15 devstack sudo[106663]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:15 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a1b56544-b078-453f-b8b6-3cce5696d06b tempest-VolumeDependencyTests-227757527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c94b30a9-8c03-4988-806c-5d173f02cb9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c94b30a9-8c03-4988-806c-5d173f02cb9e.8d1eff2d-0ebb-4bf2-8ffd-1f1fef7f4631 1G" returned: 0 in 0.449s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:15 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a1b56544-b078-453f-b8b6-3cce5696d06b tempest-VolumeDependencyTests-227757527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c94b30a9-8c03-4988-806c-5d173f02cb9e -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c94b30a9-8c03-4988-806c-5d173f02cb9e.8d1eff2d-0ebb-4bf2-8ffd-1f1fef7f4631 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:15 devstack sudo[106679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c94b30a9-8c03-4988-806c-5d173f02cb9e -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c94b30a9-8c03-4988-806c-5d173f02cb9e.8d1eff2d-0ebb-4bf2-8ffd-1f1fef7f4631 Sep 28 09:40:15 devstack sudo[106679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:15 devstack sudo[106664]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:15 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ac53665c-ef8a-40ba-9ccc-149efd0686ae tempest-CreateVolumesFromImageTest-299095373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-7668aafc-f890-4880-b885-9391ab4ce59e" returned: 0 in 0.480s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:15 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ac53665c-ef8a-40ba-9ccc-149efd0686ae tempest-CreateVolumesFromImageTest-299095373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-7668aafc-f890-4880-b885-9391ab4ce59e {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:15 devstack sudo[106681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-7668aafc-f890-4880-b885-9391ab4ce59e Sep 28 09:40:15 devstack sudo[106681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:15 devstack sudo[106668]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:15 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-75164afd-6925-497b-9442-1d8440a917ca tempest-VolumeAndVolumeTypeFromImageTest-247040431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3e30182a-f8a9-4652-9b57-86390ca167c0_fp8z2cvudevstack@QuobyteHD" returned: 1 in 0.385s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:15 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-75164afd-6925-497b-9442-1d8440a917ca tempest-VolumeAndVolumeTypeFromImageTest-247040431 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3e30182a-f8a9-4652-9b57-86390ca167c0_fp8z2cvudevstack@QuobyteHD' failed. Not Retrying. {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 09:40:15 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-75164afd-6925-497b-9442-1d8440a917ca tempest-VolumeAndVolumeTypeFromImageTest-247040431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:40:15 devstack sudo[106679]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:15 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a1b56544-b078-453f-b8b6-3cce5696d06b tempest-VolumeDependencyTests-227757527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c94b30a9-8c03-4988-806c-5d173f02cb9e -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c94b30a9-8c03-4988-806c-5d173f02cb9e.8d1eff2d-0ebb-4bf2-8ffd-1f1fef7f4631" returned: 0 in 0.294s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:15 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-a1b56544-b078-453f-b8b6-3cce5696d06b tempest-VolumeDependencyTests-227757527 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c94b30a9-8c03-4988-806c-5d173f02cb9e.8d1eff2d-0ebb-4bf2-8ffd-1f1fef7f4631 is being set with open permissions: ugo+rw Sep 28 09:40:15 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a1b56544-b078-453f-b8b6-3cce5696d06b tempest-VolumeDependencyTests-227757527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c94b30a9-8c03-4988-806c-5d173f02cb9e.8d1eff2d-0ebb-4bf2-8ffd-1f1fef7f4631 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:15 devstack sudo[106681]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:15 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ac53665c-ef8a-40ba-9ccc-149efd0686ae tempest-CreateVolumesFromImageTest-299095373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-7668aafc-f890-4880-b885-9391ab4ce59e" returned: 0 in 0.267s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:15 devstack sudo[106690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c94b30a9-8c03-4988-806c-5d173f02cb9e.8d1eff2d-0ebb-4bf2-8ffd-1f1fef7f4631 Sep 28 09:40:15 devstack sudo[106690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:15 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-ac53665c-ef8a-40ba-9ccc-149efd0686ae tempest-CreateVolumesFromImageTest-299095373 None] Lock "cinder-quobyte-7668aafc-f890-4880-b885-9391ab4ce59e" released by "delete_volume" :: held 0.812s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:40:15 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-ac53665c-ef8a-40ba-9ccc-149efd0686ae tempest-CreateVolumesFromImageTest-299095373 None] Created reservations ['77063b5b-18a1-4e16-baf0-174608bb1495', 'd4e6388b-29a5-4525-830e-ca686372c212', 'a8039a72-6289-4a64-a555-119739cdf3ac', 'cbb3dd82-189c-494b-a298-00fe8ba3a4dc'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:40:15 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ac53665c-ef8a-40ba-9ccc-149efd0686ae tempest-CreateVolumesFromImageTest-299095373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:40:15 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ac53665c-ef8a-40ba-9ccc-149efd0686ae tempest-CreateVolumesFromImageTest-299095373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:40:15 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ac53665c-ef8a-40ba-9ccc-149efd0686ae tempest-CreateVolumesFromImageTest-299095373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:40:15 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ac53665c-ef8a-40ba-9ccc-149efd0686ae tempest-CreateVolumesFromImageTest-299095373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:40:15 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ac53665c-ef8a-40ba-9ccc-149efd0686ae tempest-CreateVolumesFromImageTest-299095373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:40:15 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ac53665c-ef8a-40ba-9ccc-149efd0686ae tempest-CreateVolumesFromImageTest-299095373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:15 devstack sudo[106692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:40:15 devstack sudo[106692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:16 devstack sudo[106690]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:16 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a1b56544-b078-453f-b8b6-3cce5696d06b tempest-VolumeDependencyTests-227757527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c94b30a9-8c03-4988-806c-5d173f02cb9e.8d1eff2d-0ebb-4bf2-8ffd-1f1fef7f4631" returned: 0 in 0.259s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:16 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a1b56544-b078-453f-b8b6-3cce5696d06b tempest-VolumeDependencyTests-227757527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c94b30a9-8c03-4988-806c-5d173f02cb9e.info {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:16 devstack sudo[106697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c94b30a9-8c03-4988-806c-5d173f02cb9e.info Sep 28 09:40:16 devstack sudo[106697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:16 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-8ded3afe-985b-46d8-a3f8-1df1745ba2a7 tempest-CreateVolumesFromImageTest-299095373 None] Acquiring lock "cinder-dc4b4192-1af3-4daa-bb42-06e69053fa90-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:40:16 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-8ded3afe-985b-46d8-a3f8-1df1745ba2a7 tempest-CreateVolumesFromImageTest-299095373 None] Lock "cinder-dc4b4192-1af3-4daa-bb42-06e69053fa90-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:40:16 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-8ded3afe-985b-46d8-a3f8-1df1745ba2a7 tempest-CreateVolumesFromImageTest-299095373 None] Acquiring lock "cinder-quobyte-dc4b4192-1af3-4daa-bb42-06e69053fa90" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:40:16 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-8ded3afe-985b-46d8-a3f8-1df1745ba2a7 tempest-CreateVolumesFromImageTest-299095373 None] Lock "cinder-quobyte-dc4b4192-1af3-4daa-bb42-06e69053fa90" acquired by "delete_volume" :: waited 0.040s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:40:16 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf1ae3c-6a6a-4187-b68b-74c23208b8c9]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:40:16 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-8ded3afe-985b-46d8-a3f8-1df1745ba2a7 tempest-CreateVolumesFromImageTest-299095373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-dc4b4192-1af3-4daa-bb42-06e69053fa90 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:16 devstack sudo[106692]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:16 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ac53665c-ef8a-40ba-9ccc-149efd0686ae tempest-CreateVolumesFromImageTest-299095373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.305s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:16 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-ac53665c-ef8a-40ba-9ccc-149efd0686ae tempest-CreateVolumesFromImageTest-299095373 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:40:16 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-ac53665c-ef8a-40ba-9ccc-149efd0686ae tempest-CreateVolumesFromImageTest-299095373 None] Deleted volume successfully. Sep 28 09:40:16 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-ac53665c-ef8a-40ba-9ccc-149efd0686ae tempest-CreateVolumesFromImageTest-299095373 None] Lock "cinder-7668aafc-f890-4880-b885-9391ab4ce59e-delete_volume" released by "delete_volume" :: held 1.369s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:40:16 devstack sudo[106700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-dc4b4192-1af3-4daa-bb42-06e69053fa90 Sep 28 09:40:16 devstack sudo[106697]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:16 devstack sudo[106700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:16 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a1b56544-b078-453f-b8b6-3cce5696d06b tempest-VolumeDependencyTests-227757527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c94b30a9-8c03-4988-806c-5d173f02cb9e.info" returned: 0 in 0.298s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:16 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-a1b56544-b078-453f-b8b6-3cce5696d06b tempest-VolumeDependencyTests-227757527 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c94b30a9-8c03-4988-806c-5d173f02cb9e.info is being set with open permissions: ugo+rw Sep 28 09:40:16 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a1b56544-b078-453f-b8b6-3cce5696d06b tempest-VolumeDependencyTests-227757527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c94b30a9-8c03-4988-806c-5d173f02cb9e.info {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:16 devstack sudo[106703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c94b30a9-8c03-4988-806c-5d173f02cb9e.info Sep 28 09:40:16 devstack sudo[106703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:16 devstack sudo[106703]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:16 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a1b56544-b078-453f-b8b6-3cce5696d06b tempest-VolumeDependencyTests-227757527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c94b30a9-8c03-4988-806c-5d173f02cb9e.info" returned: 0 in 0.254s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:16 devstack sudo[106700]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:16 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-a1b56544-b078-453f-b8b6-3cce5696d06b tempest-VolumeDependencyTests-227757527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.195s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:40:16 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-a97c27d7-4acb-4de6-ada7-0d32169ae673 tempest-ProjectMemberTests-186690331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.419s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:40:16 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-a97c27d7-4acb-4de6-ada7-0d32169ae673 tempest-ProjectMemberTests-186690331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:40:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1708092337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06b7bbe5-9433-4698-b02a-c3a4fbb9415b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50c5ebfa35e84e1fa822f83efd2739e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:40:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:40:15Z,use_quota=True,user_id='029e33208bca4e258a762ad19e5ed78e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:40:16 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-a97c27d7-4acb-4de6-ada7-0d32169ae673 tempest-ProjectMemberTests-186690331 None] Creating volume 06b7bbe5-9433-4698-b02a-c3a4fbb9415b {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:40:16 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-a97c27d7-4acb-4de6-ada7-0d32169ae673 tempest-ProjectMemberTests-186690331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:40:16 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-a97c27d7-4acb-4de6-ada7-0d32169ae673 tempest-ProjectMemberTests-186690331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:40:16 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-a97c27d7-4acb-4de6-ada7-0d32169ae673 tempest-ProjectMemberTests-186690331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:40:16 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-a97c27d7-4acb-4de6-ada7-0d32169ae673 tempest-ProjectMemberTests-186690331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:40:16 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-a97c27d7-4acb-4de6-ada7-0d32169ae673 tempest-ProjectMemberTests-186690331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:40:16 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-a97c27d7-4acb-4de6-ada7-0d32169ae673 tempest-ProjectMemberTests-186690331 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:40:16 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-a97c27d7-4acb-4de6-ada7-0d32169ae673 tempest-ProjectMemberTests-186690331 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:40:16 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a97c27d7-4acb-4de6-ada7-0d32169ae673 tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-06b7bbe5-9433-4698-b02a-c3a4fbb9415b 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:16 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-8ded3afe-985b-46d8-a3f8-1df1745ba2a7 tempest-CreateVolumesFromImageTest-299095373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-dc4b4192-1af3-4daa-bb42-06e69053fa90" returned: 0 in 0.425s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:16 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-8ded3afe-985b-46d8-a3f8-1df1745ba2a7 tempest-CreateVolumesFromImageTest-299095373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-dc4b4192-1af3-4daa-bb42-06e69053fa90 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:16 devstack sudo[106709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-06b7bbe5-9433-4698-b02a-c3a4fbb9415b 1073741824 Sep 28 09:40:16 devstack sudo[106709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:16 devstack sudo[106711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-dc4b4192-1af3-4daa-bb42-06e69053fa90 Sep 28 09:40:16 devstack sudo[106711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:16 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-a1b56544-b078-453f-b8b6-3cce5696d06b tempest-VolumeDependencyTests-227757527 None] Create snapshot completed successfully Sep 28 09:40:16 devstack sudo[106711]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:16 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-8ded3afe-985b-46d8-a3f8-1df1745ba2a7 tempest-CreateVolumesFromImageTest-299095373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-dc4b4192-1af3-4daa-bb42-06e69053fa90" returned: 0 in 0.263s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:16 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-8ded3afe-985b-46d8-a3f8-1df1745ba2a7 tempest-CreateVolumesFromImageTest-299095373 None] Lock "cinder-quobyte-dc4b4192-1af3-4daa-bb42-06e69053fa90" released by "delete_volume" :: held 0.751s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:40:17 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-8ded3afe-985b-46d8-a3f8-1df1745ba2a7 tempest-CreateVolumesFromImageTest-299095373 None] Created reservations ['58465ccc-b2d7-4d21-ae43-a330b9c292bd', '997ddcc6-d454-45d7-8675-5cfc03a27ade', 'a656d5ea-910a-4590-9b28-afdd9f683c48', 'b1344ae9-71ba-4da2-ae50-43b746519ba1'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:40:17 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-8ded3afe-985b-46d8-a3f8-1df1745ba2a7 tempest-CreateVolumesFromImageTest-299095373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:40:17 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-8ded3afe-985b-46d8-a3f8-1df1745ba2a7 tempest-CreateVolumesFromImageTest-299095373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:40:17 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-8ded3afe-985b-46d8-a3f8-1df1745ba2a7 tempest-CreateVolumesFromImageTest-299095373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:40:17 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-8ded3afe-985b-46d8-a3f8-1df1745ba2a7 tempest-CreateVolumesFromImageTest-299095373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:40:17 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-8ded3afe-985b-46d8-a3f8-1df1745ba2a7 tempest-CreateVolumesFromImageTest-299095373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:40:17 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-8ded3afe-985b-46d8-a3f8-1df1745ba2a7 tempest-CreateVolumesFromImageTest-299095373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:17 devstack sudo[106718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:40:17 devstack sudo[106718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:17 devstack sudo[106709]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:17 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a97c27d7-4acb-4de6-ada7-0d32169ae673 tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-06b7bbe5-9433-4698-b02a-c3a4fbb9415b 1073741824" returned: 0 in 0.521s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:17 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a97c27d7-4acb-4de6-ada7-0d32169ae673 tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-06b7bbe5-9433-4698-b02a-c3a4fbb9415b {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:17 devstack sudo[106720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-06b7bbe5-9433-4698-b02a-c3a4fbb9415b Sep 28 09:40:17 devstack sudo[106720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:17 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-c32cdc6a-85e4-43ec-8d4a-5a34a16f9684 tempest-CreateVolumesFromImageTest-299095373 None] Acquiring lock "cinder-665842bf-0a2e-4e7c-b462-8a30061231a0-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:40:17 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-c32cdc6a-85e4-43ec-8d4a-5a34a16f9684 tempest-CreateVolumesFromImageTest-299095373 None] Lock "cinder-665842bf-0a2e-4e7c-b462-8a30061231a0-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:40:17 devstack sudo[106718]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:17 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-8ded3afe-985b-46d8-a3f8-1df1745ba2a7 tempest-CreateVolumesFromImageTest-299095373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.362s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:17 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-8ded3afe-985b-46d8-a3f8-1df1745ba2a7 tempest-CreateVolumesFromImageTest-299095373 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:40:17 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-8ded3afe-985b-46d8-a3f8-1df1745ba2a7 tempest-CreateVolumesFromImageTest-299095373 None] Deleted volume successfully. Sep 28 09:40:17 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-c32cdc6a-85e4-43ec-8d4a-5a34a16f9684 tempest-CreateVolumesFromImageTest-299095373 None] Acquiring lock "cinder-quobyte-665842bf-0a2e-4e7c-b462-8a30061231a0" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:40:17 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-8ded3afe-985b-46d8-a3f8-1df1745ba2a7 tempest-CreateVolumesFromImageTest-299095373 None] Lock "cinder-dc4b4192-1af3-4daa-bb42-06e69053fa90-delete_volume" released by "delete_volume" :: held 1.379s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:40:17 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-c32cdc6a-85e4-43ec-8d4a-5a34a16f9684 tempest-CreateVolumesFromImageTest-299095373 None] Lock "cinder-quobyte-665842bf-0a2e-4e7c-b462-8a30061231a0" acquired by "delete_volume" :: waited 0.030s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:40:17 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[c34eb630-7201-452e-bea5-2247d3d99142]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:40:17 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c32cdc6a-85e4-43ec-8d4a-5a34a16f9684 tempest-CreateVolumesFromImageTest-299095373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-665842bf-0a2e-4e7c-b462-8a30061231a0 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:17 devstack sudo[106720]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:17 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a97c27d7-4acb-4de6-ada7-0d32169ae673 tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-06b7bbe5-9433-4698-b02a-c3a4fbb9415b" returned: 0 in 0.347s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:17 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-a97c27d7-4acb-4de6-ada7-0d32169ae673 tempest-ProjectMemberTests-186690331 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:40:17 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-a97c27d7-4acb-4de6-ada7-0d32169ae673 tempest-ProjectMemberTests-186690331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:40:17 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-75164afd-6925-497b-9442-1d8440a917ca tempest-VolumeAndVolumeTypeFromImageTest-247040431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.973s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:40:17 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-75164afd-6925-497b-9442-1d8440a917ca tempest-VolumeAndVolumeTypeFromImageTest-247040431 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:40:13Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3015e149-a95b-4f1b-b3a9-9e62fa936329,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8d7c322716a4d028ac38472dfbcd58a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:40:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:40:13Z,use_quota=True,user_id='2588e8a69510441faed9319af6bc80cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d633bd5-d537-4198-878d-f05f7cd05637),volume_type_id=1d633bd5-d537-4198-878d-f05f7cd05637)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:40:17 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-75164afd-6925-497b-9442-1d8440a917ca tempest-VolumeAndVolumeTypeFromImageTest-247040431 None] Creating volume 3015e149-a95b-4f1b-b3a9-9e62fa936329 {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:40:17 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-75164afd-6925-497b-9442-1d8440a917ca tempest-VolumeAndVolumeTypeFromImageTest-247040431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:40:17 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-75164afd-6925-497b-9442-1d8440a917ca tempest-VolumeAndVolumeTypeFromImageTest-247040431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:40:17 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-75164afd-6925-497b-9442-1d8440a917ca tempest-VolumeAndVolumeTypeFromImageTest-247040431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:40:17 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-75164afd-6925-497b-9442-1d8440a917ca tempest-VolumeAndVolumeTypeFromImageTest-247040431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:40:17 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-75164afd-6925-497b-9442-1d8440a917ca tempest-VolumeAndVolumeTypeFromImageTest-247040431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:40:17 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-75164afd-6925-497b-9442-1d8440a917ca tempest-VolumeAndVolumeTypeFromImageTest-247040431 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:40:17 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-75164afd-6925-497b-9442-1d8440a917ca tempest-VolumeAndVolumeTypeFromImageTest-247040431 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:40:17 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-75164afd-6925-497b-9442-1d8440a917ca tempest-VolumeAndVolumeTypeFromImageTest-247040431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3015e149-a95b-4f1b-b3a9-9e62fa936329 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:17 devstack sudo[106725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3015e149-a95b-4f1b-b3a9-9e62fa936329 1073741824 Sep 28 09:40:17 devstack sudo[106725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:17 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-a97c27d7-4acb-4de6-ada7-0d32169ae673 tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc42790d-98c5-4189-9c74-4d8c2369464b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06b7bbe5-9433-4698-b02a-c3a4fbb9415b', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:17 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-a97c27d7-4acb-4de6-ada7-0d32169ae673 tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe945b39-969e-468c-9a36-4e1af1625ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:17 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-a97c27d7-4acb-4de6-ada7-0d32169ae673 tempest-ProjectMemberTests-186690331 None] Volume volume-06b7bbe5-9433-4698-b02a-c3a4fbb9415b (06b7bbe5-9433-4698-b02a-c3a4fbb9415b): created successfully Sep 28 09:40:17 devstack sudo[106724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-665842bf-0a2e-4e7c-b462-8a30061231a0 Sep 28 09:40:17 devstack sudo[106724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:17 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-a97c27d7-4acb-4de6-ada7-0d32169ae673 tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe945b39-969e-468c-9a36-4e1af1625ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:17 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-a97c27d7-4acb-4de6-ada7-0d32169ae673 tempest-ProjectMemberTests-186690331 None] Flow 'volume_create_manager' (57de437f-7356-46df-8fb3-1e9362c1c24a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:40:17 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cd3b28c-0727-481c-9267-48e9329dd75c tempest-VolumeDependencyTests-227757527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:40:17 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-a97c27d7-4acb-4de6-ada7-0d32169ae673 tempest-ProjectMemberTests-186690331 None] Created volume successfully. Sep 28 09:40:17 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-6cd3b28c-0727-481c-9267-48e9329dd75c tempest-VolumeDependencyTests-227757527 None] Flow 'volume_create_manager' (eeb9c4a9-7cb6-4948-8676-50beecbddf7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:40:17 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-6cd3b28c-0727-481c-9267-48e9329dd75c tempest-VolumeDependencyTests-227757527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e38bedf8-62c0-4f6a-84d8-1a7405fa91f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:17 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-6cd3b28c-0727-481c-9267-48e9329dd75c tempest-VolumeDependencyTests-227757527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e38bedf8-62c0-4f6a-84d8-1a7405fa91f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:40:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1332513986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0d20a89-8a1e-4783-97e5-c48271be9916,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8284c11562c04297924d501b3a8cf842',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:40:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8d1eff2d-0ebb-4bf2-8ffd-1f1fef7f4631,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:40:18Z,use_quota=True,user_id='fee80bcd04f54a19a5d0178f938343eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:17 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-6cd3b28c-0727-481c-9267-48e9329dd75c tempest-VolumeDependencyTests-227757527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (024209c5-21f0-4aeb-add7-6acf90e36351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:17 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-6cd3b28c-0727-481c-9267-48e9329dd75c tempest-VolumeDependencyTests-227757527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (024209c5-21f0-4aeb-add7-6acf90e36351) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:17 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-6cd3b28c-0727-481c-9267-48e9329dd75c tempest-VolumeDependencyTests-227757527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (168feb0a-e7b5-4230-bc80-0f987c39bace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:17 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-6cd3b28c-0727-481c-9267-48e9329dd75c tempest-VolumeDependencyTests-227757527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (168feb0a-e7b5-4230-bc80-0f987c39bace) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b0d20a89-8a1e-4783-97e5-c48271be9916', 'volume_name': 'volume-b0d20a89-8a1e-4783-97e5-c48271be9916', 'volume_size': 1, 'snapshot_id': '8d1eff2d-0ebb-4bf2-8ffd-1f1fef7f4631'}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:17 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-6cd3b28c-0727-481c-9267-48e9329dd75c tempest-VolumeDependencyTests-227757527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48d238ef-1e4b-4c4c-ac98-678939075805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:17 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-6cd3b28c-0727-481c-9267-48e9329dd75c tempest-VolumeDependencyTests-227757527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48d238ef-1e4b-4c4c-ac98-678939075805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:17 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-6cd3b28c-0727-481c-9267-48e9329dd75c tempest-VolumeDependencyTests-227757527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6ceb5ab-8175-45f3-8c3d-37855587b84b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:17 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-6cd3b28c-0727-481c-9267-48e9329dd75c tempest-VolumeDependencyTests-227757527 None] Volume b0d20a89-8a1e-4783-97e5-c48271be9916: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b0d20a89-8a1e-4783-97e5-c48271be9916', 'volume_size': 1, 'snapshot_id': '8d1eff2d-0ebb-4bf2-8ffd-1f1fef7f4631'} Sep 28 09:40:17 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-6cd3b28c-0727-481c-9267-48e9329dd75c tempest-VolumeDependencyTests-227757527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:40:17 devstack sudo[106724]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:17 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c32cdc6a-85e4-43ec-8d4a-5a34a16f9684 tempest-CreateVolumesFromImageTest-299095373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-665842bf-0a2e-4e7c-b462-8a30061231a0" returned: 0 in 0.383s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:17 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c32cdc6a-85e4-43ec-8d4a-5a34a16f9684 tempest-CreateVolumesFromImageTest-299095373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-665842bf-0a2e-4e7c-b462-8a30061231a0 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:17 devstack sudo[106735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-665842bf-0a2e-4e7c-b462-8a30061231a0 Sep 28 09:40:17 devstack sudo[106735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:18 devstack sudo[106725]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:18 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-75164afd-6925-497b-9442-1d8440a917ca tempest-VolumeAndVolumeTypeFromImageTest-247040431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3015e149-a95b-4f1b-b3a9-9e62fa936329 1073741824" returned: 0 in 0.454s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:18 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-75164afd-6925-497b-9442-1d8440a917ca tempest-VolumeAndVolumeTypeFromImageTest-247040431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3015e149-a95b-4f1b-b3a9-9e62fa936329 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:18 devstack sudo[106738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3015e149-a95b-4f1b-b3a9-9e62fa936329 Sep 28 09:40:18 devstack sudo[106738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:18 devstack sudo[106735]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:18 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c32cdc6a-85e4-43ec-8d4a-5a34a16f9684 tempest-CreateVolumesFromImageTest-299095373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-665842bf-0a2e-4e7c-b462-8a30061231a0" returned: 0 in 0.268s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:18 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-c32cdc6a-85e4-43ec-8d4a-5a34a16f9684 tempest-CreateVolumesFromImageTest-299095373 None] Lock "cinder-quobyte-665842bf-0a2e-4e7c-b462-8a30061231a0" released by "delete_volume" :: held 0.713s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:40:18 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-c32cdc6a-85e4-43ec-8d4a-5a34a16f9684 tempest-CreateVolumesFromImageTest-299095373 None] Created reservations ['627de2ca-572d-4f1d-a3f0-34f4d6bf2fa1', '845a8ea9-298e-43fa-a6c0-cc4d500425dd', 'dd5f5cc3-de38-4859-8aea-3d8d184c3743', '02edbcde-d164-41e3-b5de-baa686aefb51'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:40:18 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-c32cdc6a-85e4-43ec-8d4a-5a34a16f9684 tempest-CreateVolumesFromImageTest-299095373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:40:18 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-c32cdc6a-85e4-43ec-8d4a-5a34a16f9684 tempest-CreateVolumesFromImageTest-299095373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:40:18 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-c32cdc6a-85e4-43ec-8d4a-5a34a16f9684 tempest-CreateVolumesFromImageTest-299095373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:40:18 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-c32cdc6a-85e4-43ec-8d4a-5a34a16f9684 tempest-CreateVolumesFromImageTest-299095373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:40:18 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-c32cdc6a-85e4-43ec-8d4a-5a34a16f9684 tempest-CreateVolumesFromImageTest-299095373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:40:18 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c32cdc6a-85e4-43ec-8d4a-5a34a16f9684 tempest-CreateVolumesFromImageTest-299095373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:18 devstack sudo[106742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:40:18 devstack sudo[106742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:18 devstack sudo[106738]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:18 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-75164afd-6925-497b-9442-1d8440a917ca tempest-VolumeAndVolumeTypeFromImageTest-247040431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3015e149-a95b-4f1b-b3a9-9e62fa936329" returned: 0 in 0.311s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:18 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-75164afd-6925-497b-9442-1d8440a917ca tempest-VolumeAndVolumeTypeFromImageTest-247040431 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:40:18 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-75164afd-6925-497b-9442-1d8440a917ca tempest-VolumeAndVolumeTypeFromImageTest-247040431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:40:18 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-6cd3b28c-0727-481c-9267-48e9329dd75c tempest-VolumeDependencyTests-227757527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.615s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:40:18 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-6cd3b28c-0727-481c-9267-48e9329dd75c tempest-VolumeDependencyTests-227757527 None] Acquiring lock "cinder-quobyte-8d1eff2d-0ebb-4bf2-8ffd-1f1fef7f4631-b0d20a89-8a1e-4783-97e5-c48271be9916" by "_create_volume_from_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:40:18 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-6cd3b28c-0727-481c-9267-48e9329dd75c tempest-VolumeDependencyTests-227757527 None] Lock "cinder-quobyte-8d1eff2d-0ebb-4bf2-8ffd-1f1fef7f4631-b0d20a89-8a1e-4783-97e5-c48271be9916" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:40:18 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-6cd3b28c-0727-481c-9267-48e9329dd75c tempest-VolumeDependencyTests-227757527 None] Creating volume b0d20a89-8a1e-4783-97e5-c48271be9916 from snapshot 8d1eff2d-0ebb-4bf2-8ffd-1f1fef7f4631 {{(pid=86553) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 09:40:18 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-6cd3b28c-0727-481c-9267-48e9329dd75c tempest-VolumeDependencyTests-227757527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:40:18 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-6cd3b28c-0727-481c-9267-48e9329dd75c tempest-VolumeDependencyTests-227757527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:40:18 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-6cd3b28c-0727-481c-9267-48e9329dd75c tempest-VolumeDependencyTests-227757527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:40:18 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-6cd3b28c-0727-481c-9267-48e9329dd75c tempest-VolumeDependencyTests-227757527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:40:18 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-6cd3b28c-0727-481c-9267-48e9329dd75c tempest-VolumeDependencyTests-227757527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:40:18 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-6cd3b28c-0727-481c-9267-48e9329dd75c tempest-VolumeDependencyTests-227757527 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:40:18 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-6cd3b28c-0727-481c-9267-48e9329dd75c tempest-VolumeDependencyTests-227757527 None] Acquiring lock "cinder-quobyte-b0d20a89-8a1e-4783-97e5-c48271be9916" by "_copy_volume_from_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:40:18 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-6cd3b28c-0727-481c-9267-48e9329dd75c tempest-VolumeDependencyTests-227757527 None] Lock "cinder-quobyte-b0d20a89-8a1e-4783-97e5-c48271be9916" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:40:18 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-6cd3b28c-0727-481c-9267-48e9329dd75c tempest-VolumeDependencyTests-227757527 None] snapshot: 8d1eff2d-0ebb-4bf2-8ffd-1f1fef7f4631, volume: b0d20a89-8a1e-4783-97e5-c48271be9916, {{(pid=86553) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 09:40:18 devstack cinder-volume[86553]: DEBUG cinder.volume.volume_utils [None req-75164afd-6925-497b-9442-1d8440a917ca tempest-VolumeAndVolumeTypeFromImageTest-247040431 None] Attempting download of 3e30182a-f8a9-4652-9b57-86390ca167c0 ((None, [{'url': 'file:///opt/stack/data/glance/images/3e30182a-f8a9-4652-9b57-86390ca167c0', 'metadata': {}}])) to volume 3015e149-a95b-4f1b-b3a9-9e62fa936329. {{(pid=86553) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 09:40:18 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-6cd3b28c-0727-481c-9267-48e9329dd75c tempest-VolumeDependencyTests-227757527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:40:18 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-6cd3b28c-0727-481c-9267-48e9329dd75c tempest-VolumeDependencyTests-227757527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:40:18 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-6cd3b28c-0727-481c-9267-48e9329dd75c tempest-VolumeDependencyTests-227757527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:40:18 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-6cd3b28c-0727-481c-9267-48e9329dd75c tempest-VolumeDependencyTests-227757527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:40:18 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-6cd3b28c-0727-481c-9267-48e9329dd75c tempest-VolumeDependencyTests-227757527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:40:18 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[af0a44ac-49a6-4cc1-8a9d-689b3a7f9b2d]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:40:18 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef7adcf-35f2-42ad-b0d9-649d748c22cf]: (4, 'raw') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:40:18 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-6cd3b28c-0727-481c-9267-48e9329dd75c tempest-VolumeDependencyTests-227757527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c94b30a9-8c03-4988-806c-5d173f02cb9e.8d1eff2d-0ebb-4bf2-8ffd-1f1fef7f4631 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:18 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-75164afd-6925-497b-9442-1d8440a917ca tempest-VolumeAndVolumeTypeFromImageTest-247040431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3e30182a-f8a9-4652-9b57-86390ca167c0_0o3dfxyu {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:18 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-04fa1c9f-d6cc-4da0-9a91-bd173a0d3c2c tempest-CreateVolumesFromImageTest-299095373 None] Acquiring lock "cinder-03411c80-24d2-48cb-ba94-eee3f807554b-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:40:18 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-60756987-bab6-44be-9533-04edb5ea7e16 tempest-ProjectMemberTests-186690331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:40:18 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-04fa1c9f-d6cc-4da0-9a91-bd173a0d3c2c tempest-CreateVolumesFromImageTest-299095373 None] Lock "cinder-03411c80-24d2-48cb-ba94-eee3f807554b-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:40:18 devstack sudo[106742]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:18 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c32cdc6a-85e4-43ec-8d4a-5a34a16f9684 tempest-CreateVolumesFromImageTest-299095373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.375s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:18 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-c32cdc6a-85e4-43ec-8d4a-5a34a16f9684 tempest-CreateVolumesFromImageTest-299095373 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:40:18 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-c32cdc6a-85e4-43ec-8d4a-5a34a16f9684 tempest-CreateVolumesFromImageTest-299095373 None] Deleted volume successfully. Sep 28 09:40:18 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-04fa1c9f-d6cc-4da0-9a91-bd173a0d3c2c tempest-CreateVolumesFromImageTest-299095373 None] Acquiring lock "cinder-quobyte-03411c80-24d2-48cb-ba94-eee3f807554b" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:40:18 devstack sudo[106744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c94b30a9-8c03-4988-806c-5d173f02cb9e.8d1eff2d-0ebb-4bf2-8ffd-1f1fef7f4631 Sep 28 09:40:18 devstack sudo[106744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:18 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-c32cdc6a-85e4-43ec-8d4a-5a34a16f9684 tempest-CreateVolumesFromImageTest-299095373 None] Lock "cinder-665842bf-0a2e-4e7c-b462-8a30061231a0-delete_volume" released by "delete_volume" :: held 1.365s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:40:18 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-04fa1c9f-d6cc-4da0-9a91-bd173a0d3c2c tempest-CreateVolumesFromImageTest-299095373 None] Lock "cinder-quobyte-03411c80-24d2-48cb-ba94-eee3f807554b" acquired by "delete_volume" :: waited 0.028s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:40:18 devstack sudo[106745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3e30182a-f8a9-4652-9b57-86390ca167c0_0o3dfxyu Sep 28 09:40:18 devstack sudo[106745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:18 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[911283ca-f4e1-4da4-8e56-37a8991018e8]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:40:18 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-04fa1c9f-d6cc-4da0-9a91-bd173a0d3c2c tempest-CreateVolumesFromImageTest-299095373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-03411c80-24d2-48cb-ba94-eee3f807554b {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:18 devstack sudo[106749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-03411c80-24d2-48cb-ba94-eee3f807554b Sep 28 09:40:18 devstack sudo[106749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:19 devstack sudo[106745]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:19 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-75164afd-6925-497b-9442-1d8440a917ca tempest-VolumeAndVolumeTypeFromImageTest-247040431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3e30182a-f8a9-4652-9b57-86390ca167c0_0o3dfxyu" returned: 0 in 0.410s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:19 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-75164afd-6925-497b-9442-1d8440a917ca tempest-VolumeAndVolumeTypeFromImageTest-247040431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3e30182a-f8a9-4652-9b57-86390ca167c0_0o3dfxyu {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:19 devstack sudo[106744]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:19 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-6cd3b28c-0727-481c-9267-48e9329dd75c tempest-VolumeDependencyTests-227757527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c94b30a9-8c03-4988-806c-5d173f02cb9e.8d1eff2d-0ebb-4bf2-8ffd-1f1fef7f4631" returned: 0 in 0.447s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:19 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-6cd3b28c-0727-481c-9267-48e9329dd75c tempest-VolumeDependencyTests-227757527 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c94b30a9-8c03-4988-806c-5d173f02cb9e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86553) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 09:40:19 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[6712c0c1-cf25-4d16-aa46-8b26035133d2]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:40:19 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-6cd3b28c-0727-481c-9267-48e9329dd75c tempest-VolumeDependencyTests-227757527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c94b30a9-8c03-4988-806c-5d173f02cb9e {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:19 devstack sudo[106756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3e30182a-f8a9-4652-9b57-86390ca167c0_0o3dfxyu Sep 28 09:40:19 devstack sudo[106756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:19 devstack sudo[106758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c94b30a9-8c03-4988-806c-5d173f02cb9e Sep 28 09:40:19 devstack sudo[106758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:19 devstack sudo[106749]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:19 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-04fa1c9f-d6cc-4da0-9a91-bd173a0d3c2c tempest-CreateVolumesFromImageTest-299095373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-03411c80-24d2-48cb-ba94-eee3f807554b" returned: 0 in 0.441s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:19 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-04fa1c9f-d6cc-4da0-9a91-bd173a0d3c2c tempest-CreateVolumesFromImageTest-299095373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-03411c80-24d2-48cb-ba94-eee3f807554b {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:19 devstack sudo[106765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-03411c80-24d2-48cb-ba94-eee3f807554b Sep 28 09:40:19 devstack sudo[106765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:19 devstack sudo[106756]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:19 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-75164afd-6925-497b-9442-1d8440a917ca tempest-VolumeAndVolumeTypeFromImageTest-247040431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3e30182a-f8a9-4652-9b57-86390ca167c0_0o3dfxyu" returned: 1 in 0.384s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:19 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-75164afd-6925-497b-9442-1d8440a917ca tempest-VolumeAndVolumeTypeFromImageTest-247040431 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3e30182a-f8a9-4652-9b57-86390ca167c0_0o3dfxyu' failed. Not Retrying. {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 09:40:19 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a8dfdc3-b5bd-4d8d-a487-3a92f48d0abd]: (4, 'raw') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:40:19 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-75164afd-6925-497b-9442-1d8440a917ca tempest-VolumeAndVolumeTypeFromImageTest-247040431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3e30182a-f8a9-4652-9b57-86390ca167c0_fp8z2cvudevstack@QuobyteHD {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:19 devstack sudo[106758]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:19 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-6cd3b28c-0727-481c-9267-48e9329dd75c tempest-VolumeDependencyTests-227757527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c94b30a9-8c03-4988-806c-5d173f02cb9e" returned: 0 in 0.439s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:19 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-6cd3b28c-0727-481c-9267-48e9329dd75c tempest-VolumeDependencyTests-227757527 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c94b30a9-8c03-4988-806c-5d173f02cb9e {{(pid=86553) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 09:40:19 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-6cd3b28c-0727-481c-9267-48e9329dd75c tempest-VolumeDependencyTests-227757527 None] Creating direct copy from snapshot {{(pid=86553) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 09:40:19 devstack cinder-volume[86553]: DEBUG cinder.utils [None req-6cd3b28c-0727-481c-9267-48e9329dd75c tempest-VolumeDependencyTests-227757527 None] Path /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b0d20a89-8a1e-4783-97e5-c48271be9916 not found in is_blk_device check {{(pid=86553) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 09:40:19 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-6cd3b28c-0727-481c-9267-48e9329dd75c tempest-VolumeDependencyTests-227757527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c94b30a9-8c03-4988-806c-5d173f02cb9e /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b0d20a89-8a1e-4783-97e5-c48271be9916 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:19 devstack sudo[106765]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:19 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-04fa1c9f-d6cc-4da0-9a91-bd173a0d3c2c tempest-CreateVolumesFromImageTest-299095373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-03411c80-24d2-48cb-ba94-eee3f807554b" returned: 0 in 0.292s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:19 devstack sudo[106774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c94b30a9-8c03-4988-806c-5d173f02cb9e /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b0d20a89-8a1e-4783-97e5-c48271be9916 Sep 28 09:40:19 devstack sudo[106774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:19 devstack sudo[106771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3e30182a-f8a9-4652-9b57-86390ca167c0_fp8z2cvudevstack@QuobyteHD Sep 28 09:40:19 devstack sudo[106771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:19 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-04fa1c9f-d6cc-4da0-9a91-bd173a0d3c2c tempest-CreateVolumesFromImageTest-299095373 None] Lock "cinder-quobyte-03411c80-24d2-48cb-ba94-eee3f807554b" released by "delete_volume" :: held 0.785s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:40:19 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-04fa1c9f-d6cc-4da0-9a91-bd173a0d3c2c tempest-CreateVolumesFromImageTest-299095373 None] Created reservations ['91b669f5-ab25-43e2-a18c-8c0f1a5fec6f', '85eecad9-cfcf-4a9e-804e-d989651b6f80', '8ccc66d2-20be-4120-ba84-ed8f24bd1389', '191ca9ad-a2a8-4dae-bcb5-8d0ae12d0f93'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:40:19 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-04fa1c9f-d6cc-4da0-9a91-bd173a0d3c2c tempest-CreateVolumesFromImageTest-299095373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:40:19 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-04fa1c9f-d6cc-4da0-9a91-bd173a0d3c2c tempest-CreateVolumesFromImageTest-299095373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:40:19 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-04fa1c9f-d6cc-4da0-9a91-bd173a0d3c2c tempest-CreateVolumesFromImageTest-299095373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:40:19 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-04fa1c9f-d6cc-4da0-9a91-bd173a0d3c2c tempest-CreateVolumesFromImageTest-299095373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:40:19 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-04fa1c9f-d6cc-4da0-9a91-bd173a0d3c2c tempest-CreateVolumesFromImageTest-299095373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:40:19 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-04fa1c9f-d6cc-4da0-9a91-bd173a0d3c2c tempest-CreateVolumesFromImageTest-299095373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:19 devstack sudo[106777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:40:19 devstack sudo[106777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:19 devstack sudo[106771]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:19 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-75164afd-6925-497b-9442-1d8440a917ca tempest-VolumeAndVolumeTypeFromImageTest-247040431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3e30182a-f8a9-4652-9b57-86390ca167c0_fp8z2cvudevstack@QuobyteHD" returned: 0 in 0.411s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:19 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-75164afd-6925-497b-9442-1d8440a917ca tempest-VolumeAndVolumeTypeFromImageTest-247040431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3e30182a-f8a9-4652-9b57-86390ca167c0_fp8z2cvudevstack@QuobyteHD {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:19 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-fdbeae33-cebd-48d9-92ee-c0b70240773c tempest-CreateVolumesFromImageTest-299095373 None] Acquiring lock "cinder-c6848fe0-4faf-4a47-b4a8-76a998729c55-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:40:19 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-fdbeae33-cebd-48d9-92ee-c0b70240773c tempest-CreateVolumesFromImageTest-299095373 None] Lock "cinder-c6848fe0-4faf-4a47-b4a8-76a998729c55-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:40:19 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-fdbeae33-cebd-48d9-92ee-c0b70240773c tempest-CreateVolumesFromImageTest-299095373 None] Acquiring lock "cinder-quobyte-c6848fe0-4faf-4a47-b4a8-76a998729c55" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:40:20 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-fdbeae33-cebd-48d9-92ee-c0b70240773c tempest-CreateVolumesFromImageTest-299095373 None] Lock "cinder-quobyte-c6848fe0-4faf-4a47-b4a8-76a998729c55" acquired by "delete_volume" :: waited 0.019s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:40:20 devstack sudo[106777]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-04fa1c9f-d6cc-4da0-9a91-bd173a0d3c2c tempest-CreateVolumesFromImageTest-299095373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.306s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:20 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-04fa1c9f-d6cc-4da0-9a91-bd173a0d3c2c tempest-CreateVolumesFromImageTest-299095373 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:40:20 devstack sudo[106784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3e30182a-f8a9-4652-9b57-86390ca167c0_fp8z2cvudevstack@QuobyteHD Sep 28 09:40:20 devstack sudo[106784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:20 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-04fa1c9f-d6cc-4da0-9a91-bd173a0d3c2c tempest-CreateVolumesFromImageTest-299095373 None] Deleted volume successfully. Sep 28 09:40:20 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ca59b8-f39c-4074-80c4-919a04b512c9]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:40:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-fdbeae33-cebd-48d9-92ee-c0b70240773c tempest-CreateVolumesFromImageTest-299095373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c6848fe0-4faf-4a47-b4a8-76a998729c55 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:20 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-04fa1c9f-d6cc-4da0-9a91-bd173a0d3c2c tempest-CreateVolumesFromImageTest-299095373 None] Lock "cinder-03411c80-24d2-48cb-ba94-eee3f807554b-delete_volume" released by "delete_volume" :: held 1.362s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:40:20 devstack sudo[106787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c6848fe0-4faf-4a47-b4a8-76a998729c55 Sep 28 09:40:20 devstack sudo[106787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:20 devstack sudo[106784]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-75164afd-6925-497b-9442-1d8440a917ca tempest-VolumeAndVolumeTypeFromImageTest-247040431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3e30182a-f8a9-4652-9b57-86390ca167c0_fp8z2cvudevstack@QuobyteHD" returned: 1 in 0.539s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-75164afd-6925-497b-9442-1d8440a917ca tempest-VolumeAndVolumeTypeFromImageTest-247040431 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3e30182a-f8a9-4652-9b57-86390ca167c0_fp8z2cvudevstack@QuobyteHD' failed. Not Retrying. {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 09:40:20 devstack cinder-volume[86553]: DEBUG cinder.image.image_utils [None req-75164afd-6925-497b-9442-1d8440a917ca tempest-VolumeAndVolumeTypeFromImageTest-247040431 None] 3e30182a-f8a9-4652-9b57-86390ca167c0 was raw, converting to qcow2 {{(pid=86553) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 09:40:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-75164afd-6925-497b-9442-1d8440a917ca tempest-VolumeAndVolumeTypeFromImageTest-247040431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3e30182a-f8a9-4652-9b57-86390ca167c0_fp8z2cvudevstack@QuobyteHD /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3015e149-a95b-4f1b-b3a9-9e62fa936329 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:20 devstack sudo[106799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3e30182a-f8a9-4652-9b57-86390ca167c0_fp8z2cvudevstack@QuobyteHD /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3015e149-a95b-4f1b-b3a9-9e62fa936329 Sep 28 09:40:20 devstack sudo[106799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:20 devstack sudo[106787]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-fdbeae33-cebd-48d9-92ee-c0b70240773c tempest-CreateVolumesFromImageTest-299095373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c6848fe0-4faf-4a47-b4a8-76a998729c55" returned: 0 in 0.585s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-fdbeae33-cebd-48d9-92ee-c0b70240773c tempest-CreateVolumesFromImageTest-299095373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c6848fe0-4faf-4a47-b4a8-76a998729c55 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:20 devstack sudo[106804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c6848fe0-4faf-4a47-b4a8-76a998729c55 Sep 28 09:40:20 devstack sudo[106804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:21 devstack sudo[106804]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-fdbeae33-cebd-48d9-92ee-c0b70240773c tempest-CreateVolumesFromImageTest-299095373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c6848fe0-4faf-4a47-b4a8-76a998729c55" returned: 0 in 0.649s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:21 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-fdbeae33-cebd-48d9-92ee-c0b70240773c tempest-CreateVolumesFromImageTest-299095373 None] Lock "cinder-quobyte-c6848fe0-4faf-4a47-b4a8-76a998729c55" released by "delete_volume" :: held 1.318s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:40:21 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-fdbeae33-cebd-48d9-92ee-c0b70240773c tempest-CreateVolumesFromImageTest-299095373 None] Created reservations ['e714fe9b-3d25-4c44-8e23-57d3b2b2e8f7', 'd64def53-7ee3-4b6c-935e-7ec22e300d6e', 'fd237e88-0668-4db3-9657-1e5c0edc2413', 'b2ad89bf-cc0f-40b4-bfaa-0029139769b5'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:40:21 devstack sudo[106799]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-75164afd-6925-497b-9442-1d8440a917ca tempest-VolumeAndVolumeTypeFromImageTest-247040431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3e30182a-f8a9-4652-9b57-86390ca167c0_fp8z2cvudevstack@QuobyteHD /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3015e149-a95b-4f1b-b3a9-9e62fa936329" returned: 0 in 1.097s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:21 devstack cinder-volume[86553]: DEBUG cinder.image.image_utils [None req-75164afd-6925-497b-9442-1d8440a917ca tempest-VolumeAndVolumeTypeFromImageTest-247040431 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3e30182a-f8a9-4652-9b57-86390ca167c0_fp8z2cvudevstack@QuobyteHD, size 0.00 MB, duration 1.10 sec, destination /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3015e149-a95b-4f1b-b3a9-9e62fa936329 {{(pid=86553) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 09:40:21 devstack cinder-volume[86553]: INFO cinder.image.image_utils [None req-75164afd-6925-497b-9442-1d8440a917ca tempest-VolumeAndVolumeTypeFromImageTest-247040431 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 09:40:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-75164afd-6925-497b-9442-1d8440a917ca tempest-VolumeAndVolumeTypeFromImageTest-247040431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3015e149-a95b-4f1b-b3a9-9e62fa936329 1G {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:21 devstack sudo[106811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3015e149-a95b-4f1b-b3a9-9e62fa936329 1G Sep 28 09:40:21 devstack sudo[106811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:21 devstack cinder-volume[86553]: DEBUG oslo_service.periodic_task [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86553) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 09:40:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:40:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:40:21 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:40:21 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:40:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:40:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-fdbeae33-cebd-48d9-92ee-c0b70240773c tempest-CreateVolumesFromImageTest-299095373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:40:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-fdbeae33-cebd-48d9-92ee-c0b70240773c tempest-CreateVolumesFromImageTest-299095373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:40:21 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-fdbeae33-cebd-48d9-92ee-c0b70240773c tempest-CreateVolumesFromImageTest-299095373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:40:21 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-fdbeae33-cebd-48d9-92ee-c0b70240773c tempest-CreateVolumesFromImageTest-299095373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:40:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-fdbeae33-cebd-48d9-92ee-c0b70240773c tempest-CreateVolumesFromImageTest-299095373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:40:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-fdbeae33-cebd-48d9-92ee-c0b70240773c tempest-CreateVolumesFromImageTest-299095373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:21 devstack sudo[106813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:40:21 devstack sudo[106813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:21 devstack sudo[106814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:40:21 devstack sudo[106814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:22 devstack sudo[106813]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:22 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.443s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:22 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:40:22 devstack cinder-volume[86553]: DEBUG oslo_service.periodic_task [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Running periodic task VolumeManager._thread_info {{(pid=86553) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 09:40:22 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] thread count: 28 {{(pid=86553) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 09:40:22 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] thread info: [<_MainThread(MainThread, started 134684877779072)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86553) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 09:40:22 devstack sudo[106811]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:22 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-75164afd-6925-497b-9442-1d8440a917ca tempest-VolumeAndVolumeTypeFromImageTest-247040431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3015e149-a95b-4f1b-b3a9-9e62fa936329 1G" returned: 0 in 0.620s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:22 devstack cinder-volume[86553]: DEBUG cinder.volume.volume_utils [None req-75164afd-6925-497b-9442-1d8440a917ca tempest-VolumeAndVolumeTypeFromImageTest-247040431 None] Downloaded image 3e30182a-f8a9-4652-9b57-86390ca167c0 ((None, [{'url': 'file:///opt/stack/data/glance/images/3e30182a-f8a9-4652-9b57-86390ca167c0', 'metadata': {}}])) to volume 3015e149-a95b-4f1b-b3a9-9e62fa936329 successfully. {{(pid=86553) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 09:40:22 devstack cinder-volume[86553]: DEBUG cinder.image.image_utils [None req-75164afd-6925-497b-9442-1d8440a917ca tempest-VolumeAndVolumeTypeFromImageTest-247040431 None] Temporary image 3e30182a-f8a9-4652-9b57-86390ca167c0 for user 2588e8a69510441faed9319af6bc80cd is deleted. {{(pid=86553) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 09:40:22 devstack cinder-volume[86553]: DEBUG cinder.volume.volume_utils [None req-75164afd-6925-497b-9442-1d8440a917ca tempest-VolumeAndVolumeTypeFromImageTest-247040431 None] Marking volume 3015e149-a95b-4f1b-b3a9-9e62fa936329 as bootable. {{(pid=86553) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 09:40:22 devstack sudo[106814]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:22 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-75164afd-6925-497b-9442-1d8440a917ca tempest-VolumeAndVolumeTypeFromImageTest-247040431 None] Copying metadata from image 3e30182a-f8a9-4652-9b57-86390ca167c0 to 3015e149-a95b-4f1b-b3a9-9e62fa936329. {{(pid=86553) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 09:40:22 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-75164afd-6925-497b-9442-1d8440a917ca tempest-VolumeAndVolumeTypeFromImageTest-247040431 None] Creating volume glance metadata for volume 3015e149-a95b-4f1b-b3a9-9e62fa936329 backed by image 3e30182a-f8a9-4652-9b57-86390ca167c0 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '3e30182a-f8a9-4652-9b57-86390ca167c0', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'cd74195b5785aa894a90165c24d84297', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86553) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 09:40:22 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-fdbeae33-cebd-48d9-92ee-c0b70240773c tempest-CreateVolumesFromImageTest-299095373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.506s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:22 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-fdbeae33-cebd-48d9-92ee-c0b70240773c tempest-CreateVolumesFromImageTest-299095373 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:40:22 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-fdbeae33-cebd-48d9-92ee-c0b70240773c tempest-CreateVolumesFromImageTest-299095373 None] Deleted volume successfully. Sep 28 09:40:22 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-fdbeae33-cebd-48d9-92ee-c0b70240773c tempest-CreateVolumesFromImageTest-299095373 None] Lock "cinder-c6848fe0-4faf-4a47-b4a8-76a998729c55-delete_volume" released by "delete_volume" :: held 2.257s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:40:22 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-75164afd-6925-497b-9442-1d8440a917ca tempest-VolumeAndVolumeTypeFromImageTest-247040431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fefab10e-8ad5-43dd-a4de-13ee989e3821) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3015e149-a95b-4f1b-b3a9-9e62fa936329', 'volume_size': 1, 'image_id': '3e30182a-f8a9-4652-9b57-86390ca167c0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3e30182a-f8a9-4652-9b57-86390ca167c0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cd74195b5785aa894a90165c24d84297', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e8d7c322716a4d028ac38472dfbcd58a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6c987648c634a5e64a1cfcc0e4c71137479c44c0fa8a8173d4a189e287d57fde31fc159c66b273eebc3b2a93a73c53130999d4eb1c199bd5335ffc30f59014f2', 'id': '3e30182a-f8a9-4652-9b57-86390ca167c0', 'created_at': datetime.datetime(2026, 9, 28, 7, 40, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 7, 40, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3e30182a-f8a9-4652-9b57-86390ca167c0/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:22 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-75164afd-6925-497b-9442-1d8440a917ca tempest-VolumeAndVolumeTypeFromImageTest-247040431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c92d4be-454e-4293-9a73-ef8e19b5f88e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:22 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-75164afd-6925-497b-9442-1d8440a917ca tempest-VolumeAndVolumeTypeFromImageTest-247040431 None] Volume volume-3015e149-a95b-4f1b-b3a9-9e62fa936329 (3015e149-a95b-4f1b-b3a9-9e62fa936329): created successfully Sep 28 09:40:22 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-75164afd-6925-497b-9442-1d8440a917ca tempest-VolumeAndVolumeTypeFromImageTest-247040431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c92d4be-454e-4293-9a73-ef8e19b5f88e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:22 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-75164afd-6925-497b-9442-1d8440a917ca tempest-VolumeAndVolumeTypeFromImageTest-247040431 None] Flow 'volume_create_manager' (f5355acf-b4d7-4fb8-b6a0-a0f616fa2e95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:40:22 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-75164afd-6925-497b-9442-1d8440a917ca tempest-VolumeAndVolumeTypeFromImageTest-247040431 None] Created volume successfully. Sep 28 09:40:23 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-d5d2981f-fe2f-49e3-af42-db96236c9214 tempest-VolumeAndVolumeTypeFromImageTest-247040431 None] Acquiring lock "cinder-3015e149-a95b-4f1b-b3a9-9e62fa936329-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:40:23 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-d5d2981f-fe2f-49e3-af42-db96236c9214 tempest-VolumeAndVolumeTypeFromImageTest-247040431 None] Lock "cinder-3015e149-a95b-4f1b-b3a9-9e62fa936329-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:40:23 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-d5d2981f-fe2f-49e3-af42-db96236c9214 tempest-VolumeAndVolumeTypeFromImageTest-247040431 None] Acquiring lock "cinder-quobyte-3015e149-a95b-4f1b-b3a9-9e62fa936329" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:40:23 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-d5d2981f-fe2f-49e3-af42-db96236c9214 tempest-VolumeAndVolumeTypeFromImageTest-247040431 None] Lock "cinder-quobyte-3015e149-a95b-4f1b-b3a9-9e62fa936329" acquired by "delete_volume" :: waited 0.032s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:40:23 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cac85e5-2d75-49a2-bd6b-98c1734df1aa]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:40:23 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-d5d2981f-fe2f-49e3-af42-db96236c9214 tempest-VolumeAndVolumeTypeFromImageTest-247040431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3015e149-a95b-4f1b-b3a9-9e62fa936329 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:23 devstack sudo[106823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3015e149-a95b-4f1b-b3a9-9e62fa936329 Sep 28 09:40:23 devstack sudo[106823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:24 devstack sudo[106823]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:24 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-d5d2981f-fe2f-49e3-af42-db96236c9214 tempest-VolumeAndVolumeTypeFromImageTest-247040431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3015e149-a95b-4f1b-b3a9-9e62fa936329" returned: 0 in 0.902s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:24 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-d5d2981f-fe2f-49e3-af42-db96236c9214 tempest-VolumeAndVolumeTypeFromImageTest-247040431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3015e149-a95b-4f1b-b3a9-9e62fa936329 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:24 devstack sudo[106830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3015e149-a95b-4f1b-b3a9-9e62fa936329 Sep 28 09:40:24 devstack sudo[106830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:24 devstack sudo[106830]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:24 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-d5d2981f-fe2f-49e3-af42-db96236c9214 tempest-VolumeAndVolumeTypeFromImageTest-247040431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-3015e149-a95b-4f1b-b3a9-9e62fa936329" returned: 0 in 0.516s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:24 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-d5d2981f-fe2f-49e3-af42-db96236c9214 tempest-VolumeAndVolumeTypeFromImageTest-247040431 None] Lock "cinder-quobyte-3015e149-a95b-4f1b-b3a9-9e62fa936329" released by "delete_volume" :: held 1.534s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:40:24 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-d5d2981f-fe2f-49e3-af42-db96236c9214 tempest-VolumeAndVolumeTypeFromImageTest-247040431 None] Created reservations ['4efc3c52-858f-4de1-85ac-727a16d2e538', '6347f157-2e26-4099-8e6a-265de3cb253a', '85f7f26a-2cd1-4708-97b8-feb5e2ae3610', 'a7ce17eb-06da-4b59-8504-460ea921a766'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:40:24 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-d5d2981f-fe2f-49e3-af42-db96236c9214 tempest-VolumeAndVolumeTypeFromImageTest-247040431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:40:24 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-d5d2981f-fe2f-49e3-af42-db96236c9214 tempest-VolumeAndVolumeTypeFromImageTest-247040431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:40:24 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-d5d2981f-fe2f-49e3-af42-db96236c9214 tempest-VolumeAndVolumeTypeFromImageTest-247040431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:40:24 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-d5d2981f-fe2f-49e3-af42-db96236c9214 tempest-VolumeAndVolumeTypeFromImageTest-247040431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:40:24 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-d5d2981f-fe2f-49e3-af42-db96236c9214 tempest-VolumeAndVolumeTypeFromImageTest-247040431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:40:24 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-d5d2981f-fe2f-49e3-af42-db96236c9214 tempest-VolumeAndVolumeTypeFromImageTest-247040431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:25 devstack sudo[106833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:40:25 devstack sudo[106833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:25 devstack sudo[106833]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:25 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-d5d2981f-fe2f-49e3-af42-db96236c9214 tempest-VolumeAndVolumeTypeFromImageTest-247040431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.462s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:25 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-d5d2981f-fe2f-49e3-af42-db96236c9214 tempest-VolumeAndVolumeTypeFromImageTest-247040431 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:40:25 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-d5d2981f-fe2f-49e3-af42-db96236c9214 tempest-VolumeAndVolumeTypeFromImageTest-247040431 None] Deleted volume successfully. Sep 28 09:40:25 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-d5d2981f-fe2f-49e3-af42-db96236c9214 tempest-VolumeAndVolumeTypeFromImageTest-247040431 None] Lock "cinder-3015e149-a95b-4f1b-b3a9-9e62fa936329-delete_volume" released by "delete_volume" :: held 2.438s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:40:27 devstack sudo[106774]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:27 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-6cd3b28c-0727-481c-9267-48e9329dd75c tempest-VolumeDependencyTests-227757527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c94b30a9-8c03-4988-806c-5d173f02cb9e /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b0d20a89-8a1e-4783-97e5-c48271be9916" returned: 0 in 8.415s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:27 devstack cinder-volume[86553]: DEBUG cinder.image.image_utils [None req-6cd3b28c-0727-481c-9267-48e9329dd75c tempest-VolumeDependencyTests-227757527 None] Image conversion details: src /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c94b30a9-8c03-4988-806c-5d173f02cb9e, size 1024.00 MB, duration 8.42 sec, destination /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b0d20a89-8a1e-4783-97e5-c48271be9916 {{(pid=86553) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 09:40:27 devstack cinder-volume[86553]: INFO cinder.image.image_utils [None req-6cd3b28c-0727-481c-9267-48e9329dd75c tempest-VolumeDependencyTests-227757527 None] Converted 1024.00 MB image at 121.67 MB/s Sep 28 09:40:27 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-6cd3b28c-0727-481c-9267-48e9329dd75c tempest-VolumeDependencyTests-227757527 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b0d20a89-8a1e-4783-97e5-c48271be9916 is being set with open permissions: ugo+rw Sep 28 09:40:27 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-6cd3b28c-0727-481c-9267-48e9329dd75c tempest-VolumeDependencyTests-227757527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b0d20a89-8a1e-4783-97e5-c48271be9916 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:27 devstack sudo[106872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b0d20a89-8a1e-4783-97e5-c48271be9916 Sep 28 09:40:27 devstack sudo[106872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:28 devstack sudo[106872]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:28 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-6cd3b28c-0727-481c-9267-48e9329dd75c tempest-VolumeDependencyTests-227757527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b0d20a89-8a1e-4783-97e5-c48271be9916" returned: 0 in 0.254s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:28 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-6cd3b28c-0727-481c-9267-48e9329dd75c tempest-VolumeDependencyTests-227757527 None] Lock "cinder-quobyte-b0d20a89-8a1e-4783-97e5-c48271be9916" released by "_copy_volume_from_snapshot" :: held 9.746s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:40:28 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-6cd3b28c-0727-481c-9267-48e9329dd75c tempest-VolumeDependencyTests-227757527 None] Lock "cinder-quobyte-8d1eff2d-0ebb-4bf2-8ffd-1f1fef7f4631-b0d20a89-8a1e-4783-97e5-c48271be9916" released by "_create_volume_from_snapshot" :: held 9.840s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:40:28 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-6cd3b28c-0727-481c-9267-48e9329dd75c tempest-VolumeDependencyTests-227757527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.863s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:40:28 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-60756987-bab6-44be-9533-04edb5ea7e16 tempest-ProjectMemberTests-186690331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.583s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:40:28 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-60756987-bab6-44be-9533-04edb5ea7e16 tempest-ProjectMemberTests-186690331 None] Creating offline snapshot 2b00bfec-40ff-41da-83e0-8c202ddf24d3 of volume 06b7bbe5-9433-4698-b02a-c3a4fbb9415b {{(pid=86553) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 09:40:28 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-6cd3b28c-0727-481c-9267-48e9329dd75c tempest-VolumeDependencyTests-227757527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6ceb5ab-8175-45f3-8c3d-37855587b84b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0d20a89-8a1e-4783-97e5-c48271be9916', 'volume_size': 1, 'snapshot_id': '8d1eff2d-0ebb-4bf2-8ffd-1f1fef7f4631'}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:28 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-6cd3b28c-0727-481c-9267-48e9329dd75c tempest-VolumeDependencyTests-227757527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a00857d9-c997-4b00-abf4-7707ada32f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:28 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b88ecb-4ef1-4ff3-98cb-f3e271a25372]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:40:28 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-60756987-bab6-44be-9533-04edb5ea7e16 tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-06b7bbe5-9433-4698-b02a-c3a4fbb9415b {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:28 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-6cd3b28c-0727-481c-9267-48e9329dd75c tempest-VolumeDependencyTests-227757527 None] Volume volume-b0d20a89-8a1e-4783-97e5-c48271be9916 (b0d20a89-8a1e-4783-97e5-c48271be9916): created successfully Sep 28 09:40:28 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-6cd3b28c-0727-481c-9267-48e9329dd75c tempest-VolumeDependencyTests-227757527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a00857d9-c997-4b00-abf4-7707ada32f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:28 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-6cd3b28c-0727-481c-9267-48e9329dd75c tempest-VolumeDependencyTests-227757527 None] Flow 'volume_create_manager' (eeb9c4a9-7cb6-4948-8676-50beecbddf7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:40:28 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-6cd3b28c-0727-481c-9267-48e9329dd75c tempest-VolumeDependencyTests-227757527 None] Created volume successfully. Sep 28 09:40:28 devstack sudo[106876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-06b7bbe5-9433-4698-b02a-c3a4fbb9415b Sep 28 09:40:28 devstack sudo[106876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:28 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-817f958d-ecff-445f-9678-557c907b854b tempest-VolumeDependencyTests-227757527 None] Acquiring lock "cinder-8d1eff2d-0ebb-4bf2-8ffd-1f1fef7f4631-delete_snapshot" by "delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:40:28 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-43caab69-db84-4893-ada6-3e0daadb4dd0 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:40:28 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-43caab69-db84-4893-ada6-3e0daadb4dd0 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Flow 'volume_create_manager' (8ecfc11c-c40b-4821-904e-5ed6fff45a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:40:28 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-43caab69-db84-4893-ada6-3e0daadb4dd0 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (163c7c8d-d8ae-4df1-8d87-48d994681cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:28 devstack sudo[106876]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:28 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-817f958d-ecff-445f-9678-557c907b854b tempest-VolumeDependencyTests-227757527 None] Lock "cinder-8d1eff2d-0ebb-4bf2-8ffd-1f1fef7f4631-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:40:28 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-817f958d-ecff-445f-9678-557c907b854b tempest-VolumeDependencyTests-227757527 None] Acquiring lock "cinder-quobyte-c94b30a9-8c03-4988-806c-5d173f02cb9e" by "delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:40:28 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-60756987-bab6-44be-9533-04edb5ea7e16 tempest-ProjectMemberTests-186690331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-06b7bbe5-9433-4698-b02a-c3a4fbb9415b" returned: 0 in 0.489s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:28 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-60756987-bab6-44be-9533-04edb5ea7e16 tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-06b7bbe5-9433-4698-b02a-c3a4fbb9415b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-06b7bbe5-9433-4698-b02a-c3a4fbb9415b.2b00bfec-40ff-41da-83e0-8c202ddf24d3 1G {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:28 devstack sudo[106881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-06b7bbe5-9433-4698-b02a-c3a4fbb9415b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-06b7bbe5-9433-4698-b02a-c3a4fbb9415b.2b00bfec-40ff-41da-83e0-8c202ddf24d3 1G Sep 28 09:40:28 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-43caab69-db84-4893-ada6-3e0daadb4dd0 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (163c7c8d-d8ae-4df1-8d87-48d994681cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:40:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-477041141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1746e80c-66c0-4799-83e8-63f25f7db499,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3a018ea1a7f443f995907f85fbd4e20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:40:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:40:29Z,use_quota=True,user_id='f742cd667c1449578c5b6c6cd8bfca09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:28 devstack sudo[106881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:28 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-43caab69-db84-4893-ada6-3e0daadb4dd0 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e902ad9-ac66-4964-b90c-c58e16cab9ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:28 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-43caab69-db84-4893-ada6-3e0daadb4dd0 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e902ad9-ac66-4964-b90c-c58e16cab9ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:28 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-43caab69-db84-4893-ada6-3e0daadb4dd0 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bf61ced-7208-4594-8333-4ec564b6d0c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:28 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-43caab69-db84-4893-ada6-3e0daadb4dd0 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bf61ced-7208-4594-8333-4ec564b6d0c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1746e80c-66c0-4799-83e8-63f25f7db499', 'volume_name': 'volume-1746e80c-66c0-4799-83e8-63f25f7db499', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:28 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-43caab69-db84-4893-ada6-3e0daadb4dd0 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3669c292-fd55-43b5-abdf-d370e54ce9d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:28 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-43caab69-db84-4893-ada6-3e0daadb4dd0 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3669c292-fd55-43b5-abdf-d370e54ce9d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:28 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-43caab69-db84-4893-ada6-3e0daadb4dd0 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef5ece62-1328-4e13-be08-47ed05bfb6e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:28 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-43caab69-db84-4893-ada6-3e0daadb4dd0 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Volume 1746e80c-66c0-4799-83e8-63f25f7db499: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1746e80c-66c0-4799-83e8-63f25f7db499', 'volume_size': 1} Sep 28 09:40:28 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-43caab69-db84-4893-ada6-3e0daadb4dd0 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:40:28 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-817f958d-ecff-445f-9678-557c907b854b tempest-VolumeDependencyTests-227757527 None] Lock "cinder-quobyte-c94b30a9-8c03-4988-806c-5d173f02cb9e" acquired by "delete_snapshot" :: waited 0.076s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:40:28 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-817f958d-ecff-445f-9678-557c907b854b tempest-VolumeDependencyTests-227757527 None] Acquiring lock "cinder-quobyte-8d1eff2d-0ebb-4bf2-8ffd-1f1fef7f4631" by "_delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:40:28 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-817f958d-ecff-445f-9678-557c907b854b tempest-VolumeDependencyTests-227757527 None] Lock "cinder-quobyte-8d1eff2d-0ebb-4bf2-8ffd-1f1fef7f4631" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:40:28 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-817f958d-ecff-445f-9678-557c907b854b tempest-VolumeDependencyTests-227757527 None] Deleting offline snapshot 8d1eff2d-0ebb-4bf2-8ffd-1f1fef7f4631 of volume c94b30a9-8c03-4988-806c-5d173f02cb9e {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 09:40:28 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-817f958d-ecff-445f-9678-557c907b854b tempest-VolumeDependencyTests-227757527 None] snapshot_file for this snap is: volume-c94b30a9-8c03-4988-806c-5d173f02cb9e.8d1eff2d-0ebb-4bf2-8ffd-1f1fef7f4631 {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 09:40:28 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba3cc295-06b8-420a-b805-98ce1c1188d5]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:40:28 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-817f958d-ecff-445f-9678-557c907b854b tempest-VolumeDependencyTests-227757527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c94b30a9-8c03-4988-806c-5d173f02cb9e.8d1eff2d-0ebb-4bf2-8ffd-1f1fef7f4631 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:29 devstack sudo[106883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c94b30a9-8c03-4988-806c-5d173f02cb9e.8d1eff2d-0ebb-4bf2-8ffd-1f1fef7f4631 Sep 28 09:40:29 devstack sudo[106883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:29 devstack sudo[106881]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:29 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-60756987-bab6-44be-9533-04edb5ea7e16 tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-06b7bbe5-9433-4698-b02a-c3a4fbb9415b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-06b7bbe5-9433-4698-b02a-c3a4fbb9415b.2b00bfec-40ff-41da-83e0-8c202ddf24d3 1G" returned: 0 in 0.548s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:29 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-60756987-bab6-44be-9533-04edb5ea7e16 tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06b7bbe5-9433-4698-b02a-c3a4fbb9415b -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-06b7bbe5-9433-4698-b02a-c3a4fbb9415b.2b00bfec-40ff-41da-83e0-8c202ddf24d3 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:29 devstack sudo[106883]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:29 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-817f958d-ecff-445f-9678-557c907b854b tempest-VolumeDependencyTests-227757527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c94b30a9-8c03-4988-806c-5d173f02cb9e.8d1eff2d-0ebb-4bf2-8ffd-1f1fef7f4631" returned: 0 in 0.457s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:29 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-817f958d-ecff-445f-9678-557c907b854b tempest-VolumeDependencyTests-227757527 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c94b30a9-8c03-4988-806c-5d173f02cb9e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86553) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 09:40:29 devstack sudo[106892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06b7bbe5-9433-4698-b02a-c3a4fbb9415b -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-06b7bbe5-9433-4698-b02a-c3a4fbb9415b.2b00bfec-40ff-41da-83e0-8c202ddf24d3 Sep 28 09:40:29 devstack sudo[106892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:29 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe3dff0c-4da4-4b5a-9613-8f6408000f03]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:40:29 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-817f958d-ecff-445f-9678-557c907b854b tempest-VolumeDependencyTests-227757527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c94b30a9-8c03-4988-806c-5d173f02cb9e {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:29 devstack sudo[106894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c94b30a9-8c03-4988-806c-5d173f02cb9e Sep 28 09:40:29 devstack sudo[106894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:29 devstack sudo[106892]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:29 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-60756987-bab6-44be-9533-04edb5ea7e16 tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06b7bbe5-9433-4698-b02a-c3a4fbb9415b -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-06b7bbe5-9433-4698-b02a-c3a4fbb9415b.2b00bfec-40ff-41da-83e0-8c202ddf24d3" returned: 0 in 0.361s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:29 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-60756987-bab6-44be-9533-04edb5ea7e16 tempest-ProjectMemberTests-186690331 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-06b7bbe5-9433-4698-b02a-c3a4fbb9415b.2b00bfec-40ff-41da-83e0-8c202ddf24d3 is being set with open permissions: ugo+rw Sep 28 09:40:29 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-60756987-bab6-44be-9533-04edb5ea7e16 tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-06b7bbe5-9433-4698-b02a-c3a4fbb9415b.2b00bfec-40ff-41da-83e0-8c202ddf24d3 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:29 devstack sudo[106901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-06b7bbe5-9433-4698-b02a-c3a4fbb9415b.2b00bfec-40ff-41da-83e0-8c202ddf24d3 Sep 28 09:40:29 devstack sudo[106901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:30 devstack sudo[106901]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-60756987-bab6-44be-9533-04edb5ea7e16 tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-06b7bbe5-9433-4698-b02a-c3a4fbb9415b.2b00bfec-40ff-41da-83e0-8c202ddf24d3" returned: 0 in 0.284s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-60756987-bab6-44be-9533-04edb5ea7e16 tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-06b7bbe5-9433-4698-b02a-c3a4fbb9415b.info {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:30 devstack sudo[106894]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-817f958d-ecff-445f-9678-557c907b854b tempest-VolumeDependencyTests-227757527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c94b30a9-8c03-4988-806c-5d173f02cb9e" returned: 0 in 0.656s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-817f958d-ecff-445f-9678-557c907b854b tempest-VolumeDependencyTests-227757527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c94b30a9-8c03-4988-806c-5d173f02cb9e.8d1eff2d-0ebb-4bf2-8ffd-1f1fef7f4631 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:30 devstack sudo[106907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-06b7bbe5-9433-4698-b02a-c3a4fbb9415b.info Sep 28 09:40:30 devstack sudo[106907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:30 devstack sudo[106909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c94b30a9-8c03-4988-806c-5d173f02cb9e.8d1eff2d-0ebb-4bf2-8ffd-1f1fef7f4631 Sep 28 09:40:30 devstack sudo[106909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:30 devstack sudo[106907]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-60756987-bab6-44be-9533-04edb5ea7e16 tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-06b7bbe5-9433-4698-b02a-c3a4fbb9415b.info" returned: 0 in 0.283s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:30 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-60756987-bab6-44be-9533-04edb5ea7e16 tempest-ProjectMemberTests-186690331 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-06b7bbe5-9433-4698-b02a-c3a4fbb9415b.info is being set with open permissions: ugo+rw Sep 28 09:40:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-60756987-bab6-44be-9533-04edb5ea7e16 tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-06b7bbe5-9433-4698-b02a-c3a4fbb9415b.info {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:30 devstack sudo[106914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-06b7bbe5-9433-4698-b02a-c3a4fbb9415b.info Sep 28 09:40:30 devstack sudo[106914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:30 devstack sudo[106909]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-817f958d-ecff-445f-9678-557c907b854b tempest-VolumeDependencyTests-227757527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c94b30a9-8c03-4988-806c-5d173f02cb9e.8d1eff2d-0ebb-4bf2-8ffd-1f1fef7f4631" returned: 0 in 0.383s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-817f958d-ecff-445f-9678-557c907b854b tempest-VolumeDependencyTests-227757527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c94b30a9-8c03-4988-806c-5d173f02cb9e.8d1eff2d-0ebb-4bf2-8ffd-1f1fef7f4631 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:30 devstack sudo[106917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c94b30a9-8c03-4988-806c-5d173f02cb9e.8d1eff2d-0ebb-4bf2-8ffd-1f1fef7f4631 Sep 28 09:40:30 devstack sudo[106917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:30 devstack sudo[106914]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-60756987-bab6-44be-9533-04edb5ea7e16 tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-06b7bbe5-9433-4698-b02a-c3a4fbb9415b.info" returned: 0 in 0.280s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-60756987-bab6-44be-9533-04edb5ea7e16 tempest-ProjectMemberTests-186690331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.408s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:40:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-43caab69-db84-4893-ada6-3e0daadb4dd0 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.781s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:40:30 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-43caab69-db84-4893-ada6-3e0daadb4dd0 tempest-CreateVolumesFromSnapshotTest-1115355121 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:40:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-477041141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1746e80c-66c0-4799-83e8-63f25f7db499,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3a018ea1a7f443f995907f85fbd4e20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:40:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:40:29Z,use_quota=True,user_id='f742cd667c1449578c5b6c6cd8bfca09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:40:30 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-43caab69-db84-4893-ada6-3e0daadb4dd0 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Creating volume 1746e80c-66c0-4799-83e8-63f25f7db499 {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:40:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-43caab69-db84-4893-ada6-3e0daadb4dd0 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:40:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-43caab69-db84-4893-ada6-3e0daadb4dd0 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:40:30 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-43caab69-db84-4893-ada6-3e0daadb4dd0 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:40:30 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-43caab69-db84-4893-ada6-3e0daadb4dd0 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:40:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-43caab69-db84-4893-ada6-3e0daadb4dd0 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:40:30 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-43caab69-db84-4893-ada6-3e0daadb4dd0 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:40:30 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-43caab69-db84-4893-ada6-3e0daadb4dd0 tempest-CreateVolumesFromSnapshotTest-1115355121 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:40:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-43caab69-db84-4893-ada6-3e0daadb4dd0 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1746e80c-66c0-4799-83e8-63f25f7db499 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:30 devstack sudo[106920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1746e80c-66c0-4799-83e8-63f25f7db499 1073741824 Sep 28 09:40:30 devstack sudo[106920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:30 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-60756987-bab6-44be-9533-04edb5ea7e16 tempest-ProjectMemberTests-186690331 None] Create snapshot completed successfully Sep 28 09:40:30 devstack sudo[106917]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-817f958d-ecff-445f-9678-557c907b854b tempest-VolumeDependencyTests-227757527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c94b30a9-8c03-4988-806c-5d173f02cb9e.8d1eff2d-0ebb-4bf2-8ffd-1f1fef7f4631" returned: 0 in 0.301s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:30 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-817f958d-ecff-445f-9678-557c907b854b tempest-VolumeDependencyTests-227757527 None] Lock "cinder-quobyte-8d1eff2d-0ebb-4bf2-8ffd-1f1fef7f4631" released by "_delete_snapshot" :: held 1.929s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:40:30 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-817f958d-ecff-445f-9678-557c907b854b tempest-VolumeDependencyTests-227757527 None] Lock "cinder-quobyte-c94b30a9-8c03-4988-806c-5d173f02cb9e" released by "delete_snapshot" :: held 1.953s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:40:30 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-817f958d-ecff-445f-9678-557c907b854b tempest-VolumeDependencyTests-227757527 None] Created reservations ['1bdeb24b-7f8e-4cef-9782-c5706af8bb52', 'ce1409f3-6faa-4826-80fa-423e98d39683', 'a6f645ad-c8d8-405b-a532-a2a5e55a26e3', '248ba04e-d366-487f-836f-e63a2a49ae47'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:40:31 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-817f958d-ecff-445f-9678-557c907b854b tempest-VolumeDependencyTests-227757527 None] Delete snapshot completed successfully. Sep 28 09:40:31 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-817f958d-ecff-445f-9678-557c907b854b tempest-VolumeDependencyTests-227757527 None] Lock "cinder-8d1eff2d-0ebb-4bf2-8ffd-1f1fef7f4631-delete_snapshot" released by "delete_snapshot" :: held 2.188s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:40:31 devstack sudo[106920]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:31 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-43caab69-db84-4893-ada6-3e0daadb4dd0 tempest-CreateVolumesFromSnapshotTest-1115355121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1746e80c-66c0-4799-83e8-63f25f7db499 1073741824" returned: 0 in 0.511s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:31 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-43caab69-db84-4893-ada6-3e0daadb4dd0 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1746e80c-66c0-4799-83e8-63f25f7db499 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:31 devstack sudo[106927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1746e80c-66c0-4799-83e8-63f25f7db499 Sep 28 09:40:31 devstack sudo[106927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:31 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-2462256f-dc4c-4c48-8c87-dc95e094850a tempest-ProjectMemberTests-186690331 None] Acquiring lock "cinder-2b00bfec-40ff-41da-83e0-8c202ddf24d3-delete_snapshot" by "delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:40:31 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-2462256f-dc4c-4c48-8c87-dc95e094850a tempest-ProjectMemberTests-186690331 None] Lock "cinder-2b00bfec-40ff-41da-83e0-8c202ddf24d3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:40:31 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-2462256f-dc4c-4c48-8c87-dc95e094850a tempest-ProjectMemberTests-186690331 None] Acquiring lock "cinder-quobyte-06b7bbe5-9433-4698-b02a-c3a4fbb9415b" by "delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:40:31 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-2462256f-dc4c-4c48-8c87-dc95e094850a tempest-ProjectMemberTests-186690331 None] Lock "cinder-quobyte-06b7bbe5-9433-4698-b02a-c3a4fbb9415b" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:40:31 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-2462256f-dc4c-4c48-8c87-dc95e094850a tempest-ProjectMemberTests-186690331 None] Acquiring lock "cinder-quobyte-2b00bfec-40ff-41da-83e0-8c202ddf24d3" by "_delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:40:31 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-2462256f-dc4c-4c48-8c87-dc95e094850a tempest-ProjectMemberTests-186690331 None] Lock "cinder-quobyte-2b00bfec-40ff-41da-83e0-8c202ddf24d3" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:40:31 devstack sudo[106927]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:31 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-2462256f-dc4c-4c48-8c87-dc95e094850a tempest-ProjectMemberTests-186690331 None] Deleting offline snapshot 2b00bfec-40ff-41da-83e0-8c202ddf24d3 of volume 06b7bbe5-9433-4698-b02a-c3a4fbb9415b {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 09:40:31 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-2462256f-dc4c-4c48-8c87-dc95e094850a tempest-ProjectMemberTests-186690331 None] snapshot_file for this snap is: volume-06b7bbe5-9433-4698-b02a-c3a4fbb9415b.2b00bfec-40ff-41da-83e0-8c202ddf24d3 {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 09:40:31 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-43caab69-db84-4893-ada6-3e0daadb4dd0 tempest-CreateVolumesFromSnapshotTest-1115355121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1746e80c-66c0-4799-83e8-63f25f7db499" returned: 0 in 0.321s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:31 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-43caab69-db84-4893-ada6-3e0daadb4dd0 tempest-CreateVolumesFromSnapshotTest-1115355121 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:40:31 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-43caab69-db84-4893-ada6-3e0daadb4dd0 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:40:31 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a84e859-6853-49dd-8cff-ed1c6fec9380]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:40:31 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2462256f-dc4c-4c48-8c87-dc95e094850a tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-06b7bbe5-9433-4698-b02a-c3a4fbb9415b.2b00bfec-40ff-41da-83e0-8c202ddf24d3 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:31 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-43caab69-db84-4893-ada6-3e0daadb4dd0 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef5ece62-1328-4e13-be08-47ed05bfb6e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1746e80c-66c0-4799-83e8-63f25f7db499', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:31 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-43caab69-db84-4893-ada6-3e0daadb4dd0 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca5ab089-6ac5-48bc-9e1b-5c030aa8210b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:31 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-43caab69-db84-4893-ada6-3e0daadb4dd0 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Volume volume-1746e80c-66c0-4799-83e8-63f25f7db499 (1746e80c-66c0-4799-83e8-63f25f7db499): created successfully Sep 28 09:40:31 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-43caab69-db84-4893-ada6-3e0daadb4dd0 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca5ab089-6ac5-48bc-9e1b-5c030aa8210b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:31 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-43caab69-db84-4893-ada6-3e0daadb4dd0 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Flow 'volume_create_manager' (8ecfc11c-c40b-4821-904e-5ed6fff45a87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:40:31 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-43caab69-db84-4893-ada6-3e0daadb4dd0 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Created volume successfully. Sep 28 09:40:31 devstack sudo[106936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-06b7bbe5-9433-4698-b02a-c3a4fbb9415b.2b00bfec-40ff-41da-83e0-8c202ddf24d3 Sep 28 09:40:31 devstack sudo[106936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:32 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-674e9545-0318-4509-a6c3-43c31cc5d44a tempest-VolumeDependencyTests-227757527 None] Acquiring lock "cinder-c94b30a9-8c03-4988-806c-5d173f02cb9e-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:40:32 devstack sudo[106936]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:32 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-674e9545-0318-4509-a6c3-43c31cc5d44a tempest-VolumeDependencyTests-227757527 None] Lock "cinder-c94b30a9-8c03-4988-806c-5d173f02cb9e-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:40:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2462256f-dc4c-4c48-8c87-dc95e094850a tempest-ProjectMemberTests-186690331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-06b7bbe5-9433-4698-b02a-c3a4fbb9415b.2b00bfec-40ff-41da-83e0-8c202ddf24d3" returned: 0 in 0.479s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:32 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-2462256f-dc4c-4c48-8c87-dc95e094850a tempest-ProjectMemberTests-186690331 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06b7bbe5-9433-4698-b02a-c3a4fbb9415b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86553) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 09:40:32 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f8ece9-4892-4c30-aa48-386980b9fd41]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:40:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2462256f-dc4c-4c48-8c87-dc95e094850a tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-06b7bbe5-9433-4698-b02a-c3a4fbb9415b {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:32 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-4dfdbf9a-eb55-481c-a3bb-8f060e44a6a9 tempest-CinderUnicodeTest-934001813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:40:32 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-4dfdbf9a-eb55-481c-a3bb-8f060e44a6a9 tempest-CinderUnicodeTest-934001813 None] Flow 'volume_create_manager' (b33c6ded-c617-4df8-b26a-644c874de7ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:40:32 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-4dfdbf9a-eb55-481c-a3bb-8f060e44a6a9 tempest-CinderUnicodeTest-934001813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99109de6-e828-40b8-9ebc-9dea1855ef39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:32 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-674e9545-0318-4509-a6c3-43c31cc5d44a tempest-VolumeDependencyTests-227757527 None] Acquiring lock "cinder-quobyte-c94b30a9-8c03-4988-806c-5d173f02cb9e" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:40:32 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-4dfdbf9a-eb55-481c-a3bb-8f060e44a6a9 tempest-CinderUnicodeTest-934001813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99109de6-e828-40b8-9ebc-9dea1855ef39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:40:32Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5865681-fbdb-4c60-89f0-02e721b59f22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70e4b4aead4843feb17a61120031ba25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:40:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:40:32Z,use_quota=True,user_id='b1a150a848654a5fafa961942301d478',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:32 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-4dfdbf9a-eb55-481c-a3bb-8f060e44a6a9 tempest-CinderUnicodeTest-934001813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e438def7-c571-43bb-8805-35474f7974bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:32 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-4dfdbf9a-eb55-481c-a3bb-8f060e44a6a9 tempest-CinderUnicodeTest-934001813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e438def7-c571-43bb-8805-35474f7974bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:32 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-4dfdbf9a-eb55-481c-a3bb-8f060e44a6a9 tempest-CinderUnicodeTest-934001813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95519e7e-b0aa-4127-9ebc-017426dce718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:32 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-4dfdbf9a-eb55-481c-a3bb-8f060e44a6a9 tempest-CinderUnicodeTest-934001813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95519e7e-b0aa-4127-9ebc-017426dce718) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5865681-fbdb-4c60-89f0-02e721b59f22', 'volume_name': 'volume-c5865681-fbdb-4c60-89f0-02e721b59f22', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:32 devstack sudo[106941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-06b7bbe5-9433-4698-b02a-c3a4fbb9415b Sep 28 09:40:32 devstack sudo[106941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:32 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-4dfdbf9a-eb55-481c-a3bb-8f060e44a6a9 tempest-CinderUnicodeTest-934001813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a4209c2-7c69-4926-b367-a12fcf6a0ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:32 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-4dfdbf9a-eb55-481c-a3bb-8f060e44a6a9 tempest-CinderUnicodeTest-934001813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a4209c2-7c69-4926-b367-a12fcf6a0ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:32 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-4dfdbf9a-eb55-481c-a3bb-8f060e44a6a9 tempest-CinderUnicodeTest-934001813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fff9143-d06b-4fe6-bad5-97bf349a4572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:32 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-4dfdbf9a-eb55-481c-a3bb-8f060e44a6a9 tempest-CinderUnicodeTest-934001813 None] Volume c5865681-fbdb-4c60-89f0-02e721b59f22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5865681-fbdb-4c60-89f0-02e721b59f22', 'volume_size': 1} Sep 28 09:40:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-4dfdbf9a-eb55-481c-a3bb-8f060e44a6a9 tempest-CinderUnicodeTest-934001813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:40:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-4dfdbf9a-eb55-481c-a3bb-8f060e44a6a9 tempest-CinderUnicodeTest-934001813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:40:32 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-4dfdbf9a-eb55-481c-a3bb-8f060e44a6a9 tempest-CinderUnicodeTest-934001813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:40:32Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5865681-fbdb-4c60-89f0-02e721b59f22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70e4b4aead4843feb17a61120031ba25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:40:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:40:32Z,use_quota=True,user_id='b1a150a848654a5fafa961942301d478',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:40:32 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-4dfdbf9a-eb55-481c-a3bb-8f060e44a6a9 tempest-CinderUnicodeTest-934001813 None] Creating volume c5865681-fbdb-4c60-89f0-02e721b59f22 {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:40:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-4dfdbf9a-eb55-481c-a3bb-8f060e44a6a9 tempest-CinderUnicodeTest-934001813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:40:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-4dfdbf9a-eb55-481c-a3bb-8f060e44a6a9 tempest-CinderUnicodeTest-934001813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:40:32 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-4dfdbf9a-eb55-481c-a3bb-8f060e44a6a9 tempest-CinderUnicodeTest-934001813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:40:32 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-4dfdbf9a-eb55-481c-a3bb-8f060e44a6a9 tempest-CinderUnicodeTest-934001813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:40:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-4dfdbf9a-eb55-481c-a3bb-8f060e44a6a9 tempest-CinderUnicodeTest-934001813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:40:32 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-4dfdbf9a-eb55-481c-a3bb-8f060e44a6a9 tempest-CinderUnicodeTest-934001813 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:40:32 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-4dfdbf9a-eb55-481c-a3bb-8f060e44a6a9 tempest-CinderUnicodeTest-934001813 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:40:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-4dfdbf9a-eb55-481c-a3bb-8f060e44a6a9 tempest-CinderUnicodeTest-934001813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c5865681-fbdb-4c60-89f0-02e721b59f22 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:32 devstack sudo[106943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c5865681-fbdb-4c60-89f0-02e721b59f22 1073741824 Sep 28 09:40:32 devstack sudo[106943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:32 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-674e9545-0318-4509-a6c3-43c31cc5d44a tempest-VolumeDependencyTests-227757527 None] Lock "cinder-quobyte-c94b30a9-8c03-4988-806c-5d173f02cb9e" acquired by "delete_volume" :: waited 0.100s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:40:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-901c54c8-d538-4a43-a0d2-03366f47bbc0 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:40:32 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[f98c4882-b379-45f7-86f8-9a2c7cfaec23]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:40:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-674e9545-0318-4509-a6c3-43c31cc5d44a tempest-VolumeDependencyTests-227757527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c94b30a9-8c03-4988-806c-5d173f02cb9e {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:32 devstack sudo[106945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c94b30a9-8c03-4988-806c-5d173f02cb9e Sep 28 09:40:32 devstack sudo[106945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:32 devstack sudo[106941]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2462256f-dc4c-4c48-8c87-dc95e094850a tempest-ProjectMemberTests-186690331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-06b7bbe5-9433-4698-b02a-c3a4fbb9415b" returned: 0 in 0.421s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2462256f-dc4c-4c48-8c87-dc95e094850a tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-06b7bbe5-9433-4698-b02a-c3a4fbb9415b.2b00bfec-40ff-41da-83e0-8c202ddf24d3 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:32 devstack sudo[106953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-06b7bbe5-9433-4698-b02a-c3a4fbb9415b.2b00bfec-40ff-41da-83e0-8c202ddf24d3 Sep 28 09:40:32 devstack sudo[106953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:32 devstack sudo[106943]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-4dfdbf9a-eb55-481c-a3bb-8f060e44a6a9 tempest-CinderUnicodeTest-934001813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c5865681-fbdb-4c60-89f0-02e721b59f22 1073741824" returned: 0 in 0.476s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:32 devstack sudo[106945]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-674e9545-0318-4509-a6c3-43c31cc5d44a tempest-VolumeDependencyTests-227757527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c94b30a9-8c03-4988-806c-5d173f02cb9e" returned: 0 in 0.421s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-674e9545-0318-4509-a6c3-43c31cc5d44a tempest-VolumeDependencyTests-227757527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c94b30a9-8c03-4988-806c-5d173f02cb9e {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-4dfdbf9a-eb55-481c-a3bb-8f060e44a6a9 tempest-CinderUnicodeTest-934001813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c5865681-fbdb-4c60-89f0-02e721b59f22 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:32 devstack sudo[106959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c94b30a9-8c03-4988-806c-5d173f02cb9e Sep 28 09:40:32 devstack sudo[106959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:32 devstack sudo[106963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c5865681-fbdb-4c60-89f0-02e721b59f22 Sep 28 09:40:32 devstack sudo[106963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:32 devstack sudo[106953]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2462256f-dc4c-4c48-8c87-dc95e094850a tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-06b7bbe5-9433-4698-b02a-c3a4fbb9415b.2b00bfec-40ff-41da-83e0-8c202ddf24d3" returned: 0 in 0.374s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2462256f-dc4c-4c48-8c87-dc95e094850a tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-06b7bbe5-9433-4698-b02a-c3a4fbb9415b.2b00bfec-40ff-41da-83e0-8c202ddf24d3 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:32 devstack sudo[106966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-06b7bbe5-9433-4698-b02a-c3a4fbb9415b.2b00bfec-40ff-41da-83e0-8c202ddf24d3 Sep 28 09:40:32 devstack sudo[106966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:33 devstack sudo[106959]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:33 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-674e9545-0318-4509-a6c3-43c31cc5d44a tempest-VolumeDependencyTests-227757527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c94b30a9-8c03-4988-806c-5d173f02cb9e" returned: 0 in 0.276s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:33 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-674e9545-0318-4509-a6c3-43c31cc5d44a tempest-VolumeDependencyTests-227757527 None] Lock "cinder-quobyte-c94b30a9-8c03-4988-806c-5d173f02cb9e" released by "delete_volume" :: held 0.766s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:40:33 devstack sudo[106963]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:33 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-4dfdbf9a-eb55-481c-a3bb-8f060e44a6a9 tempest-CinderUnicodeTest-934001813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c5865681-fbdb-4c60-89f0-02e721b59f22" returned: 0 in 0.285s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:33 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-4dfdbf9a-eb55-481c-a3bb-8f060e44a6a9 tempest-CinderUnicodeTest-934001813 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:40:33 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-4dfdbf9a-eb55-481c-a3bb-8f060e44a6a9 tempest-CinderUnicodeTest-934001813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.826s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:40:33 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-901c54c8-d538-4a43-a0d2-03366f47bbc0 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.751s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:40:33 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-4dfdbf9a-eb55-481c-a3bb-8f060e44a6a9 tempest-CinderUnicodeTest-934001813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fff9143-d06b-4fe6-bad5-97bf349a4572) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5865681-fbdb-4c60-89f0-02e721b59f22', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:33 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-4dfdbf9a-eb55-481c-a3bb-8f060e44a6a9 tempest-CinderUnicodeTest-934001813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2175dcd-88a3-442b-8f9d-754a6f9b08cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:33 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-901c54c8-d538-4a43-a0d2-03366f47bbc0 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Creating offline snapshot 480142d1-093a-4429-bc64-f5c651ff5ba0 of volume 1746e80c-66c0-4799-83e8-63f25f7db499 {{(pid=86553) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 09:40:33 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-4dfdbf9a-eb55-481c-a3bb-8f060e44a6a9 tempest-CinderUnicodeTest-934001813 None] Volume volume-c5865681-fbdb-4c60-89f0-02e721b59f22 (c5865681-fbdb-4c60-89f0-02e721b59f22): created successfully Sep 28 09:40:33 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-4dfdbf9a-eb55-481c-a3bb-8f060e44a6a9 tempest-CinderUnicodeTest-934001813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2175dcd-88a3-442b-8f9d-754a6f9b08cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:33 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-4dfdbf9a-eb55-481c-a3bb-8f060e44a6a9 tempest-CinderUnicodeTest-934001813 None] Flow 'volume_create_manager' (b33c6ded-c617-4df8-b26a-644c874de7ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:40:33 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf75bc5-597e-46e6-931f-ff526a812bb9]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:40:33 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-901c54c8-d538-4a43-a0d2-03366f47bbc0 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1746e80c-66c0-4799-83e8-63f25f7db499 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:33 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-674e9545-0318-4509-a6c3-43c31cc5d44a tempest-VolumeDependencyTests-227757527 None] Created reservations ['3f21d99f-b5a5-4be7-9ef0-dc046136c226', '0638821b-1513-4d1d-997c-35555729a2d8', '38689402-7b79-49c2-99b2-53c10127b0df', '912243cf-8216-446a-b335-84eedf7e6381'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:40:33 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-4dfdbf9a-eb55-481c-a3bb-8f060e44a6a9 tempest-CinderUnicodeTest-934001813 None] Created volume successfully. Sep 28 09:40:33 devstack sudo[106966]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:33 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2462256f-dc4c-4c48-8c87-dc95e094850a tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-06b7bbe5-9433-4698-b02a-c3a4fbb9415b.2b00bfec-40ff-41da-83e0-8c202ddf24d3" returned: 0 in 0.310s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:33 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-2462256f-dc4c-4c48-8c87-dc95e094850a tempest-ProjectMemberTests-186690331 None] Lock "cinder-quobyte-2b00bfec-40ff-41da-83e0-8c202ddf24d3" released by "_delete_snapshot" :: held 1.747s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:40:33 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-2462256f-dc4c-4c48-8c87-dc95e094850a tempest-ProjectMemberTests-186690331 None] Lock "cinder-quobyte-06b7bbe5-9433-4698-b02a-c3a4fbb9415b" released by "delete_snapshot" :: held 1.776s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:40:33 devstack sudo[106971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1746e80c-66c0-4799-83e8-63f25f7db499 Sep 28 09:40:33 devstack sudo[106971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:33 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-674e9545-0318-4509-a6c3-43c31cc5d44a tempest-VolumeDependencyTests-227757527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:40:33 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-674e9545-0318-4509-a6c3-43c31cc5d44a tempest-VolumeDependencyTests-227757527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:40:33 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-674e9545-0318-4509-a6c3-43c31cc5d44a tempest-VolumeDependencyTests-227757527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:40:33 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-674e9545-0318-4509-a6c3-43c31cc5d44a tempest-VolumeDependencyTests-227757527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:40:33 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-674e9545-0318-4509-a6c3-43c31cc5d44a tempest-VolumeDependencyTests-227757527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:40:33 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-674e9545-0318-4509-a6c3-43c31cc5d44a tempest-VolumeDependencyTests-227757527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:33 devstack sudo[106973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:40:33 devstack sudo[106973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:33 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-2462256f-dc4c-4c48-8c87-dc95e094850a tempest-ProjectMemberTests-186690331 None] Created reservations ['a9186c30-76bf-4c7e-ad5c-29fb812b79ca', '653b0997-0804-4423-adb3-d15e87bd6a09', '51e97743-8036-4d30-9305-15b270a38e9b', '77fe741e-e320-440c-acd9-f97cab189873'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:40:33 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-2462256f-dc4c-4c48-8c87-dc95e094850a tempest-ProjectMemberTests-186690331 None] Delete snapshot completed successfully. Sep 28 09:40:33 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-2462256f-dc4c-4c48-8c87-dc95e094850a tempest-ProjectMemberTests-186690331 None] Lock "cinder-2b00bfec-40ff-41da-83e0-8c202ddf24d3-delete_snapshot" released by "delete_snapshot" :: held 1.949s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:40:33 devstack sudo[106971]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:33 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-901c54c8-d538-4a43-a0d2-03366f47bbc0 tempest-CreateVolumesFromSnapshotTest-1115355121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1746e80c-66c0-4799-83e8-63f25f7db499" returned: 0 in 0.414s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:33 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-901c54c8-d538-4a43-a0d2-03366f47bbc0 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1746e80c-66c0-4799-83e8-63f25f7db499,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1746e80c-66c0-4799-83e8-63f25f7db499.480142d1-093a-4429-bc64-f5c651ff5ba0 1G {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:33 devstack sudo[106973]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:33 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-674e9545-0318-4509-a6c3-43c31cc5d44a tempest-VolumeDependencyTests-227757527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.283s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:33 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-674e9545-0318-4509-a6c3-43c31cc5d44a tempest-VolumeDependencyTests-227757527 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:40:33 devstack sudo[106979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1746e80c-66c0-4799-83e8-63f25f7db499,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1746e80c-66c0-4799-83e8-63f25f7db499.480142d1-093a-4429-bc64-f5c651ff5ba0 1G Sep 28 09:40:33 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-674e9545-0318-4509-a6c3-43c31cc5d44a tempest-VolumeDependencyTests-227757527 None] Deleted volume successfully. Sep 28 09:40:33 devstack sudo[106979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:33 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-674e9545-0318-4509-a6c3-43c31cc5d44a tempest-VolumeDependencyTests-227757527 None] Lock "cinder-c94b30a9-8c03-4988-806c-5d173f02cb9e-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:40:33 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-91f3b251-6d33-49f4-8434-b49c21012e74 tempest-ProjectMemberTests-186690331 None] Acquiring lock "cinder-06b7bbe5-9433-4698-b02a-c3a4fbb9415b-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:40:33 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-91f3b251-6d33-49f4-8434-b49c21012e74 tempest-ProjectMemberTests-186690331 None] Lock "cinder-06b7bbe5-9433-4698-b02a-c3a4fbb9415b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:40:33 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-91f3b251-6d33-49f4-8434-b49c21012e74 tempest-ProjectMemberTests-186690331 None] Acquiring lock "cinder-quobyte-06b7bbe5-9433-4698-b02a-c3a4fbb9415b" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:40:33 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-91f3b251-6d33-49f4-8434-b49c21012e74 tempest-ProjectMemberTests-186690331 None] Lock "cinder-quobyte-06b7bbe5-9433-4698-b02a-c3a4fbb9415b" acquired by "delete_volume" :: waited 0.015s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:40:33 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e29d15-2bad-45ab-b233-c47bf9fdb99a]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:40:33 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-91f3b251-6d33-49f4-8434-b49c21012e74 tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-06b7bbe5-9433-4698-b02a-c3a4fbb9415b {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:33 devstack sudo[106981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-06b7bbe5-9433-4698-b02a-c3a4fbb9415b Sep 28 09:40:33 devstack sudo[106981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:34 devstack sudo[106979]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:34 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-901c54c8-d538-4a43-a0d2-03366f47bbc0 tempest-CreateVolumesFromSnapshotTest-1115355121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1746e80c-66c0-4799-83e8-63f25f7db499,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1746e80c-66c0-4799-83e8-63f25f7db499.480142d1-093a-4429-bc64-f5c651ff5ba0 1G" returned: 0 in 0.456s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:34 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-901c54c8-d538-4a43-a0d2-03366f47bbc0 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1746e80c-66c0-4799-83e8-63f25f7db499 -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1746e80c-66c0-4799-83e8-63f25f7db499.480142d1-093a-4429-bc64-f5c651ff5ba0 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:34 devstack sudo[106987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1746e80c-66c0-4799-83e8-63f25f7db499 -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1746e80c-66c0-4799-83e8-63f25f7db499.480142d1-093a-4429-bc64-f5c651ff5ba0 Sep 28 09:40:34 devstack sudo[106987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:34 devstack sudo[106981]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:34 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-91f3b251-6d33-49f4-8434-b49c21012e74 tempest-ProjectMemberTests-186690331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-06b7bbe5-9433-4698-b02a-c3a4fbb9415b" returned: 0 in 0.421s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:34 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-91f3b251-6d33-49f4-8434-b49c21012e74 tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-06b7bbe5-9433-4698-b02a-c3a4fbb9415b {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:34 devstack sudo[106992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-06b7bbe5-9433-4698-b02a-c3a4fbb9415b Sep 28 09:40:34 devstack sudo[106992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:34 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-1e47c52f-6828-4e32-9bfb-0654dea38d24 tempest-VolumeDependencyTests-227757527 None] Acquiring lock "cinder-b0d20a89-8a1e-4783-97e5-c48271be9916-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:40:34 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-1e47c52f-6828-4e32-9bfb-0654dea38d24 tempest-VolumeDependencyTests-227757527 None] Lock "cinder-b0d20a89-8a1e-4783-97e5-c48271be9916-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:40:34 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-1e47c52f-6828-4e32-9bfb-0654dea38d24 tempest-VolumeDependencyTests-227757527 None] Acquiring lock "cinder-quobyte-b0d20a89-8a1e-4783-97e5-c48271be9916" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:40:34 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-1e47c52f-6828-4e32-9bfb-0654dea38d24 tempest-VolumeDependencyTests-227757527 None] Lock "cinder-quobyte-b0d20a89-8a1e-4783-97e5-c48271be9916" acquired by "delete_volume" :: waited 0.035s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:40:34 devstack sudo[106987]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:34 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-901c54c8-d538-4a43-a0d2-03366f47bbc0 tempest-CreateVolumesFromSnapshotTest-1115355121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1746e80c-66c0-4799-83e8-63f25f7db499 -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1746e80c-66c0-4799-83e8-63f25f7db499.480142d1-093a-4429-bc64-f5c651ff5ba0" returned: 0 in 0.437s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:34 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-901c54c8-d538-4a43-a0d2-03366f47bbc0 tempest-CreateVolumesFromSnapshotTest-1115355121 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1746e80c-66c0-4799-83e8-63f25f7db499.480142d1-093a-4429-bc64-f5c651ff5ba0 is being set with open permissions: ugo+rw Sep 28 09:40:34 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-901c54c8-d538-4a43-a0d2-03366f47bbc0 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1746e80c-66c0-4799-83e8-63f25f7db499.480142d1-093a-4429-bc64-f5c651ff5ba0 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:34 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[d13e0816-7882-483a-ab3e-34dbc648a89c]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:40:34 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1e47c52f-6828-4e32-9bfb-0654dea38d24 tempest-VolumeDependencyTests-227757527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b0d20a89-8a1e-4783-97e5-c48271be9916 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:34 devstack sudo[106998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1746e80c-66c0-4799-83e8-63f25f7db499.480142d1-093a-4429-bc64-f5c651ff5ba0 Sep 28 09:40:34 devstack sudo[106998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:34 devstack sudo[106992]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:34 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-91f3b251-6d33-49f4-8434-b49c21012e74 tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-06b7bbe5-9433-4698-b02a-c3a4fbb9415b" returned: 0 in 0.350s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:34 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-91f3b251-6d33-49f4-8434-b49c21012e74 tempest-ProjectMemberTests-186690331 None] Lock "cinder-quobyte-06b7bbe5-9433-4698-b02a-c3a4fbb9415b" released by "delete_volume" :: held 0.853s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:40:34 devstack sudo[107000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b0d20a89-8a1e-4783-97e5-c48271be9916 Sep 28 09:40:34 devstack sudo[107000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:34 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-91f3b251-6d33-49f4-8434-b49c21012e74 tempest-ProjectMemberTests-186690331 None] Created reservations ['35b313fb-b6ac-446c-9199-3da32261c6d2', '178ed968-c02a-400f-b264-8e92563e71c7', 'b0deabe8-1e12-4cfe-acf3-677173365c82', 'd35f26a0-37ad-418e-a202-0aaa4e8dfa3d'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:40:34 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-91f3b251-6d33-49f4-8434-b49c21012e74 tempest-ProjectMemberTests-186690331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:40:34 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-91f3b251-6d33-49f4-8434-b49c21012e74 tempest-ProjectMemberTests-186690331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:40:34 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-91f3b251-6d33-49f4-8434-b49c21012e74 tempest-ProjectMemberTests-186690331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:40:34 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-91f3b251-6d33-49f4-8434-b49c21012e74 tempest-ProjectMemberTests-186690331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:40:34 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-91f3b251-6d33-49f4-8434-b49c21012e74 tempest-ProjectMemberTests-186690331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:40:34 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-91f3b251-6d33-49f4-8434-b49c21012e74 tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:34 devstack sudo[106998]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:34 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-901c54c8-d538-4a43-a0d2-03366f47bbc0 tempest-CreateVolumesFromSnapshotTest-1115355121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1746e80c-66c0-4799-83e8-63f25f7db499.480142d1-093a-4429-bc64-f5c651ff5ba0" returned: 0 in 0.328s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:34 devstack sudo[107004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:40:34 devstack sudo[107004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:34 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-901c54c8-d538-4a43-a0d2-03366f47bbc0 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1746e80c-66c0-4799-83e8-63f25f7db499.info {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:34 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-313b0d46-61e7-4ee6-8276-429c147a4a32 tempest-CinderUnicodeTest-934001813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:40:34 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-313b0d46-61e7-4ee6-8276-429c147a4a32 tempest-CinderUnicodeTest-934001813 None] Flow 'volume_create_manager' (528fc8ba-0545-421a-8c26-9e2ea744e910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:40:34 devstack sudo[107009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1746e80c-66c0-4799-83e8-63f25f7db499.info Sep 28 09:40:34 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-313b0d46-61e7-4ee6-8276-429c147a4a32 tempest-CinderUnicodeTest-934001813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4edce122-3373-4f04-a9d5-9cfb4f4b8a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:34 devstack sudo[107009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:34 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-313b0d46-61e7-4ee6-8276-429c147a4a32 tempest-CinderUnicodeTest-934001813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4edce122-3373-4f04-a9d5-9cfb4f4b8a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:40:34Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1811819758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f689dbf9-156a-4785-9bdf-918603e7999c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70e4b4aead4843feb17a61120031ba25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:40:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:40:35Z,use_quota=True,user_id='b1a150a848654a5fafa961942301d478',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:34 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-313b0d46-61e7-4ee6-8276-429c147a4a32 tempest-CinderUnicodeTest-934001813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da79a358-c4d9-40ea-ae2e-5f537005c5c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:34 devstack sudo[107000]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:34 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-313b0d46-61e7-4ee6-8276-429c147a4a32 tempest-CinderUnicodeTest-934001813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da79a358-c4d9-40ea-ae2e-5f537005c5c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:34 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-313b0d46-61e7-4ee6-8276-429c147a4a32 tempest-CinderUnicodeTest-934001813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ab45504-9ff3-4ab6-8968-fca59f20df2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:34 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-313b0d46-61e7-4ee6-8276-429c147a4a32 tempest-CinderUnicodeTest-934001813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ab45504-9ff3-4ab6-8968-fca59f20df2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f689dbf9-156a-4785-9bdf-918603e7999c', 'volume_name': 'volume-f689dbf9-156a-4785-9bdf-918603e7999c', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:34 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-313b0d46-61e7-4ee6-8276-429c147a4a32 tempest-CinderUnicodeTest-934001813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (206b8d43-d3b5-49db-942f-8e606298db54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:34 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-313b0d46-61e7-4ee6-8276-429c147a4a32 tempest-CinderUnicodeTest-934001813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (206b8d43-d3b5-49db-942f-8e606298db54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:34 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-313b0d46-61e7-4ee6-8276-429c147a4a32 tempest-CinderUnicodeTest-934001813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cee1acf-7fc0-4961-a94b-b36d712d04dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:34 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-313b0d46-61e7-4ee6-8276-429c147a4a32 tempest-CinderUnicodeTest-934001813 None] Volume f689dbf9-156a-4785-9bdf-918603e7999c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f689dbf9-156a-4785-9bdf-918603e7999c', 'volume_size': 1} Sep 28 09:40:34 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-313b0d46-61e7-4ee6-8276-429c147a4a32 tempest-CinderUnicodeTest-934001813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:40:34 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1e47c52f-6828-4e32-9bfb-0654dea38d24 tempest-VolumeDependencyTests-227757527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b0d20a89-8a1e-4783-97e5-c48271be9916" returned: 0 in 0.499s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:35 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1e47c52f-6828-4e32-9bfb-0654dea38d24 tempest-VolumeDependencyTests-227757527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b0d20a89-8a1e-4783-97e5-c48271be9916 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:35 devstack sudo[107011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b0d20a89-8a1e-4783-97e5-c48271be9916 Sep 28 09:40:35 devstack sudo[107011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:35 devstack sudo[107004]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:35 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-91f3b251-6d33-49f4-8434-b49c21012e74 tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.327s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:35 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-91f3b251-6d33-49f4-8434-b49c21012e74 tempest-ProjectMemberTests-186690331 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:40:35 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-91f3b251-6d33-49f4-8434-b49c21012e74 tempest-ProjectMemberTests-186690331 None] Deleted volume successfully. Sep 28 09:40:35 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-91f3b251-6d33-49f4-8434-b49c21012e74 tempest-ProjectMemberTests-186690331 None] Lock "cinder-06b7bbe5-9433-4698-b02a-c3a4fbb9415b-delete_volume" released by "delete_volume" :: held 1.456s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:40:35 devstack sudo[107009]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:35 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-901c54c8-d538-4a43-a0d2-03366f47bbc0 tempest-CreateVolumesFromSnapshotTest-1115355121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1746e80c-66c0-4799-83e8-63f25f7db499.info" returned: 0 in 0.356s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:35 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-901c54c8-d538-4a43-a0d2-03366f47bbc0 tempest-CreateVolumesFromSnapshotTest-1115355121 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1746e80c-66c0-4799-83e8-63f25f7db499.info is being set with open permissions: ugo+rw Sep 28 09:40:35 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-901c54c8-d538-4a43-a0d2-03366f47bbc0 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1746e80c-66c0-4799-83e8-63f25f7db499.info {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:35 devstack sudo[107015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1746e80c-66c0-4799-83e8-63f25f7db499.info Sep 28 09:40:35 devstack sudo[107015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:35 devstack sudo[107011]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:35 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1e47c52f-6828-4e32-9bfb-0654dea38d24 tempest-VolumeDependencyTests-227757527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b0d20a89-8a1e-4783-97e5-c48271be9916" returned: 0 in 0.335s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:35 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-1e47c52f-6828-4e32-9bfb-0654dea38d24 tempest-VolumeDependencyTests-227757527 None] Lock "cinder-quobyte-b0d20a89-8a1e-4783-97e5-c48271be9916" released by "delete_volume" :: held 0.902s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:40:35 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-1e47c52f-6828-4e32-9bfb-0654dea38d24 tempest-VolumeDependencyTests-227757527 None] Created reservations ['4e2c4165-e812-4110-8d8f-d7bff18a3f2a', 'f876aa07-1e88-4bf9-9a89-6a9d1a2a8989', '9a998e8a-770c-4669-8be8-a2e0eae2d1e6', 'b3fc92ad-c1b8-40fc-a53b-10dc079525fa'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:40:35 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-faf8913f-03d6-4f98-a77c-91ec952c1764 tempest-ProjectMemberTests-186690331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:40:35 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-faf8913f-03d6-4f98-a77c-91ec952c1764 tempest-ProjectMemberTests-186690331 None] Flow 'volume_create_manager' (40559e61-418c-44b5-9a40-4f351a43fe65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:40:35 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-faf8913f-03d6-4f98-a77c-91ec952c1764 tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27aea38d-7ebc-4865-9b73-816624b5d9d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:35 devstack sudo[107015]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:35 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-901c54c8-d538-4a43-a0d2-03366f47bbc0 tempest-CreateVolumesFromSnapshotTest-1115355121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1746e80c-66c0-4799-83e8-63f25f7db499.info" returned: 0 in 0.293s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:35 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-901c54c8-d538-4a43-a0d2-03366f47bbc0 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.469s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:40:35 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-313b0d46-61e7-4ee6-8276-429c147a4a32 tempest-CinderUnicodeTest-934001813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.565s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:40:35 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-313b0d46-61e7-4ee6-8276-429c147a4a32 tempest-CinderUnicodeTest-934001813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:40:34Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1811819758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f689dbf9-156a-4785-9bdf-918603e7999c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70e4b4aead4843feb17a61120031ba25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:40:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:40:35Z,use_quota=True,user_id='b1a150a848654a5fafa961942301d478',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:40:35 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-313b0d46-61e7-4ee6-8276-429c147a4a32 tempest-CinderUnicodeTest-934001813 None] Creating volume f689dbf9-156a-4785-9bdf-918603e7999c {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:40:35 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-313b0d46-61e7-4ee6-8276-429c147a4a32 tempest-CinderUnicodeTest-934001813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:40:35 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-313b0d46-61e7-4ee6-8276-429c147a4a32 tempest-CinderUnicodeTest-934001813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:40:35 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-313b0d46-61e7-4ee6-8276-429c147a4a32 tempest-CinderUnicodeTest-934001813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:40:35 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-313b0d46-61e7-4ee6-8276-429c147a4a32 tempest-CinderUnicodeTest-934001813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:40:35 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-313b0d46-61e7-4ee6-8276-429c147a4a32 tempest-CinderUnicodeTest-934001813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:40:35 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-313b0d46-61e7-4ee6-8276-429c147a4a32 tempest-CinderUnicodeTest-934001813 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:40:35 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-313b0d46-61e7-4ee6-8276-429c147a4a32 tempest-CinderUnicodeTest-934001813 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:40:35 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-313b0d46-61e7-4ee6-8276-429c147a4a32 tempest-CinderUnicodeTest-934001813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f689dbf9-156a-4785-9bdf-918603e7999c 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:35 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-faf8913f-03d6-4f98-a77c-91ec952c1764 tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27aea38d-7ebc-4865-9b73-816624b5d9d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:40:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1066636819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9975178b-255e-43b8-af32-6fb62ef9dcfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50c5ebfa35e84e1fa822f83efd2739e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:40:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:40:35Z,use_quota=True,user_id='029e33208bca4e258a762ad19e5ed78e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:35 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-faf8913f-03d6-4f98-a77c-91ec952c1764 tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08ab4972-c771-4816-88bc-0d79f100027c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:35 devstack sudo[107019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f689dbf9-156a-4785-9bdf-918603e7999c 1073741824 Sep 28 09:40:35 devstack sudo[107019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:35 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-faf8913f-03d6-4f98-a77c-91ec952c1764 tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08ab4972-c771-4816-88bc-0d79f100027c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:35 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-faf8913f-03d6-4f98-a77c-91ec952c1764 tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61b3433f-3643-4feb-8ce9-483d0ad2e19b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:35 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-faf8913f-03d6-4f98-a77c-91ec952c1764 tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61b3433f-3643-4feb-8ce9-483d0ad2e19b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9975178b-255e-43b8-af32-6fb62ef9dcfc', 'volume_name': 'volume-9975178b-255e-43b8-af32-6fb62ef9dcfc', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:35 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-faf8913f-03d6-4f98-a77c-91ec952c1764 tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66782018-80e8-4088-bce4-51e1e15610ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:35 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-faf8913f-03d6-4f98-a77c-91ec952c1764 tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66782018-80e8-4088-bce4-51e1e15610ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:35 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-faf8913f-03d6-4f98-a77c-91ec952c1764 tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4486caf-466d-4e53-8ddb-499558fb13ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:35 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-faf8913f-03d6-4f98-a77c-91ec952c1764 tempest-ProjectMemberTests-186690331 None] Volume 9975178b-255e-43b8-af32-6fb62ef9dcfc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9975178b-255e-43b8-af32-6fb62ef9dcfc', 'volume_size': 1} Sep 28 09:40:35 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-faf8913f-03d6-4f98-a77c-91ec952c1764 tempest-ProjectMemberTests-186690331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:40:35 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-901c54c8-d538-4a43-a0d2-03366f47bbc0 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Create snapshot completed successfully Sep 28 09:40:35 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-1e47c52f-6828-4e32-9bfb-0654dea38d24 tempest-VolumeDependencyTests-227757527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:40:35 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-1e47c52f-6828-4e32-9bfb-0654dea38d24 tempest-VolumeDependencyTests-227757527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:40:35 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-1e47c52f-6828-4e32-9bfb-0654dea38d24 tempest-VolumeDependencyTests-227757527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:40:35 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-1e47c52f-6828-4e32-9bfb-0654dea38d24 tempest-VolumeDependencyTests-227757527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:40:35 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-1e47c52f-6828-4e32-9bfb-0654dea38d24 tempest-VolumeDependencyTests-227757527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:40:35 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1e47c52f-6828-4e32-9bfb-0654dea38d24 tempest-VolumeDependencyTests-227757527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:35 devstack sudo[107021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:40:35 devstack sudo[107021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:35 devstack sudo[107021]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:35 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1e47c52f-6828-4e32-9bfb-0654dea38d24 tempest-VolumeDependencyTests-227757527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.309s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:35 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-1e47c52f-6828-4e32-9bfb-0654dea38d24 tempest-VolumeDependencyTests-227757527 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:40:35 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-1e47c52f-6828-4e32-9bfb-0654dea38d24 tempest-VolumeDependencyTests-227757527 None] Deleted volume successfully. Sep 28 09:40:36 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-1e47c52f-6828-4e32-9bfb-0654dea38d24 tempest-VolumeDependencyTests-227757527 None] Lock "cinder-b0d20a89-8a1e-4783-97e5-c48271be9916-delete_volume" released by "delete_volume" :: held 1.658s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:40:36 devstack sudo[107019]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:36 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-313b0d46-61e7-4ee6-8276-429c147a4a32 tempest-CinderUnicodeTest-934001813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f689dbf9-156a-4785-9bdf-918603e7999c 1073741824" returned: 0 in 0.488s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:36 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-313b0d46-61e7-4ee6-8276-429c147a4a32 tempest-CinderUnicodeTest-934001813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f689dbf9-156a-4785-9bdf-918603e7999c {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:36 devstack sudo[107027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f689dbf9-156a-4785-9bdf-918603e7999c Sep 28 09:40:36 devstack sudo[107027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:36 devstack sudo[107027]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:36 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-313b0d46-61e7-4ee6-8276-429c147a4a32 tempest-CinderUnicodeTest-934001813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f689dbf9-156a-4785-9bdf-918603e7999c" returned: 0 in 0.271s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:36 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-313b0d46-61e7-4ee6-8276-429c147a4a32 tempest-CinderUnicodeTest-934001813 None] <== create_volume: return (799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:40:36 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-313b0d46-61e7-4ee6-8276-429c147a4a32 tempest-CinderUnicodeTest-934001813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.802s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:40:36 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-faf8913f-03d6-4f98-a77c-91ec952c1764 tempest-ProjectMemberTests-186690331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.735s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:40:36 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-faf8913f-03d6-4f98-a77c-91ec952c1764 tempest-ProjectMemberTests-186690331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:40:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1066636819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9975178b-255e-43b8-af32-6fb62ef9dcfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50c5ebfa35e84e1fa822f83efd2739e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:40:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:40:35Z,use_quota=True,user_id='029e33208bca4e258a762ad19e5ed78e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:40:36 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-faf8913f-03d6-4f98-a77c-91ec952c1764 tempest-ProjectMemberTests-186690331 None] Creating volume 9975178b-255e-43b8-af32-6fb62ef9dcfc {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:40:36 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-faf8913f-03d6-4f98-a77c-91ec952c1764 tempest-ProjectMemberTests-186690331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:40:36 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-faf8913f-03d6-4f98-a77c-91ec952c1764 tempest-ProjectMemberTests-186690331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:40:36 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-faf8913f-03d6-4f98-a77c-91ec952c1764 tempest-ProjectMemberTests-186690331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:40:36 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-faf8913f-03d6-4f98-a77c-91ec952c1764 tempest-ProjectMemberTests-186690331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:40:36 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-faf8913f-03d6-4f98-a77c-91ec952c1764 tempest-ProjectMemberTests-186690331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:40:36 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-faf8913f-03d6-4f98-a77c-91ec952c1764 tempest-ProjectMemberTests-186690331 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:40:36 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-faf8913f-03d6-4f98-a77c-91ec952c1764 tempest-ProjectMemberTests-186690331 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:40:36 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-faf8913f-03d6-4f98-a77c-91ec952c1764 tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9975178b-255e-43b8-af32-6fb62ef9dcfc 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:36 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-313b0d46-61e7-4ee6-8276-429c147a4a32 tempest-CinderUnicodeTest-934001813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cee1acf-7fc0-4961-a94b-b36d712d04dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f689dbf9-156a-4785-9bdf-918603e7999c', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:36 devstack sudo[107030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9975178b-255e-43b8-af32-6fb62ef9dcfc 1073741824 Sep 28 09:40:36 devstack sudo[107030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:36 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-313b0d46-61e7-4ee6-8276-429c147a4a32 tempest-CinderUnicodeTest-934001813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adb14efe-6a70-4b40-b9d9-d4c50a58a9f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:36 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-313b0d46-61e7-4ee6-8276-429c147a4a32 tempest-CinderUnicodeTest-934001813 None] Volume volume-f689dbf9-156a-4785-9bdf-918603e7999c (f689dbf9-156a-4785-9bdf-918603e7999c): created successfully Sep 28 09:40:36 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-313b0d46-61e7-4ee6-8276-429c147a4a32 tempest-CinderUnicodeTest-934001813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adb14efe-6a70-4b40-b9d9-d4c50a58a9f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:36 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-313b0d46-61e7-4ee6-8276-429c147a4a32 tempest-CinderUnicodeTest-934001813 None] Flow 'volume_create_manager' (528fc8ba-0545-421a-8c26-9e2ea744e910) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:40:36 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-313b0d46-61e7-4ee6-8276-429c147a4a32 tempest-CinderUnicodeTest-934001813 None] Created volume successfully. Sep 28 09:40:37 devstack sudo[107030]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:37 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-faf8913f-03d6-4f98-a77c-91ec952c1764 tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9975178b-255e-43b8-af32-6fb62ef9dcfc 1073741824" returned: 0 in 0.626s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:37 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-56d838f5-3cd0-4b8e-81e3-3126c4c07041 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:40:37 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-56d838f5-3cd0-4b8e-81e3-3126c4c07041 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Flow 'volume_create_manager' (7fa00043-93cc-4efa-8571-4f44deeb2deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:40:37 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-56d838f5-3cd0-4b8e-81e3-3126c4c07041 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e9de397-f4b4-41e5-bf51-090123a546a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:37 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-faf8913f-03d6-4f98-a77c-91ec952c1764 tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9975178b-255e-43b8-af32-6fb62ef9dcfc {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:37 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-56d838f5-3cd0-4b8e-81e3-3126c4c07041 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e9de397-f4b4-41e5-bf51-090123a546a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:40:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1374055556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de4d4e39-cf09-44fd-a0e8-9ffead2cd014,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3a018ea1a7f443f995907f85fbd4e20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:40:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:40:37Z,use_quota=True,user_id='f742cd667c1449578c5b6c6cd8bfca09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:37 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-56d838f5-3cd0-4b8e-81e3-3126c4c07041 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49a0d3b3-0495-4cfe-91aa-706d65ffeaff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:37 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-56d838f5-3cd0-4b8e-81e3-3126c4c07041 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49a0d3b3-0495-4cfe-91aa-706d65ffeaff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:37 devstack sudo[107036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9975178b-255e-43b8-af32-6fb62ef9dcfc Sep 28 09:40:37 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-56d838f5-3cd0-4b8e-81e3-3126c4c07041 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c6bc48f-8c55-44a6-a594-d3e5f2322add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:37 devstack sudo[107036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:37 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-56d838f5-3cd0-4b8e-81e3-3126c4c07041 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c6bc48f-8c55-44a6-a594-d3e5f2322add) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de4d4e39-cf09-44fd-a0e8-9ffead2cd014', 'volume_name': 'volume-de4d4e39-cf09-44fd-a0e8-9ffead2cd014', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:37 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-56d838f5-3cd0-4b8e-81e3-3126c4c07041 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afff4b7e-b118-470e-8061-215ee375e973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:37 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-56d838f5-3cd0-4b8e-81e3-3126c4c07041 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afff4b7e-b118-470e-8061-215ee375e973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:37 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-56d838f5-3cd0-4b8e-81e3-3126c4c07041 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (392abc9d-ca91-477b-8ba2-e03f32f6f84a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:37 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-56d838f5-3cd0-4b8e-81e3-3126c4c07041 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Volume de4d4e39-cf09-44fd-a0e8-9ffead2cd014: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de4d4e39-cf09-44fd-a0e8-9ffead2cd014', 'volume_size': 1} Sep 28 09:40:37 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-56d838f5-3cd0-4b8e-81e3-3126c4c07041 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:40:37 devstack sudo[107036]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:37 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-faf8913f-03d6-4f98-a77c-91ec952c1764 tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9975178b-255e-43b8-af32-6fb62ef9dcfc" returned: 0 in 0.429s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:37 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-faf8913f-03d6-4f98-a77c-91ec952c1764 tempest-ProjectMemberTests-186690331 None] <== create_volume: return (1202ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:40:37 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-faf8913f-03d6-4f98-a77c-91ec952c1764 tempest-ProjectMemberTests-186690331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.206s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:40:37 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-56d838f5-3cd0-4b8e-81e3-3126c4c07041 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.337s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:40:37 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-56d838f5-3cd0-4b8e-81e3-3126c4c07041 tempest-CreateVolumesFromSnapshotTest-1115355121 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:40:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1374055556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de4d4e39-cf09-44fd-a0e8-9ffead2cd014,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3a018ea1a7f443f995907f85fbd4e20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:40:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:40:37Z,use_quota=True,user_id='f742cd667c1449578c5b6c6cd8bfca09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:40:37 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-56d838f5-3cd0-4b8e-81e3-3126c4c07041 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Creating volume de4d4e39-cf09-44fd-a0e8-9ffead2cd014 {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:40:37 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-56d838f5-3cd0-4b8e-81e3-3126c4c07041 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:40:37 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-56d838f5-3cd0-4b8e-81e3-3126c4c07041 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:40:37 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-56d838f5-3cd0-4b8e-81e3-3126c4c07041 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:40:37 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-56d838f5-3cd0-4b8e-81e3-3126c4c07041 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:40:37 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-56d838f5-3cd0-4b8e-81e3-3126c4c07041 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:40:37 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-56d838f5-3cd0-4b8e-81e3-3126c4c07041 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:40:37 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-56d838f5-3cd0-4b8e-81e3-3126c4c07041 tempest-CreateVolumesFromSnapshotTest-1115355121 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:40:37 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-56d838f5-3cd0-4b8e-81e3-3126c4c07041 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-de4d4e39-cf09-44fd-a0e8-9ffead2cd014 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:37 devstack sudo[107039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-de4d4e39-cf09-44fd-a0e8-9ffead2cd014 1073741824 Sep 28 09:40:37 devstack sudo[107039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:37 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-faf8913f-03d6-4f98-a77c-91ec952c1764 tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4486caf-466d-4e53-8ddb-499558fb13ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9975178b-255e-43b8-af32-6fb62ef9dcfc', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:37 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-faf8913f-03d6-4f98-a77c-91ec952c1764 tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e0beb7d-7147-4925-b9ed-11f3c9828705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:37 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-faf8913f-03d6-4f98-a77c-91ec952c1764 tempest-ProjectMemberTests-186690331 None] Volume volume-9975178b-255e-43b8-af32-6fb62ef9dcfc (9975178b-255e-43b8-af32-6fb62ef9dcfc): created successfully Sep 28 09:40:37 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-faf8913f-03d6-4f98-a77c-91ec952c1764 tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e0beb7d-7147-4925-b9ed-11f3c9828705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:37 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-faf8913f-03d6-4f98-a77c-91ec952c1764 tempest-ProjectMemberTests-186690331 None] Flow 'volume_create_manager' (40559e61-418c-44b5-9a40-4f351a43fe65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:40:37 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-1e8786ac-c1d6-4112-8374-e30e2192f544 tempest-CinderUnicodeTest-934001813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:40:37 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-b19e51dd-7d9c-41e0-a929-b6b95a1c7b1a tempest-CreateVolumesFromSnapshotTest-1115355121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:40:37 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b19e51dd-7d9c-41e0-a929-b6b95a1c7b1a tempest-CreateVolumesFromSnapshotTest-1115355121 None] Flow 'volume_create_manager' (0aef5249-f31a-4246-98cf-8b883c4128eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:40:37 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b19e51dd-7d9c-41e0-a929-b6b95a1c7b1a tempest-CreateVolumesFromSnapshotTest-1115355121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8031b347-adcf-4274-8082-2f30f90bd8d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:37 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-faf8913f-03d6-4f98-a77c-91ec952c1764 tempest-ProjectMemberTests-186690331 None] Created volume successfully. Sep 28 09:40:37 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b19e51dd-7d9c-41e0-a929-b6b95a1c7b1a tempest-CreateVolumesFromSnapshotTest-1115355121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8031b347-adcf-4274-8082-2f30f90bd8d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:40:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-443795028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f565bbc-14cf-4711-8b3c-c71c345a1cd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3a018ea1a7f443f995907f85fbd4e20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:40:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:40:38Z,use_quota=True,user_id='f742cd667c1449578c5b6c6cd8bfca09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:37 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b19e51dd-7d9c-41e0-a929-b6b95a1c7b1a tempest-CreateVolumesFromSnapshotTest-1115355121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b6e484f-a8f9-46e3-bd04-56ce43cdbbef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:37 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b19e51dd-7d9c-41e0-a929-b6b95a1c7b1a tempest-CreateVolumesFromSnapshotTest-1115355121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b6e484f-a8f9-46e3-bd04-56ce43cdbbef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:37 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b19e51dd-7d9c-41e0-a929-b6b95a1c7b1a tempest-CreateVolumesFromSnapshotTest-1115355121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c6be353-4b5f-4ec2-b738-7ab34b11f224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:37 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b19e51dd-7d9c-41e0-a929-b6b95a1c7b1a tempest-CreateVolumesFromSnapshotTest-1115355121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c6be353-4b5f-4ec2-b738-7ab34b11f224) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f565bbc-14cf-4711-8b3c-c71c345a1cd8', 'volume_name': 'volume-2f565bbc-14cf-4711-8b3c-c71c345a1cd8', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:37 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b19e51dd-7d9c-41e0-a929-b6b95a1c7b1a tempest-CreateVolumesFromSnapshotTest-1115355121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30047e6d-6cb9-4ee8-85f1-159bbd569690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:37 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b19e51dd-7d9c-41e0-a929-b6b95a1c7b1a tempest-CreateVolumesFromSnapshotTest-1115355121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30047e6d-6cb9-4ee8-85f1-159bbd569690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:37 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b19e51dd-7d9c-41e0-a929-b6b95a1c7b1a tempest-CreateVolumesFromSnapshotTest-1115355121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (439e8546-df3e-4fa3-9b88-33b30d94afb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:37 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-b19e51dd-7d9c-41e0-a929-b6b95a1c7b1a tempest-CreateVolumesFromSnapshotTest-1115355121 None] Volume 2f565bbc-14cf-4711-8b3c-c71c345a1cd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f565bbc-14cf-4711-8b3c-c71c345a1cd8', 'volume_size': 1} Sep 28 09:40:37 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-b19e51dd-7d9c-41e0-a929-b6b95a1c7b1a tempest-CreateVolumesFromSnapshotTest-1115355121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:40:37 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-55e2671b-9700-4503-ad5c-2c5772946b25 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:40:38 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-55e2671b-9700-4503-ad5c-2c5772946b25 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Flow 'volume_create_manager' (24f3e9ce-a4d7-4863-b7cc-f1592d29aebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:40:38 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-55e2671b-9700-4503-ad5c-2c5772946b25 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f59ea8e-f75e-4407-83fb-2e7f74e97048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:38 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-55e2671b-9700-4503-ad5c-2c5772946b25 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f59ea8e-f75e-4407-83fb-2e7f74e97048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:40:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-613757064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=242fd277-0f68-43bf-9a72-b0c556e21726,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3a018ea1a7f443f995907f85fbd4e20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:40:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:40:38Z,use_quota=True,user_id='f742cd667c1449578c5b6c6cd8bfca09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:38 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-55e2671b-9700-4503-ad5c-2c5772946b25 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1462b880-7c80-496a-aa09-b39fe912e8c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:38 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-55e2671b-9700-4503-ad5c-2c5772946b25 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1462b880-7c80-496a-aa09-b39fe912e8c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:38 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-55e2671b-9700-4503-ad5c-2c5772946b25 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e869d8d-356f-46e7-a053-69604174407d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:38 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-55e2671b-9700-4503-ad5c-2c5772946b25 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e869d8d-356f-46e7-a053-69604174407d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '242fd277-0f68-43bf-9a72-b0c556e21726', 'volume_name': 'volume-242fd277-0f68-43bf-9a72-b0c556e21726', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:38 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-55e2671b-9700-4503-ad5c-2c5772946b25 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f920213e-0049-4182-85cc-65ba562e7674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:38 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-55e2671b-9700-4503-ad5c-2c5772946b25 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f920213e-0049-4182-85cc-65ba562e7674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:38 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-55e2671b-9700-4503-ad5c-2c5772946b25 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a22daad9-6be0-4236-ae70-38a549e3ec52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:38 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-55e2671b-9700-4503-ad5c-2c5772946b25 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Volume 242fd277-0f68-43bf-9a72-b0c556e21726: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-242fd277-0f68-43bf-9a72-b0c556e21726', 'volume_size': 1} Sep 28 09:40:38 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-55e2671b-9700-4503-ad5c-2c5772946b25 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:40:38 devstack sudo[107039]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:38 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-56d838f5-3cd0-4b8e-81e3-3126c4c07041 tempest-CreateVolumesFromSnapshotTest-1115355121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-de4d4e39-cf09-44fd-a0e8-9ffead2cd014 1073741824" returned: 0 in 0.711s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:38 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-56d838f5-3cd0-4b8e-81e3-3126c4c07041 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-de4d4e39-cf09-44fd-a0e8-9ffead2cd014 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:38 devstack sudo[107046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-de4d4e39-cf09-44fd-a0e8-9ffead2cd014 Sep 28 09:40:38 devstack sudo[107046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:38 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-2342fcf4-3ba7-4ccd-a2ad-779bd61f048c tempest-CreateVolumesFromSnapshotTest-1115355121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:40:38 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-2342fcf4-3ba7-4ccd-a2ad-779bd61f048c tempest-CreateVolumesFromSnapshotTest-1115355121 None] Flow 'volume_create_manager' (35f32217-c531-48cf-a328-b558e9dfbe17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:40:38 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-2342fcf4-3ba7-4ccd-a2ad-779bd61f048c tempest-CreateVolumesFromSnapshotTest-1115355121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (717ce021-de36-4d07-b780-872089ffa4ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:38 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-2342fcf4-3ba7-4ccd-a2ad-779bd61f048c tempest-CreateVolumesFromSnapshotTest-1115355121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (717ce021-de36-4d07-b780-872089ffa4ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:40:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-511877954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c643e8b6-491f-4c52-b083-e406e26b8a17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3a018ea1a7f443f995907f85fbd4e20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:40:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:40:38Z,use_quota=True,user_id='f742cd667c1449578c5b6c6cd8bfca09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:38 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-2342fcf4-3ba7-4ccd-a2ad-779bd61f048c tempest-CreateVolumesFromSnapshotTest-1115355121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b6b60d6-27c4-489b-9101-5c1615805b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:38 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-2342fcf4-3ba7-4ccd-a2ad-779bd61f048c tempest-CreateVolumesFromSnapshotTest-1115355121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b6b60d6-27c4-489b-9101-5c1615805b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:38 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-2342fcf4-3ba7-4ccd-a2ad-779bd61f048c tempest-CreateVolumesFromSnapshotTest-1115355121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efb657f4-aa54-4ed1-86eb-0a03b3eb4215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:38 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-2342fcf4-3ba7-4ccd-a2ad-779bd61f048c tempest-CreateVolumesFromSnapshotTest-1115355121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efb657f4-aa54-4ed1-86eb-0a03b3eb4215) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c643e8b6-491f-4c52-b083-e406e26b8a17', 'volume_name': 'volume-c643e8b6-491f-4c52-b083-e406e26b8a17', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:38 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-2342fcf4-3ba7-4ccd-a2ad-779bd61f048c tempest-CreateVolumesFromSnapshotTest-1115355121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8303bb6e-e300-4a3e-9e91-d87d7176a4f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:38 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-2342fcf4-3ba7-4ccd-a2ad-779bd61f048c tempest-CreateVolumesFromSnapshotTest-1115355121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8303bb6e-e300-4a3e-9e91-d87d7176a4f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:38 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-2342fcf4-3ba7-4ccd-a2ad-779bd61f048c tempest-CreateVolumesFromSnapshotTest-1115355121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17a90ced-f590-400f-952d-31009ef47af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:38 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-2342fcf4-3ba7-4ccd-a2ad-779bd61f048c tempest-CreateVolumesFromSnapshotTest-1115355121 None] Volume c643e8b6-491f-4c52-b083-e406e26b8a17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c643e8b6-491f-4c52-b083-e406e26b8a17', 'volume_size': 1} Sep 28 09:40:38 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-2342fcf4-3ba7-4ccd-a2ad-779bd61f048c tempest-CreateVolumesFromSnapshotTest-1115355121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:40:38 devstack sudo[107046]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:38 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-56d838f5-3cd0-4b8e-81e3-3126c4c07041 tempest-CreateVolumesFromSnapshotTest-1115355121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-de4d4e39-cf09-44fd-a0e8-9ffead2cd014" returned: 0 in 0.420s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:38 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-56d838f5-3cd0-4b8e-81e3-3126c4c07041 tempest-CreateVolumesFromSnapshotTest-1115355121 None] <== create_volume: return (1183ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:40:38 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-56d838f5-3cd0-4b8e-81e3-3126c4c07041 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.188s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:40:38 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-1e8786ac-c1d6-4112-8374-e30e2192f544 tempest-CinderUnicodeTest-934001813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.980s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:40:38 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-1e8786ac-c1d6-4112-8374-e30e2192f544 tempest-CinderUnicodeTest-934001813 None] Creating offline snapshot 36201964-3dee-402d-9308-bca1550be063 of volume f689dbf9-156a-4785-9bdf-918603e7999c {{(pid=86553) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 09:40:38 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-56d838f5-3cd0-4b8e-81e3-3126c4c07041 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (392abc9d-ca91-477b-8ba2-e03f32f6f84a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de4d4e39-cf09-44fd-a0e8-9ffead2cd014', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:38 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-56d838f5-3cd0-4b8e-81e3-3126c4c07041 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d16e7e2-5042-41e4-bcbd-955a0dee851f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:38 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aeaeebe-72b5-45e0-9d22-d3abb1ca7a89]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:40:38 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1e8786ac-c1d6-4112-8374-e30e2192f544 tempest-CinderUnicodeTest-934001813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f689dbf9-156a-4785-9bdf-918603e7999c {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:38 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-56d838f5-3cd0-4b8e-81e3-3126c4c07041 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Volume volume-de4d4e39-cf09-44fd-a0e8-9ffead2cd014 (de4d4e39-cf09-44fd-a0e8-9ffead2cd014): created successfully Sep 28 09:40:38 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-56d838f5-3cd0-4b8e-81e3-3126c4c07041 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d16e7e2-5042-41e4-bcbd-955a0dee851f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:38 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-56d838f5-3cd0-4b8e-81e3-3126c4c07041 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Flow 'volume_create_manager' (7fa00043-93cc-4efa-8571-4f44deeb2deb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:40:38 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-56d838f5-3cd0-4b8e-81e3-3126c4c07041 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Created volume successfully. Sep 28 09:40:38 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-96b74a3a-1191-4b36-a682-1ef974b700a2 tempest-ProjectMemberTests-186690331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:40:38 devstack sudo[107049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f689dbf9-156a-4785-9bdf-918603e7999c Sep 28 09:40:38 devstack sudo[107049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:38 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c8b816d-a8a7-4c22-8314-c6cb1b2cb22d tempest-CreateVolumesFromSnapshotTest-1115355121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:40:39 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-1c8b816d-a8a7-4c22-8314-c6cb1b2cb22d tempest-CreateVolumesFromSnapshotTest-1115355121 None] Flow 'volume_create_manager' (81e77f46-475b-4ceb-b090-36b3a4afc72f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:40:39 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-1c8b816d-a8a7-4c22-8314-c6cb1b2cb22d tempest-CreateVolumesFromSnapshotTest-1115355121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53d9bf52-5372-430f-a148-39900da46481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:39 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-1c8b816d-a8a7-4c22-8314-c6cb1b2cb22d tempest-CreateVolumesFromSnapshotTest-1115355121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53d9bf52-5372-430f-a148-39900da46481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:40:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1930524963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5aab7b8-a06e-4e4c-b502-58b2418c53a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3a018ea1a7f443f995907f85fbd4e20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:40:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:40:39Z,use_quota=True,user_id='f742cd667c1449578c5b6c6cd8bfca09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:39 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-1c8b816d-a8a7-4c22-8314-c6cb1b2cb22d tempest-CreateVolumesFromSnapshotTest-1115355121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (758903d4-74b4-4fef-897b-5e30253858ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:39 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-1c8b816d-a8a7-4c22-8314-c6cb1b2cb22d tempest-CreateVolumesFromSnapshotTest-1115355121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (758903d4-74b4-4fef-897b-5e30253858ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:39 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-1c8b816d-a8a7-4c22-8314-c6cb1b2cb22d tempest-CreateVolumesFromSnapshotTest-1115355121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b0edc23-ab38-480b-9ce1-abe627a8c463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:39 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-1c8b816d-a8a7-4c22-8314-c6cb1b2cb22d tempest-CreateVolumesFromSnapshotTest-1115355121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b0edc23-ab38-480b-9ce1-abe627a8c463) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5aab7b8-a06e-4e4c-b502-58b2418c53a7', 'volume_name': 'volume-c5aab7b8-a06e-4e4c-b502-58b2418c53a7', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:39 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-1c8b816d-a8a7-4c22-8314-c6cb1b2cb22d tempest-CreateVolumesFromSnapshotTest-1115355121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b76ff05-7c35-4d85-a829-93147fb28691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:39 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-1c8b816d-a8a7-4c22-8314-c6cb1b2cb22d tempest-CreateVolumesFromSnapshotTest-1115355121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b76ff05-7c35-4d85-a829-93147fb28691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:39 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-1c8b816d-a8a7-4c22-8314-c6cb1b2cb22d tempest-CreateVolumesFromSnapshotTest-1115355121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6901b7ad-aa04-45bb-999a-4ef22bb2755d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:39 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-1c8b816d-a8a7-4c22-8314-c6cb1b2cb22d tempest-CreateVolumesFromSnapshotTest-1115355121 None] Volume c5aab7b8-a06e-4e4c-b502-58b2418c53a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5aab7b8-a06e-4e4c-b502-58b2418c53a7', 'volume_size': 1} Sep 28 09:40:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-1c8b816d-a8a7-4c22-8314-c6cb1b2cb22d tempest-CreateVolumesFromSnapshotTest-1115355121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:40:39 devstack sudo[107049]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1e8786ac-c1d6-4112-8374-e30e2192f544 tempest-CinderUnicodeTest-934001813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f689dbf9-156a-4785-9bdf-918603e7999c" returned: 0 in 0.436s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1e8786ac-c1d6-4112-8374-e30e2192f544 tempest-CinderUnicodeTest-934001813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f689dbf9-156a-4785-9bdf-918603e7999c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f689dbf9-156a-4785-9bdf-918603e7999c.36201964-3dee-402d-9308-bca1550be063 1G {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:39 devstack sudo[107054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f689dbf9-156a-4785-9bdf-918603e7999c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f689dbf9-156a-4785-9bdf-918603e7999c.36201964-3dee-402d-9308-bca1550be063 1G Sep 28 09:40:39 devstack sudo[107054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:39 devstack sudo[107054]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1e8786ac-c1d6-4112-8374-e30e2192f544 tempest-CinderUnicodeTest-934001813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f689dbf9-156a-4785-9bdf-918603e7999c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f689dbf9-156a-4785-9bdf-918603e7999c.36201964-3dee-402d-9308-bca1550be063 1G" returned: 0 in 0.454s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1e8786ac-c1d6-4112-8374-e30e2192f544 tempest-CinderUnicodeTest-934001813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f689dbf9-156a-4785-9bdf-918603e7999c -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f689dbf9-156a-4785-9bdf-918603e7999c.36201964-3dee-402d-9308-bca1550be063 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:39 devstack sudo[107060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f689dbf9-156a-4785-9bdf-918603e7999c -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f689dbf9-156a-4785-9bdf-918603e7999c.36201964-3dee-402d-9308-bca1550be063 Sep 28 09:40:39 devstack sudo[107060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:40 devstack sudo[107060]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:40 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1e8786ac-c1d6-4112-8374-e30e2192f544 tempest-CinderUnicodeTest-934001813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f689dbf9-156a-4785-9bdf-918603e7999c -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f689dbf9-156a-4785-9bdf-918603e7999c.36201964-3dee-402d-9308-bca1550be063" returned: 0 in 0.328s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:40 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-1e8786ac-c1d6-4112-8374-e30e2192f544 tempest-CinderUnicodeTest-934001813 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f689dbf9-156a-4785-9bdf-918603e7999c.36201964-3dee-402d-9308-bca1550be063 is being set with open permissions: ugo+rw Sep 28 09:40:40 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1e8786ac-c1d6-4112-8374-e30e2192f544 tempest-CinderUnicodeTest-934001813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f689dbf9-156a-4785-9bdf-918603e7999c.36201964-3dee-402d-9308-bca1550be063 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:40 devstack sudo[107065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f689dbf9-156a-4785-9bdf-918603e7999c.36201964-3dee-402d-9308-bca1550be063 Sep 28 09:40:40 devstack sudo[107065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:40 devstack sudo[107065]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:40 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1e8786ac-c1d6-4112-8374-e30e2192f544 tempest-CinderUnicodeTest-934001813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f689dbf9-156a-4785-9bdf-918603e7999c.36201964-3dee-402d-9308-bca1550be063" returned: 0 in 0.251s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:40 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1e8786ac-c1d6-4112-8374-e30e2192f544 tempest-CinderUnicodeTest-934001813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f689dbf9-156a-4785-9bdf-918603e7999c.info {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:40 devstack sudo[107068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f689dbf9-156a-4785-9bdf-918603e7999c.info Sep 28 09:40:40 devstack sudo[107068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:40 devstack sudo[107068]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:40 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1e8786ac-c1d6-4112-8374-e30e2192f544 tempest-CinderUnicodeTest-934001813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f689dbf9-156a-4785-9bdf-918603e7999c.info" returned: 0 in 0.271s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:40 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-1e8786ac-c1d6-4112-8374-e30e2192f544 tempest-CinderUnicodeTest-934001813 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f689dbf9-156a-4785-9bdf-918603e7999c.info is being set with open permissions: ugo+rw Sep 28 09:40:40 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1e8786ac-c1d6-4112-8374-e30e2192f544 tempest-CinderUnicodeTest-934001813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f689dbf9-156a-4785-9bdf-918603e7999c.info {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:40 devstack sudo[107071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f689dbf9-156a-4785-9bdf-918603e7999c.info Sep 28 09:40:40 devstack sudo[107071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:40 devstack sudo[107071]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:40 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1e8786ac-c1d6-4112-8374-e30e2192f544 tempest-CinderUnicodeTest-934001813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f689dbf9-156a-4785-9bdf-918603e7999c.info" returned: 0 in 0.252s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:40 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-1e8786ac-c1d6-4112-8374-e30e2192f544 tempest-CinderUnicodeTest-934001813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.106s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:40:40 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-b19e51dd-7d9c-41e0-a929-b6b95a1c7b1a tempest-CreateVolumesFromSnapshotTest-1115355121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.947s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:40:40 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-b19e51dd-7d9c-41e0-a929-b6b95a1c7b1a tempest-CreateVolumesFromSnapshotTest-1115355121 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:40:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-443795028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f565bbc-14cf-4711-8b3c-c71c345a1cd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3a018ea1a7f443f995907f85fbd4e20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:40:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:40:38Z,use_quota=True,user_id='f742cd667c1449578c5b6c6cd8bfca09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:40:40 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-b19e51dd-7d9c-41e0-a929-b6b95a1c7b1a tempest-CreateVolumesFromSnapshotTest-1115355121 None] Creating volume 2f565bbc-14cf-4711-8b3c-c71c345a1cd8 {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:40:40 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-b19e51dd-7d9c-41e0-a929-b6b95a1c7b1a tempest-CreateVolumesFromSnapshotTest-1115355121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:40:40 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-b19e51dd-7d9c-41e0-a929-b6b95a1c7b1a tempest-CreateVolumesFromSnapshotTest-1115355121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:40:40 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-b19e51dd-7d9c-41e0-a929-b6b95a1c7b1a tempest-CreateVolumesFromSnapshotTest-1115355121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:40:40 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-b19e51dd-7d9c-41e0-a929-b6b95a1c7b1a tempest-CreateVolumesFromSnapshotTest-1115355121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:40:40 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-b19e51dd-7d9c-41e0-a929-b6b95a1c7b1a tempest-CreateVolumesFromSnapshotTest-1115355121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:40:40 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-b19e51dd-7d9c-41e0-a929-b6b95a1c7b1a tempest-CreateVolumesFromSnapshotTest-1115355121 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:40:40 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-b19e51dd-7d9c-41e0-a929-b6b95a1c7b1a tempest-CreateVolumesFromSnapshotTest-1115355121 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:40:40 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b19e51dd-7d9c-41e0-a929-b6b95a1c7b1a tempest-CreateVolumesFromSnapshotTest-1115355121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-2f565bbc-14cf-4711-8b3c-c71c345a1cd8 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:40 devstack sudo[107074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-2f565bbc-14cf-4711-8b3c-c71c345a1cd8 1073741824 Sep 28 09:40:40 devstack sudo[107074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:40 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-1e8786ac-c1d6-4112-8374-e30e2192f544 tempest-CinderUnicodeTest-934001813 None] Create snapshot completed successfully Sep 28 09:40:41 devstack sudo[107074]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b19e51dd-7d9c-41e0-a929-b6b95a1c7b1a tempest-CreateVolumesFromSnapshotTest-1115355121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-2f565bbc-14cf-4711-8b3c-c71c345a1cd8 1073741824" returned: 0 in 0.481s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b19e51dd-7d9c-41e0-a929-b6b95a1c7b1a tempest-CreateVolumesFromSnapshotTest-1115355121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-2f565bbc-14cf-4711-8b3c-c71c345a1cd8 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:41 devstack sudo[107080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-2f565bbc-14cf-4711-8b3c-c71c345a1cd8 Sep 28 09:40:41 devstack sudo[107080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:41 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-f43c4ecd-5724-4544-a7f1-f8425fd6ecd0 tempest-CinderUnicodeTest-934001813 None] Acquiring lock "cinder-36201964-3dee-402d-9308-bca1550be063-delete_snapshot" by "delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:40:41 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-f43c4ecd-5724-4544-a7f1-f8425fd6ecd0 tempest-CinderUnicodeTest-934001813 None] Lock "cinder-36201964-3dee-402d-9308-bca1550be063-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:40:41 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-f43c4ecd-5724-4544-a7f1-f8425fd6ecd0 tempest-CinderUnicodeTest-934001813 None] Acquiring lock "cinder-quobyte-f689dbf9-156a-4785-9bdf-918603e7999c" by "delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:40:41 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-f43c4ecd-5724-4544-a7f1-f8425fd6ecd0 tempest-CinderUnicodeTest-934001813 None] Lock "cinder-quobyte-f689dbf9-156a-4785-9bdf-918603e7999c" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:40:41 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-f43c4ecd-5724-4544-a7f1-f8425fd6ecd0 tempest-CinderUnicodeTest-934001813 None] Acquiring lock "cinder-quobyte-36201964-3dee-402d-9308-bca1550be063" by "_delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:40:41 devstack sudo[107080]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b19e51dd-7d9c-41e0-a929-b6b95a1c7b1a tempest-CreateVolumesFromSnapshotTest-1115355121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-2f565bbc-14cf-4711-8b3c-c71c345a1cd8" returned: 0 in 0.288s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:41 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-b19e51dd-7d9c-41e0-a929-b6b95a1c7b1a tempest-CreateVolumesFromSnapshotTest-1115355121 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:40:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-b19e51dd-7d9c-41e0-a929-b6b95a1c7b1a tempest-CreateVolumesFromSnapshotTest-1115355121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:40:41 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-f43c4ecd-5724-4544-a7f1-f8425fd6ecd0 tempest-CinderUnicodeTest-934001813 None] Lock "cinder-quobyte-36201964-3dee-402d-9308-bca1550be063" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:40:41 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-f43c4ecd-5724-4544-a7f1-f8425fd6ecd0 tempest-CinderUnicodeTest-934001813 None] Deleting offline snapshot 36201964-3dee-402d-9308-bca1550be063 of volume f689dbf9-156a-4785-9bdf-918603e7999c {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 09:40:41 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-f43c4ecd-5724-4544-a7f1-f8425fd6ecd0 tempest-CinderUnicodeTest-934001813 None] snapshot_file for this snap is: volume-f689dbf9-156a-4785-9bdf-918603e7999c.36201964-3dee-402d-9308-bca1550be063 {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 09:40:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-55e2671b-9700-4503-ad5c-2c5772946b25 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.668s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:40:41 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-55e2671b-9700-4503-ad5c-2c5772946b25 tempest-CreateVolumesFromSnapshotTest-1115355121 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:40:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-613757064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=242fd277-0f68-43bf-9a72-b0c556e21726,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3a018ea1a7f443f995907f85fbd4e20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:40:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:40:38Z,use_quota=True,user_id='f742cd667c1449578c5b6c6cd8bfca09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:40:41 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-55e2671b-9700-4503-ad5c-2c5772946b25 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Creating volume 242fd277-0f68-43bf-9a72-b0c556e21726 {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:40:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-55e2671b-9700-4503-ad5c-2c5772946b25 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:40:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-55e2671b-9700-4503-ad5c-2c5772946b25 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:40:41 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-55e2671b-9700-4503-ad5c-2c5772946b25 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:40:41 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-55e2671b-9700-4503-ad5c-2c5772946b25 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:40:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-55e2671b-9700-4503-ad5c-2c5772946b25 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:40:41 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-55e2671b-9700-4503-ad5c-2c5772946b25 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:40:41 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-55e2671b-9700-4503-ad5c-2c5772946b25 tempest-CreateVolumesFromSnapshotTest-1115355121 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:40:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-55e2671b-9700-4503-ad5c-2c5772946b25 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-242fd277-0f68-43bf-9a72-b0c556e21726 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:41 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4c0a336-6a67-48d0-8289-0e58df2f1a73]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:40:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f43c4ecd-5724-4544-a7f1-f8425fd6ecd0 tempest-CinderUnicodeTest-934001813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f689dbf9-156a-4785-9bdf-918603e7999c.36201964-3dee-402d-9308-bca1550be063 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:41 devstack sudo[107083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-242fd277-0f68-43bf-9a72-b0c556e21726 1073741824 Sep 28 09:40:41 devstack sudo[107083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:41 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b19e51dd-7d9c-41e0-a929-b6b95a1c7b1a tempest-CreateVolumesFromSnapshotTest-1115355121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (439e8546-df3e-4fa3-9b88-33b30d94afb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f565bbc-14cf-4711-8b3c-c71c345a1cd8', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:41 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b19e51dd-7d9c-41e0-a929-b6b95a1c7b1a tempest-CreateVolumesFromSnapshotTest-1115355121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0243d899-93f8-4ed0-b219-348cc5271d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:41 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-b19e51dd-7d9c-41e0-a929-b6b95a1c7b1a tempest-CreateVolumesFromSnapshotTest-1115355121 None] Volume volume-2f565bbc-14cf-4711-8b3c-c71c345a1cd8 (2f565bbc-14cf-4711-8b3c-c71c345a1cd8): created successfully Sep 28 09:40:41 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b19e51dd-7d9c-41e0-a929-b6b95a1c7b1a tempest-CreateVolumesFromSnapshotTest-1115355121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0243d899-93f8-4ed0-b219-348cc5271d75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:41 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-b19e51dd-7d9c-41e0-a929-b6b95a1c7b1a tempest-CreateVolumesFromSnapshotTest-1115355121 None] Flow 'volume_create_manager' (0aef5249-f31a-4246-98cf-8b883c4128eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:40:41 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-b19e51dd-7d9c-41e0-a929-b6b95a1c7b1a tempest-CreateVolumesFromSnapshotTest-1115355121 None] Created volume successfully. Sep 28 09:40:41 devstack sudo[107084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f689dbf9-156a-4785-9bdf-918603e7999c.36201964-3dee-402d-9308-bca1550be063 Sep 28 09:40:41 devstack sudo[107084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:41 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e9633a8-7885-41a1-8d38-040be5fd37b8 tempest-VolumeImageDependencyTests-692568895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:40:41 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-1e9633a8-7885-41a1-8d38-040be5fd37b8 tempest-VolumeImageDependencyTests-692568895 None] Flow 'volume_create_manager' (42b63364-6418-4c56-ad8b-498b55978996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:40:41 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-1e9633a8-7885-41a1-8d38-040be5fd37b8 tempest-VolumeImageDependencyTests-692568895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95349fc8-9f31-4277-87c7-21354e373365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:41 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-1e9633a8-7885-41a1-8d38-040be5fd37b8 tempest-VolumeImageDependencyTests-692568895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95349fc8-9f31-4277-87c7-21354e373365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:40:42Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f8b5af7-ce68-4ec0-8f7c-cfa93f8ef7ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2037b41767c14b239bb7c4d6bf71ad7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:40:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:40:42Z,use_quota=True,user_id='772044f337954beb92a4872fa52e7fce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:41 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-1e9633a8-7885-41a1-8d38-040be5fd37b8 tempest-VolumeImageDependencyTests-692568895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2edfeb1-a5f4-425e-8ab0-197b6078c26a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:42 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-1e9633a8-7885-41a1-8d38-040be5fd37b8 tempest-VolumeImageDependencyTests-692568895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2edfeb1-a5f4-425e-8ab0-197b6078c26a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:42 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-1e9633a8-7885-41a1-8d38-040be5fd37b8 tempest-VolumeImageDependencyTests-692568895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1456342-4033-46e7-abdd-f1e221c8d990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:42 devstack cinder-volume[86553]: DEBUG cinder.image.glance [None req-1e9633a8-7885-41a1-8d38-040be5fd37b8 tempest-VolumeImageDependencyTests-692568895 None] Creating Keystone auth plugin from conf {{(pid=86553) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 09:40:42 devstack sudo[107084]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f43c4ecd-5724-4544-a7f1-f8425fd6ecd0 tempest-CinderUnicodeTest-934001813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f689dbf9-156a-4785-9bdf-918603e7999c.36201964-3dee-402d-9308-bca1550be063" returned: 0 in 0.409s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:42 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-f43c4ecd-5724-4544-a7f1-f8425fd6ecd0 tempest-CinderUnicodeTest-934001813 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f689dbf9-156a-4785-9bdf-918603e7999c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86553) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 09:40:42 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f1f226a-0296-4a87-8f05-3781ca346233]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:40:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f43c4ecd-5724-4544-a7f1-f8425fd6ecd0 tempest-CinderUnicodeTest-934001813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f689dbf9-156a-4785-9bdf-918603e7999c {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:42 devstack sudo[107083]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:42 devstack sudo[107095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f689dbf9-156a-4785-9bdf-918603e7999c Sep 28 09:40:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-55e2671b-9700-4503-ad5c-2c5772946b25 tempest-CreateVolumesFromSnapshotTest-1115355121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-242fd277-0f68-43bf-9a72-b0c556e21726 1073741824" returned: 0 in 0.593s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:42 devstack sudo[107095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-55e2671b-9700-4503-ad5c-2c5772946b25 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-242fd277-0f68-43bf-9a72-b0c556e21726 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:42 devstack sudo[107097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-242fd277-0f68-43bf-9a72-b0c556e21726 Sep 28 09:40:42 devstack sudo[107097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:42 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-1e9633a8-7885-41a1-8d38-040be5fd37b8 tempest-VolumeImageDependencyTests-692568895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1456342-4033-46e7-abdd-f1e221c8d990) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5f8b5af7-ce68-4ec0-8f7c-cfa93f8ef7ca', 'volume_name': 'volume-5f8b5af7-ce68-4ec0-8f7c-cfa93f8ef7ca', 'volume_size': 1, 'image_id': '8adcc488-416d-442f-9b50-51e3c34a65ef', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8adcc488-416d-442f-9b50-51e3c34a65ef', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3b8d3b2a5a91aad8ea97a0f1705b825f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2037b41767c14b239bb7c4d6bf71ad7e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '83a97584cf472274ad173645e7755f14d99d017aef275d63f94571266ad1868901cb039482fe12eb60fabca5e8152c5e635c575f64259cf617e6533acd61a71e', 'id': '8adcc488-416d-442f-9b50-51e3c34a65ef', 'created_at': datetime.datetime(2026, 9, 28, 7, 40, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 7, 40, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8adcc488-416d-442f-9b50-51e3c34a65ef/file', 'properties': {}}, 'image_service': }' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:42 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-1e9633a8-7885-41a1-8d38-040be5fd37b8 tempest-VolumeImageDependencyTests-692568895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79b737ec-2ccd-45df-aaeb-1f56f723e4f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:42 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-1e9633a8-7885-41a1-8d38-040be5fd37b8 tempest-VolumeImageDependencyTests-692568895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79b737ec-2ccd-45df-aaeb-1f56f723e4f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:42 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-1e9633a8-7885-41a1-8d38-040be5fd37b8 tempest-VolumeImageDependencyTests-692568895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6fb5af2-c23f-4099-93f1-4159668ea23e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:42 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-1e9633a8-7885-41a1-8d38-040be5fd37b8 tempest-VolumeImageDependencyTests-692568895 None] Volume 5f8b5af7-ce68-4ec0-8f7c-cfa93f8ef7ca: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5f8b5af7-ce68-4ec0-8f7c-cfa93f8ef7ca', 'volume_size': 1, 'image_id': '8adcc488-416d-442f-9b50-51e3c34a65ef', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8adcc488-416d-442f-9b50-51e3c34a65ef', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3b8d3b2a5a91aad8ea97a0f1705b825f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2037b41767c14b239bb7c4d6bf71ad7e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '83a97584cf472274ad173645e7755f14d99d017aef275d63f94571266ad1868901cb039482fe12eb60fabca5e8152c5e635c575f64259cf617e6533acd61a71e', 'id': '8adcc488-416d-442f-9b50-51e3c34a65ef', 'created_at': datetime.datetime(2026, 9, 28, 7, 40, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 7, 40, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8adcc488-416d-442f-9b50-51e3c34a65ef/file', 'properties': {}}, 'image_service': } Sep 28 09:40:42 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e9633a8-7885-41a1-8d38-040be5fd37b8 tempest-VolumeImageDependencyTests-692568895 None] Trying to clone 5f8b5af7-ce68-4ec0-8f7c-cfa93f8ef7ca from image 8adcc488-416d-442f-9b50-51e3c34a65ef at location (None, [{'url': 'file:///opt/stack/data/glance/images/8adcc488-416d-442f-9b50-51e3c34a65ef', 'metadata': {}}]). {{(pid=86553) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 09:40:42 devstack cinder-volume[86553]: DEBUG cinder.image.image_utils [None req-1e9633a8-7885-41a1-8d38-040be5fd37b8 tempest-VolumeImageDependencyTests-692568895 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8adcc488-416d-442f-9b50-51e3c34a65ef_g62nfziqdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86553) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 09:40:42 devstack cinder-volume[86553]: INFO cinder.image.image_utils [None req-1e9633a8-7885-41a1-8d38-040be5fd37b8 tempest-VolumeImageDependencyTests-692568895 None] Image download 0.00 MB at 0.00 MB/s Sep 28 09:40:42 devstack sudo[107095]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f43c4ecd-5724-4544-a7f1-f8425fd6ecd0 tempest-CinderUnicodeTest-934001813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f689dbf9-156a-4785-9bdf-918603e7999c" returned: 0 in 0.393s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f43c4ecd-5724-4544-a7f1-f8425fd6ecd0 tempest-CinderUnicodeTest-934001813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f689dbf9-156a-4785-9bdf-918603e7999c.36201964-3dee-402d-9308-bca1550be063 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:42 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bbad022-b706-4ada-9867-75c0d427d9cb]: (4, 'raw') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:40:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1e9633a8-7885-41a1-8d38-040be5fd37b8 tempest-VolumeImageDependencyTests-692568895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8adcc488-416d-442f-9b50-51e3c34a65ef_g62nfziqdevstack@QuobyteHD {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:42 devstack sudo[107102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f689dbf9-156a-4785-9bdf-918603e7999c.36201964-3dee-402d-9308-bca1550be063 Sep 28 09:40:42 devstack sudo[107102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:42 devstack sudo[107097]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-55e2671b-9700-4503-ad5c-2c5772946b25 tempest-CreateVolumesFromSnapshotTest-1115355121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-242fd277-0f68-43bf-9a72-b0c556e21726" returned: 0 in 0.280s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:42 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-55e2671b-9700-4503-ad5c-2c5772946b25 tempest-CreateVolumesFromSnapshotTest-1115355121 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:40:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-55e2671b-9700-4503-ad5c-2c5772946b25 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:40:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-2342fcf4-3ba7-4ccd-a2ad-779bd61f048c tempest-CreateVolumesFromSnapshotTest-1115355121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.107s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:40:42 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-2342fcf4-3ba7-4ccd-a2ad-779bd61f048c tempest-CreateVolumesFromSnapshotTest-1115355121 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:40:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-511877954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c643e8b6-491f-4c52-b083-e406e26b8a17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3a018ea1a7f443f995907f85fbd4e20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:40:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:40:38Z,use_quota=True,user_id='f742cd667c1449578c5b6c6cd8bfca09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:40:42 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-2342fcf4-3ba7-4ccd-a2ad-779bd61f048c tempest-CreateVolumesFromSnapshotTest-1115355121 None] Creating volume c643e8b6-491f-4c52-b083-e406e26b8a17 {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:40:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-2342fcf4-3ba7-4ccd-a2ad-779bd61f048c tempest-CreateVolumesFromSnapshotTest-1115355121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:40:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-2342fcf4-3ba7-4ccd-a2ad-779bd61f048c tempest-CreateVolumesFromSnapshotTest-1115355121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:40:42 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-2342fcf4-3ba7-4ccd-a2ad-779bd61f048c tempest-CreateVolumesFromSnapshotTest-1115355121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:40:42 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-2342fcf4-3ba7-4ccd-a2ad-779bd61f048c tempest-CreateVolumesFromSnapshotTest-1115355121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:40:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-2342fcf4-3ba7-4ccd-a2ad-779bd61f048c tempest-CreateVolumesFromSnapshotTest-1115355121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:40:42 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-2342fcf4-3ba7-4ccd-a2ad-779bd61f048c tempest-CreateVolumesFromSnapshotTest-1115355121 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:40:42 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-2342fcf4-3ba7-4ccd-a2ad-779bd61f048c tempest-CreateVolumesFromSnapshotTest-1115355121 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:40:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2342fcf4-3ba7-4ccd-a2ad-779bd61f048c tempest-CreateVolumesFromSnapshotTest-1115355121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c643e8b6-491f-4c52-b083-e406e26b8a17 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:42 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-55e2671b-9700-4503-ad5c-2c5772946b25 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a22daad9-6be0-4236-ae70-38a549e3ec52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-242fd277-0f68-43bf-9a72-b0c556e21726', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:42 devstack sudo[107106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c643e8b6-491f-4c52-b083-e406e26b8a17 1073741824 Sep 28 09:40:42 devstack sudo[107106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:42 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-55e2671b-9700-4503-ad5c-2c5772946b25 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75588292-0f8d-4f96-9acd-a59a3caca4b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:42 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-55e2671b-9700-4503-ad5c-2c5772946b25 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Volume volume-242fd277-0f68-43bf-9a72-b0c556e21726 (242fd277-0f68-43bf-9a72-b0c556e21726): created successfully Sep 28 09:40:42 devstack sudo[107104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8adcc488-416d-442f-9b50-51e3c34a65ef_g62nfziqdevstack@QuobyteHD Sep 28 09:40:42 devstack sudo[107104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:42 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-55e2671b-9700-4503-ad5c-2c5772946b25 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75588292-0f8d-4f96-9acd-a59a3caca4b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:42 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-55e2671b-9700-4503-ad5c-2c5772946b25 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Flow 'volume_create_manager' (24f3e9ce-a4d7-4863-b7cc-f1592d29aebb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:40:42 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-55e2671b-9700-4503-ad5c-2c5772946b25 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Created volume successfully. Sep 28 09:40:43 devstack sudo[107102]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:43 devstack sudo[107104]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:43 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f43c4ecd-5724-4544-a7f1-f8425fd6ecd0 tempest-CinderUnicodeTest-934001813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f689dbf9-156a-4785-9bdf-918603e7999c.36201964-3dee-402d-9308-bca1550be063" returned: 0 in 0.388s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:43 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f43c4ecd-5724-4544-a7f1-f8425fd6ecd0 tempest-CinderUnicodeTest-934001813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f689dbf9-156a-4785-9bdf-918603e7999c.36201964-3dee-402d-9308-bca1550be063 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:43 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1e9633a8-7885-41a1-8d38-040be5fd37b8 tempest-VolumeImageDependencyTests-692568895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8adcc488-416d-442f-9b50-51e3c34a65ef_g62nfziqdevstack@QuobyteHD" returned: 0 in 0.381s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:43 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1e9633a8-7885-41a1-8d38-040be5fd37b8 tempest-VolumeImageDependencyTests-692568895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8adcc488-416d-442f-9b50-51e3c34a65ef_g62nfziqdevstack@QuobyteHD {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:43 devstack sudo[107118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f689dbf9-156a-4785-9bdf-918603e7999c.36201964-3dee-402d-9308-bca1550be063 Sep 28 09:40:43 devstack sudo[107118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:43 devstack sudo[107119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8adcc488-416d-442f-9b50-51e3c34a65ef_g62nfziqdevstack@QuobyteHD Sep 28 09:40:43 devstack sudo[107119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:43 devstack sudo[107106]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:43 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2342fcf4-3ba7-4ccd-a2ad-779bd61f048c tempest-CreateVolumesFromSnapshotTest-1115355121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c643e8b6-491f-4c52-b083-e406e26b8a17 1073741824" returned: 0 in 0.557s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:43 devstack sudo[107118]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:43 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f43c4ecd-5724-4544-a7f1-f8425fd6ecd0 tempest-CinderUnicodeTest-934001813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f689dbf9-156a-4785-9bdf-918603e7999c.36201964-3dee-402d-9308-bca1550be063" returned: 0 in 0.285s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:43 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2342fcf4-3ba7-4ccd-a2ad-779bd61f048c tempest-CreateVolumesFromSnapshotTest-1115355121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c643e8b6-491f-4c52-b083-e406e26b8a17 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:43 devstack sudo[107124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c643e8b6-491f-4c52-b083-e406e26b8a17 Sep 28 09:40:43 devstack sudo[107124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:43 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-f43c4ecd-5724-4544-a7f1-f8425fd6ecd0 tempest-CinderUnicodeTest-934001813 None] Lock "cinder-quobyte-36201964-3dee-402d-9308-bca1550be063" released by "_delete_snapshot" :: held 1.652s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:40:43 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-f43c4ecd-5724-4544-a7f1-f8425fd6ecd0 tempest-CinderUnicodeTest-934001813 None] Lock "cinder-quobyte-f689dbf9-156a-4785-9bdf-918603e7999c" released by "delete_snapshot" :: held 1.689s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:40:43 devstack sudo[107119]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:43 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1e9633a8-7885-41a1-8d38-040be5fd37b8 tempest-VolumeImageDependencyTests-692568895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8adcc488-416d-442f-9b50-51e3c34a65ef_g62nfziqdevstack@QuobyteHD" returned: 1 in 0.367s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:43 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1e9633a8-7885-41a1-8d38-040be5fd37b8 tempest-VolumeImageDependencyTests-692568895 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8adcc488-416d-442f-9b50-51e3c34a65ef_g62nfziqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 09:40:43 devstack cinder-volume[86553]: DEBUG cinder.image.image_utils [None req-1e9633a8-7885-41a1-8d38-040be5fd37b8 tempest-VolumeImageDependencyTests-692568895 None] Temporary image 8adcc488-416d-442f-9b50-51e3c34a65ef is fetched for user 772044f337954beb92a4872fa52e7fce. {{(pid=86553) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 09:40:43 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-f43c4ecd-5724-4544-a7f1-f8425fd6ecd0 tempest-CinderUnicodeTest-934001813 None] Created reservations ['82cff638-36ce-4dae-98d1-1836726a02df', '914041db-2fbd-4d50-a2bd-ed6934969e2a', '29df1559-8312-4303-86b1-34d56168a917', 'cda8bc3b-8e47-4682-abaf-a3592ec8b2e1'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:40:43 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[e739e72e-3d17-4db1-8653-87ebbd95018b]: (4, 'raw') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:40:43 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1e9633a8-7885-41a1-8d38-040be5fd37b8 tempest-VolumeImageDependencyTests-692568895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8adcc488-416d-442f-9b50-51e3c34a65ef_g62nfziqdevstack@QuobyteHD {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:43 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-f43c4ecd-5724-4544-a7f1-f8425fd6ecd0 tempest-CinderUnicodeTest-934001813 None] Delete snapshot completed successfully. Sep 28 09:40:43 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-f43c4ecd-5724-4544-a7f1-f8425fd6ecd0 tempest-CinderUnicodeTest-934001813 None] Lock "cinder-36201964-3dee-402d-9308-bca1550be063-delete_snapshot" released by "delete_snapshot" :: held 1.879s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:40:43 devstack sudo[107124]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:43 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2342fcf4-3ba7-4ccd-a2ad-779bd61f048c tempest-CreateVolumesFromSnapshotTest-1115355121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c643e8b6-491f-4c52-b083-e406e26b8a17" returned: 0 in 0.283s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:43 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-2342fcf4-3ba7-4ccd-a2ad-779bd61f048c tempest-CreateVolumesFromSnapshotTest-1115355121 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:40:43 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-2342fcf4-3ba7-4ccd-a2ad-779bd61f048c tempest-CreateVolumesFromSnapshotTest-1115355121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:40:43 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-96b74a3a-1191-4b36-a682-1ef974b700a2 tempest-ProjectMemberTests-186690331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.640s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:40:43 devstack sudo[107129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8adcc488-416d-442f-9b50-51e3c34a65ef_g62nfziqdevstack@QuobyteHD Sep 28 09:40:43 devstack sudo[107129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:43 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-96b74a3a-1191-4b36-a682-1ef974b700a2 tempest-ProjectMemberTests-186690331 None] Creating offline snapshot ed960e13-aaab-435f-8d59-c269ea5d114a of volume 9975178b-255e-43b8-af32-6fb62ef9dcfc {{(pid=86553) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 09:40:43 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-2342fcf4-3ba7-4ccd-a2ad-779bd61f048c tempest-CreateVolumesFromSnapshotTest-1115355121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17a90ced-f590-400f-952d-31009ef47af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c643e8b6-491f-4c52-b083-e406e26b8a17', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:43 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-2342fcf4-3ba7-4ccd-a2ad-779bd61f048c tempest-CreateVolumesFromSnapshotTest-1115355121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f38fb65e-58d7-43bb-a85e-9b71d6021ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:43 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[63bbfb4f-473f-49a3-8f2e-2666db7e5428]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:40:43 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-96b74a3a-1191-4b36-a682-1ef974b700a2 tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9975178b-255e-43b8-af32-6fb62ef9dcfc {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:43 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-2342fcf4-3ba7-4ccd-a2ad-779bd61f048c tempest-CreateVolumesFromSnapshotTest-1115355121 None] Volume volume-c643e8b6-491f-4c52-b083-e406e26b8a17 (c643e8b6-491f-4c52-b083-e406e26b8a17): created successfully Sep 28 09:40:43 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-2342fcf4-3ba7-4ccd-a2ad-779bd61f048c tempest-CreateVolumesFromSnapshotTest-1115355121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f38fb65e-58d7-43bb-a85e-9b71d6021ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:43 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-2342fcf4-3ba7-4ccd-a2ad-779bd61f048c tempest-CreateVolumesFromSnapshotTest-1115355121 None] Flow 'volume_create_manager' (35f32217-c531-48cf-a328-b558e9dfbe17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:40:43 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-2342fcf4-3ba7-4ccd-a2ad-779bd61f048c tempest-CreateVolumesFromSnapshotTest-1115355121 None] Created volume successfully. Sep 28 09:40:43 devstack sudo[107132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9975178b-255e-43b8-af32-6fb62ef9dcfc Sep 28 09:40:43 devstack sudo[107132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:43 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-10fd90e0-4de9-4c7d-bfe1-72cf4d44f46e tempest-CinderUnicodeTest-934001813 None] Acquiring lock "cinder-f689dbf9-156a-4785-9bdf-918603e7999c-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:40:43 devstack sudo[107129]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:43 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1e9633a8-7885-41a1-8d38-040be5fd37b8 tempest-VolumeImageDependencyTests-692568895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8adcc488-416d-442f-9b50-51e3c34a65ef_g62nfziqdevstack@QuobyteHD" returned: 0 in 0.351s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:43 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1e9633a8-7885-41a1-8d38-040be5fd37b8 tempest-VolumeImageDependencyTests-692568895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8adcc488-416d-442f-9b50-51e3c34a65ef_g62nfziqdevstack@QuobyteHD {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:43 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-10fd90e0-4de9-4c7d-bfe1-72cf4d44f46e tempest-CinderUnicodeTest-934001813 None] Lock "cinder-f689dbf9-156a-4785-9bdf-918603e7999c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:40:43 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-10fd90e0-4de9-4c7d-bfe1-72cf4d44f46e tempest-CinderUnicodeTest-934001813 None] Acquiring lock "cinder-quobyte-f689dbf9-156a-4785-9bdf-918603e7999c" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:40:43 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-10fd90e0-4de9-4c7d-bfe1-72cf4d44f46e tempest-CinderUnicodeTest-934001813 None] Lock "cinder-quobyte-f689dbf9-156a-4785-9bdf-918603e7999c" acquired by "delete_volume" :: waited 0.021s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:40:43 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b5110ca-99f2-4354-98ae-62c5afe38794]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:40:43 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-10fd90e0-4de9-4c7d-bfe1-72cf4d44f46e tempest-CinderUnicodeTest-934001813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f689dbf9-156a-4785-9bdf-918603e7999c {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:43 devstack sudo[107136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8adcc488-416d-442f-9b50-51e3c34a65ef_g62nfziqdevstack@QuobyteHD Sep 28 09:40:43 devstack sudo[107136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:44 devstack sudo[107132]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-96b74a3a-1191-4b36-a682-1ef974b700a2 tempest-ProjectMemberTests-186690331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9975178b-255e-43b8-af32-6fb62ef9dcfc" returned: 0 in 0.426s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-96b74a3a-1191-4b36-a682-1ef974b700a2 tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9975178b-255e-43b8-af32-6fb62ef9dcfc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9975178b-255e-43b8-af32-6fb62ef9dcfc.ed960e13-aaab-435f-8d59-c269ea5d114a 1G {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:44 devstack sudo[107142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9975178b-255e-43b8-af32-6fb62ef9dcfc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9975178b-255e-43b8-af32-6fb62ef9dcfc.ed960e13-aaab-435f-8d59-c269ea5d114a 1G Sep 28 09:40:44 devstack sudo[107142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:44 devstack sudo[107140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f689dbf9-156a-4785-9bdf-918603e7999c Sep 28 09:40:44 devstack sudo[107140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:44 devstack sudo[107136]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1e9633a8-7885-41a1-8d38-040be5fd37b8 tempest-VolumeImageDependencyTests-692568895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8adcc488-416d-442f-9b50-51e3c34a65ef_g62nfziqdevstack@QuobyteHD" returned: 1 in 0.384s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1e9633a8-7885-41a1-8d38-040be5fd37b8 tempest-VolumeImageDependencyTests-692568895 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8adcc488-416d-442f-9b50-51e3c34a65ef_g62nfziqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 09:40:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-1e9633a8-7885-41a1-8d38-040be5fd37b8 tempest-VolumeImageDependencyTests-692568895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:40:44 devstack sudo[107140]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-10fd90e0-4de9-4c7d-bfe1-72cf4d44f46e tempest-CinderUnicodeTest-934001813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f689dbf9-156a-4785-9bdf-918603e7999c" returned: 0 in 0.416s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-10fd90e0-4de9-4c7d-bfe1-72cf4d44f46e tempest-CinderUnicodeTest-934001813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f689dbf9-156a-4785-9bdf-918603e7999c {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:44 devstack sudo[107154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f689dbf9-156a-4785-9bdf-918603e7999c Sep 28 09:40:44 devstack sudo[107154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:44 devstack sudo[107142]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-96b74a3a-1191-4b36-a682-1ef974b700a2 tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9975178b-255e-43b8-af32-6fb62ef9dcfc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9975178b-255e-43b8-af32-6fb62ef9dcfc.ed960e13-aaab-435f-8d59-c269ea5d114a 1G" returned: 0 in 0.431s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-96b74a3a-1191-4b36-a682-1ef974b700a2 tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9975178b-255e-43b8-af32-6fb62ef9dcfc -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9975178b-255e-43b8-af32-6fb62ef9dcfc.ed960e13-aaab-435f-8d59-c269ea5d114a {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:44 devstack sudo[107157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9975178b-255e-43b8-af32-6fb62ef9dcfc -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9975178b-255e-43b8-af32-6fb62ef9dcfc.ed960e13-aaab-435f-8d59-c269ea5d114a Sep 28 09:40:44 devstack sudo[107157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:44 devstack sudo[107154]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-10fd90e0-4de9-4c7d-bfe1-72cf4d44f46e tempest-CinderUnicodeTest-934001813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-f689dbf9-156a-4785-9bdf-918603e7999c" returned: 0 in 0.253s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:44 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-10fd90e0-4de9-4c7d-bfe1-72cf4d44f46e tempest-CinderUnicodeTest-934001813 None] Lock "cinder-quobyte-f689dbf9-156a-4785-9bdf-918603e7999c" released by "delete_volume" :: held 0.750s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:40:44 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-10fd90e0-4de9-4c7d-bfe1-72cf4d44f46e tempest-CinderUnicodeTest-934001813 None] Created reservations ['7b0a0f5d-5571-43a3-8886-9c4812c62977', 'c3c9354c-05b4-480e-bfb2-b7dc2e45aa89', '6532fa1a-d93f-4b28-8048-eec0665511ac', '8e5dd8cc-afff-44d5-8963-eb7e3d97804b'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:40:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-10fd90e0-4de9-4c7d-bfe1-72cf4d44f46e tempest-CinderUnicodeTest-934001813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:40:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-10fd90e0-4de9-4c7d-bfe1-72cf4d44f46e tempest-CinderUnicodeTest-934001813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:40:44 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-10fd90e0-4de9-4c7d-bfe1-72cf4d44f46e tempest-CinderUnicodeTest-934001813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:40:44 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-10fd90e0-4de9-4c7d-bfe1-72cf4d44f46e tempest-CinderUnicodeTest-934001813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:40:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-10fd90e0-4de9-4c7d-bfe1-72cf4d44f46e tempest-CinderUnicodeTest-934001813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:40:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-10fd90e0-4de9-4c7d-bfe1-72cf4d44f46e tempest-CinderUnicodeTest-934001813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:44 devstack sudo[107157]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-96b74a3a-1191-4b36-a682-1ef974b700a2 tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9975178b-255e-43b8-af32-6fb62ef9dcfc -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9975178b-255e-43b8-af32-6fb62ef9dcfc.ed960e13-aaab-435f-8d59-c269ea5d114a" returned: 0 in 0.312s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:44 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-96b74a3a-1191-4b36-a682-1ef974b700a2 tempest-ProjectMemberTests-186690331 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9975178b-255e-43b8-af32-6fb62ef9dcfc.ed960e13-aaab-435f-8d59-c269ea5d114a is being set with open permissions: ugo+rw Sep 28 09:40:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-96b74a3a-1191-4b36-a682-1ef974b700a2 tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9975178b-255e-43b8-af32-6fb62ef9dcfc.ed960e13-aaab-435f-8d59-c269ea5d114a {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:44 devstack sudo[107164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:40:44 devstack sudo[107164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:44 devstack sudo[107165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9975178b-255e-43b8-af32-6fb62ef9dcfc.ed960e13-aaab-435f-8d59-c269ea5d114a Sep 28 09:40:44 devstack sudo[107165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:45 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-847f5a0c-fe68-4ede-967f-6033027540e9 tempest-CinderUnicodeTest-934001813 None] Acquiring lock "cinder-c5865681-fbdb-4c60-89f0-02e721b59f22-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:40:45 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-847f5a0c-fe68-4ede-967f-6033027540e9 tempest-CinderUnicodeTest-934001813 None] Lock "cinder-c5865681-fbdb-4c60-89f0-02e721b59f22-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:40:45 devstack sudo[107164]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:45 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-10fd90e0-4de9-4c7d-bfe1-72cf4d44f46e tempest-CinderUnicodeTest-934001813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.281s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:45 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-10fd90e0-4de9-4c7d-bfe1-72cf4d44f46e tempest-CinderUnicodeTest-934001813 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:40:45 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-10fd90e0-4de9-4c7d-bfe1-72cf4d44f46e tempest-CinderUnicodeTest-934001813 None] Deleted volume successfully. Sep 28 09:40:45 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-847f5a0c-fe68-4ede-967f-6033027540e9 tempest-CinderUnicodeTest-934001813 None] Acquiring lock "cinder-quobyte-c5865681-fbdb-4c60-89f0-02e721b59f22" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:40:45 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-847f5a0c-fe68-4ede-967f-6033027540e9 tempest-CinderUnicodeTest-934001813 None] Lock "cinder-quobyte-c5865681-fbdb-4c60-89f0-02e721b59f22" acquired by "delete_volume" :: waited 0.019s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:40:45 devstack sudo[107165]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:45 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-10fd90e0-4de9-4c7d-bfe1-72cf4d44f46e tempest-CinderUnicodeTest-934001813 None] Lock "cinder-f689dbf9-156a-4785-9bdf-918603e7999c-delete_volume" released by "delete_volume" :: held 1.285s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:40:45 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-96b74a3a-1191-4b36-a682-1ef974b700a2 tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9975178b-255e-43b8-af32-6fb62ef9dcfc.ed960e13-aaab-435f-8d59-c269ea5d114a" returned: 0 in 0.320s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:45 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[5594f5ca-dcd7-4685-a9f2-a8d295df9b30]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:40:45 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-847f5a0c-fe68-4ede-967f-6033027540e9 tempest-CinderUnicodeTest-934001813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c5865681-fbdb-4c60-89f0-02e721b59f22 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:45 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-96b74a3a-1191-4b36-a682-1ef974b700a2 tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9975178b-255e-43b8-af32-6fb62ef9dcfc.info {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:45 devstack sudo[107171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9975178b-255e-43b8-af32-6fb62ef9dcfc.info Sep 28 09:40:45 devstack sudo[107171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:45 devstack sudo[107170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c5865681-fbdb-4c60-89f0-02e721b59f22 Sep 28 09:40:45 devstack sudo[107170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:45 devstack sudo[107171]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:45 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-96b74a3a-1191-4b36-a682-1ef974b700a2 tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9975178b-255e-43b8-af32-6fb62ef9dcfc.info" returned: 0 in 0.262s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:45 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-96b74a3a-1191-4b36-a682-1ef974b700a2 tempest-ProjectMemberTests-186690331 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9975178b-255e-43b8-af32-6fb62ef9dcfc.info is being set with open permissions: ugo+rw Sep 28 09:40:45 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-96b74a3a-1191-4b36-a682-1ef974b700a2 tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9975178b-255e-43b8-af32-6fb62ef9dcfc.info {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:45 devstack sudo[107176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9975178b-255e-43b8-af32-6fb62ef9dcfc.info Sep 28 09:40:45 devstack sudo[107176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:45 devstack sudo[107170]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:45 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-847f5a0c-fe68-4ede-967f-6033027540e9 tempest-CinderUnicodeTest-934001813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c5865681-fbdb-4c60-89f0-02e721b59f22" returned: 0 in 0.374s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:45 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-847f5a0c-fe68-4ede-967f-6033027540e9 tempest-CinderUnicodeTest-934001813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c5865681-fbdb-4c60-89f0-02e721b59f22 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:45 devstack sudo[107180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c5865681-fbdb-4c60-89f0-02e721b59f22 Sep 28 09:40:45 devstack sudo[107180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:45 devstack sudo[107176]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:45 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-96b74a3a-1191-4b36-a682-1ef974b700a2 tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9975178b-255e-43b8-af32-6fb62ef9dcfc.info" returned: 0 in 0.253s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:45 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-96b74a3a-1191-4b36-a682-1ef974b700a2 tempest-ProjectMemberTests-186690331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.108s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:40:45 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-1c8b816d-a8a7-4c22-8314-c6cb1b2cb22d tempest-CreateVolumesFromSnapshotTest-1115355121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.641s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:40:45 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-1c8b816d-a8a7-4c22-8314-c6cb1b2cb22d tempest-CreateVolumesFromSnapshotTest-1115355121 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:40:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1930524963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5aab7b8-a06e-4e4c-b502-58b2418c53a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3a018ea1a7f443f995907f85fbd4e20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:40:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:40:39Z,use_quota=True,user_id='f742cd667c1449578c5b6c6cd8bfca09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:40:45 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-1c8b816d-a8a7-4c22-8314-c6cb1b2cb22d tempest-CreateVolumesFromSnapshotTest-1115355121 None] Creating volume c5aab7b8-a06e-4e4c-b502-58b2418c53a7 {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:40:45 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-1c8b816d-a8a7-4c22-8314-c6cb1b2cb22d tempest-CreateVolumesFromSnapshotTest-1115355121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:40:45 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-1c8b816d-a8a7-4c22-8314-c6cb1b2cb22d tempest-CreateVolumesFromSnapshotTest-1115355121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:40:45 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-1c8b816d-a8a7-4c22-8314-c6cb1b2cb22d tempest-CreateVolumesFromSnapshotTest-1115355121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:40:45 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-1c8b816d-a8a7-4c22-8314-c6cb1b2cb22d tempest-CreateVolumesFromSnapshotTest-1115355121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:40:45 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-1c8b816d-a8a7-4c22-8314-c6cb1b2cb22d tempest-CreateVolumesFromSnapshotTest-1115355121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:40:45 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-1c8b816d-a8a7-4c22-8314-c6cb1b2cb22d tempest-CreateVolumesFromSnapshotTest-1115355121 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:40:45 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-1c8b816d-a8a7-4c22-8314-c6cb1b2cb22d tempest-CreateVolumesFromSnapshotTest-1115355121 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:40:45 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1c8b816d-a8a7-4c22-8314-c6cb1b2cb22d tempest-CreateVolumesFromSnapshotTest-1115355121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c5aab7b8-a06e-4e4c-b502-58b2418c53a7 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:45 devstack sudo[107183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c5aab7b8-a06e-4e4c-b502-58b2418c53a7 1073741824 Sep 28 09:40:45 devstack sudo[107183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:45 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-96b74a3a-1191-4b36-a682-1ef974b700a2 tempest-ProjectMemberTests-186690331 None] Create snapshot completed successfully Sep 28 09:40:45 devstack sudo[107180]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:45 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-847f5a0c-fe68-4ede-967f-6033027540e9 tempest-CinderUnicodeTest-934001813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c5865681-fbdb-4c60-89f0-02e721b59f22" returned: 0 in 0.268s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:45 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-847f5a0c-fe68-4ede-967f-6033027540e9 tempest-CinderUnicodeTest-934001813 None] Lock "cinder-quobyte-c5865681-fbdb-4c60-89f0-02e721b59f22" released by "delete_volume" :: held 0.689s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:40:45 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-847f5a0c-fe68-4ede-967f-6033027540e9 tempest-CinderUnicodeTest-934001813 None] Created reservations ['60f6daa7-972a-448d-a867-a69905240da3', '51503996-cf3f-4f43-8326-31adcfa2630f', 'a93433ce-0c0b-4ec2-b562-469aecf4d27f', '1b57be00-6ae3-4cff-b29b-99601ba3552b'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:40:45 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-847f5a0c-fe68-4ede-967f-6033027540e9 tempest-CinderUnicodeTest-934001813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:40:45 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-847f5a0c-fe68-4ede-967f-6033027540e9 tempest-CinderUnicodeTest-934001813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:40:45 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-847f5a0c-fe68-4ede-967f-6033027540e9 tempest-CinderUnicodeTest-934001813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:40:45 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-847f5a0c-fe68-4ede-967f-6033027540e9 tempest-CinderUnicodeTest-934001813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:40:45 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-847f5a0c-fe68-4ede-967f-6033027540e9 tempest-CinderUnicodeTest-934001813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:40:45 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-847f5a0c-fe68-4ede-967f-6033027540e9 tempest-CinderUnicodeTest-934001813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:45 devstack sudo[107186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:40:45 devstack sudo[107186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:46 devstack sudo[107186]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:46 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-847f5a0c-fe68-4ede-967f-6033027540e9 tempest-CinderUnicodeTest-934001813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.284s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:46 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-847f5a0c-fe68-4ede-967f-6033027540e9 tempest-CinderUnicodeTest-934001813 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:40:46 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-847f5a0c-fe68-4ede-967f-6033027540e9 tempest-CinderUnicodeTest-934001813 None] Deleted volume successfully. Sep 28 09:40:46 devstack sudo[107183]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:46 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1c8b816d-a8a7-4c22-8314-c6cb1b2cb22d tempest-CreateVolumesFromSnapshotTest-1115355121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c5aab7b8-a06e-4e4c-b502-58b2418c53a7 1073741824" returned: 0 in 0.496s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:46 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-323783e6-79ad-491a-86e5-575ad042c825 tempest-ProjectMemberTests-186690331 None] Acquiring lock "cinder-ed960e13-aaab-435f-8d59-c269ea5d114a-delete_snapshot" by "delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:40:46 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-847f5a0c-fe68-4ede-967f-6033027540e9 tempest-CinderUnicodeTest-934001813 None] Lock "cinder-c5865681-fbdb-4c60-89f0-02e721b59f22-delete_volume" released by "delete_volume" :: held 1.215s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:40:46 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-323783e6-79ad-491a-86e5-575ad042c825 tempest-ProjectMemberTests-186690331 None] Lock "cinder-ed960e13-aaab-435f-8d59-c269ea5d114a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:40:46 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-323783e6-79ad-491a-86e5-575ad042c825 tempest-ProjectMemberTests-186690331 None] Acquiring lock "cinder-quobyte-9975178b-255e-43b8-af32-6fb62ef9dcfc" by "delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:40:46 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1c8b816d-a8a7-4c22-8314-c6cb1b2cb22d tempest-CreateVolumesFromSnapshotTest-1115355121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c5aab7b8-a06e-4e4c-b502-58b2418c53a7 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:46 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-323783e6-79ad-491a-86e5-575ad042c825 tempest-ProjectMemberTests-186690331 None] Lock "cinder-quobyte-9975178b-255e-43b8-af32-6fb62ef9dcfc" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:40:46 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-323783e6-79ad-491a-86e5-575ad042c825 tempest-ProjectMemberTests-186690331 None] Acquiring lock "cinder-quobyte-ed960e13-aaab-435f-8d59-c269ea5d114a" by "_delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:40:46 devstack sudo[107193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c5aab7b8-a06e-4e4c-b502-58b2418c53a7 Sep 28 09:40:46 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-323783e6-79ad-491a-86e5-575ad042c825 tempest-ProjectMemberTests-186690331 None] Lock "cinder-quobyte-ed960e13-aaab-435f-8d59-c269ea5d114a" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:40:46 devstack sudo[107193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:46 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-323783e6-79ad-491a-86e5-575ad042c825 tempest-ProjectMemberTests-186690331 None] Deleting offline snapshot ed960e13-aaab-435f-8d59-c269ea5d114a of volume 9975178b-255e-43b8-af32-6fb62ef9dcfc {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 09:40:46 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-323783e6-79ad-491a-86e5-575ad042c825 tempest-ProjectMemberTests-186690331 None] snapshot_file for this snap is: volume-9975178b-255e-43b8-af32-6fb62ef9dcfc.ed960e13-aaab-435f-8d59-c269ea5d114a {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 09:40:46 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[6876b24d-8aef-4ba5-9f3c-18842851739e]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:40:46 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-323783e6-79ad-491a-86e5-575ad042c825 tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9975178b-255e-43b8-af32-6fb62ef9dcfc.ed960e13-aaab-435f-8d59-c269ea5d114a {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:46 devstack sudo[107195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9975178b-255e-43b8-af32-6fb62ef9dcfc.ed960e13-aaab-435f-8d59-c269ea5d114a Sep 28 09:40:46 devstack sudo[107195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:46 devstack sudo[107193]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:46 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1c8b816d-a8a7-4c22-8314-c6cb1b2cb22d tempest-CreateVolumesFromSnapshotTest-1115355121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c5aab7b8-a06e-4e4c-b502-58b2418c53a7" returned: 0 in 0.316s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:46 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-1c8b816d-a8a7-4c22-8314-c6cb1b2cb22d tempest-CreateVolumesFromSnapshotTest-1115355121 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:40:46 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-1c8b816d-a8a7-4c22-8314-c6cb1b2cb22d tempest-CreateVolumesFromSnapshotTest-1115355121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:40:46 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-1e9633a8-7885-41a1-8d38-040be5fd37b8 tempest-VolumeImageDependencyTests-692568895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.389s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:40:46 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-1e9633a8-7885-41a1-8d38-040be5fd37b8 tempest-VolumeImageDependencyTests-692568895 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:40:42Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f8b5af7-ce68-4ec0-8f7c-cfa93f8ef7ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2037b41767c14b239bb7c4d6bf71ad7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:40:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:40:42Z,use_quota=True,user_id='772044f337954beb92a4872fa52e7fce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:40:46 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-1e9633a8-7885-41a1-8d38-040be5fd37b8 tempest-VolumeImageDependencyTests-692568895 None] Creating volume 5f8b5af7-ce68-4ec0-8f7c-cfa93f8ef7ca {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:40:46 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-1e9633a8-7885-41a1-8d38-040be5fd37b8 tempest-VolumeImageDependencyTests-692568895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:40:46 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-1e9633a8-7885-41a1-8d38-040be5fd37b8 tempest-VolumeImageDependencyTests-692568895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:40:46 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-1e9633a8-7885-41a1-8d38-040be5fd37b8 tempest-VolumeImageDependencyTests-692568895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:40:46 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-1e9633a8-7885-41a1-8d38-040be5fd37b8 tempest-VolumeImageDependencyTests-692568895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:40:46 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-1e9633a8-7885-41a1-8d38-040be5fd37b8 tempest-VolumeImageDependencyTests-692568895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:40:46 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-1e9633a8-7885-41a1-8d38-040be5fd37b8 tempest-VolumeImageDependencyTests-692568895 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:40:46 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-1e9633a8-7885-41a1-8d38-040be5fd37b8 tempest-VolumeImageDependencyTests-692568895 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:40:46 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1e9633a8-7885-41a1-8d38-040be5fd37b8 tempest-VolumeImageDependencyTests-692568895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-5f8b5af7-ce68-4ec0-8f7c-cfa93f8ef7ca 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:46 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-1c8b816d-a8a7-4c22-8314-c6cb1b2cb22d tempest-CreateVolumesFromSnapshotTest-1115355121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6901b7ad-aa04-45bb-999a-4ef22bb2755d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5aab7b8-a06e-4e4c-b502-58b2418c53a7', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:46 devstack sudo[107198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-5f8b5af7-ce68-4ec0-8f7c-cfa93f8ef7ca 1073741824 Sep 28 09:40:46 devstack sudo[107198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:46 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-1c8b816d-a8a7-4c22-8314-c6cb1b2cb22d tempest-CreateVolumesFromSnapshotTest-1115355121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3f8edf2-7bef-4d5f-9465-80127798da88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:46 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-1c8b816d-a8a7-4c22-8314-c6cb1b2cb22d tempest-CreateVolumesFromSnapshotTest-1115355121 None] Volume volume-c5aab7b8-a06e-4e4c-b502-58b2418c53a7 (c5aab7b8-a06e-4e4c-b502-58b2418c53a7): created successfully Sep 28 09:40:46 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-1c8b816d-a8a7-4c22-8314-c6cb1b2cb22d tempest-CreateVolumesFromSnapshotTest-1115355121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3f8edf2-7bef-4d5f-9465-80127798da88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:46 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-1c8b816d-a8a7-4c22-8314-c6cb1b2cb22d tempest-CreateVolumesFromSnapshotTest-1115355121 None] Flow 'volume_create_manager' (81e77f46-475b-4ceb-b090-36b3a4afc72f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:40:46 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-1c8b816d-a8a7-4c22-8314-c6cb1b2cb22d tempest-CreateVolumesFromSnapshotTest-1115355121 None] Created volume successfully. Sep 28 09:40:46 devstack sudo[107195]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:46 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-323783e6-79ad-491a-86e5-575ad042c825 tempest-ProjectMemberTests-186690331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9975178b-255e-43b8-af32-6fb62ef9dcfc.ed960e13-aaab-435f-8d59-c269ea5d114a" returned: 0 in 0.398s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:46 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-323783e6-79ad-491a-86e5-575ad042c825 tempest-ProjectMemberTests-186690331 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9975178b-255e-43b8-af32-6fb62ef9dcfc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86553) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 09:40:46 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[561c058f-6ccb-4d7b-9da7-cf4690c2b710]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:40:46 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-323783e6-79ad-491a-86e5-575ad042c825 tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9975178b-255e-43b8-af32-6fb62ef9dcfc {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:46 devstack sudo[107204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9975178b-255e-43b8-af32-6fb62ef9dcfc Sep 28 09:40:46 devstack sudo[107204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:47 devstack sudo[107198]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:47 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1e9633a8-7885-41a1-8d38-040be5fd37b8 tempest-VolumeImageDependencyTests-692568895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-5f8b5af7-ce68-4ec0-8f7c-cfa93f8ef7ca 1073741824" returned: 0 in 0.529s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:47 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1e9633a8-7885-41a1-8d38-040be5fd37b8 tempest-VolumeImageDependencyTests-692568895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-5f8b5af7-ce68-4ec0-8f7c-cfa93f8ef7ca {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:47 devstack sudo[107211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-5f8b5af7-ce68-4ec0-8f7c-cfa93f8ef7ca Sep 28 09:40:47 devstack sudo[107211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:47 devstack sudo[107204]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:47 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-323783e6-79ad-491a-86e5-575ad042c825 tempest-ProjectMemberTests-186690331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9975178b-255e-43b8-af32-6fb62ef9dcfc" returned: 0 in 0.470s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:47 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-323783e6-79ad-491a-86e5-575ad042c825 tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9975178b-255e-43b8-af32-6fb62ef9dcfc.ed960e13-aaab-435f-8d59-c269ea5d114a {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:47 devstack sudo[107214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9975178b-255e-43b8-af32-6fb62ef9dcfc.ed960e13-aaab-435f-8d59-c269ea5d114a Sep 28 09:40:47 devstack sudo[107214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:47 devstack sudo[107211]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:47 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1e9633a8-7885-41a1-8d38-040be5fd37b8 tempest-VolumeImageDependencyTests-692568895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-5f8b5af7-ce68-4ec0-8f7c-cfa93f8ef7ca" returned: 0 in 0.262s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:47 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-1e9633a8-7885-41a1-8d38-040be5fd37b8 tempest-VolumeImageDependencyTests-692568895 None] <== create_volume: return (853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:40:47 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-1e9633a8-7885-41a1-8d38-040be5fd37b8 tempest-VolumeImageDependencyTests-692568895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:40:47 devstack cinder-volume[86553]: DEBUG cinder.volume.volume_utils [None req-1e9633a8-7885-41a1-8d38-040be5fd37b8 tempest-VolumeImageDependencyTests-692568895 None] Attempting download of 8adcc488-416d-442f-9b50-51e3c34a65ef ((None, [{'url': 'file:///opt/stack/data/glance/images/8adcc488-416d-442f-9b50-51e3c34a65ef', 'metadata': {}}])) to volume 5f8b5af7-ce68-4ec0-8f7c-cfa93f8ef7ca. {{(pid=86553) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 09:40:47 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f674b1d-69d9-4f93-946b-be0cca8ef2c4]: (4, 'raw') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:40:47 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1e9633a8-7885-41a1-8d38-040be5fd37b8 tempest-VolumeImageDependencyTests-692568895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8adcc488-416d-442f-9b50-51e3c34a65ef_6i4zzmaz {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:47 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-c2204081-6599-4254-8eae-e89438677d4b tempest-CreateVolumesFromSnapshotTest-1115355121 None] Acquiring lock "cinder-c5aab7b8-a06e-4e4c-b502-58b2418c53a7-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:40:47 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-c2204081-6599-4254-8eae-e89438677d4b tempest-CreateVolumesFromSnapshotTest-1115355121 None] Lock "cinder-c5aab7b8-a06e-4e4c-b502-58b2418c53a7-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:40:47 devstack sudo[107214]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:47 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-c2204081-6599-4254-8eae-e89438677d4b tempest-CreateVolumesFromSnapshotTest-1115355121 None] Acquiring lock "cinder-quobyte-c5aab7b8-a06e-4e4c-b502-58b2418c53a7" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:40:47 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-323783e6-79ad-491a-86e5-575ad042c825 tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9975178b-255e-43b8-af32-6fb62ef9dcfc.ed960e13-aaab-435f-8d59-c269ea5d114a" returned: 0 in 0.488s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:47 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-323783e6-79ad-491a-86e5-575ad042c825 tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9975178b-255e-43b8-af32-6fb62ef9dcfc.ed960e13-aaab-435f-8d59-c269ea5d114a {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:47 devstack sudo[107220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8adcc488-416d-442f-9b50-51e3c34a65ef_6i4zzmaz Sep 28 09:40:47 devstack sudo[107220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:47 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-c2204081-6599-4254-8eae-e89438677d4b tempest-CreateVolumesFromSnapshotTest-1115355121 None] Lock "cinder-quobyte-c5aab7b8-a06e-4e4c-b502-58b2418c53a7" acquired by "delete_volume" :: waited 0.052s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:40:47 devstack sudo[107221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9975178b-255e-43b8-af32-6fb62ef9dcfc.ed960e13-aaab-435f-8d59-c269ea5d114a Sep 28 09:40:47 devstack sudo[107221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:47 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c65c2f-e713-46ac-b810-b295a62bc32c]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:40:47 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c2204081-6599-4254-8eae-e89438677d4b tempest-CreateVolumesFromSnapshotTest-1115355121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c5aab7b8-a06e-4e4c-b502-58b2418c53a7 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:47 devstack sudo[107224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c5aab7b8-a06e-4e4c-b502-58b2418c53a7 Sep 28 09:40:48 devstack sudo[107224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:48 devstack sudo[107220]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1e9633a8-7885-41a1-8d38-040be5fd37b8 tempest-VolumeImageDependencyTests-692568895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8adcc488-416d-442f-9b50-51e3c34a65ef_6i4zzmaz" returned: 0 in 0.413s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1e9633a8-7885-41a1-8d38-040be5fd37b8 tempest-VolumeImageDependencyTests-692568895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8adcc488-416d-442f-9b50-51e3c34a65ef_6i4zzmaz {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:48 devstack sudo[107221]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-323783e6-79ad-491a-86e5-575ad042c825 tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9975178b-255e-43b8-af32-6fb62ef9dcfc.ed960e13-aaab-435f-8d59-c269ea5d114a" returned: 0 in 0.326s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:48 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-323783e6-79ad-491a-86e5-575ad042c825 tempest-ProjectMemberTests-186690331 None] Lock "cinder-quobyte-ed960e13-aaab-435f-8d59-c269ea5d114a" released by "_delete_snapshot" :: held 1.823s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:40:48 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-323783e6-79ad-491a-86e5-575ad042c825 tempest-ProjectMemberTests-186690331 None] Lock "cinder-quobyte-9975178b-255e-43b8-af32-6fb62ef9dcfc" released by "delete_snapshot" :: held 1.851s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:40:48 devstack sudo[107228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8adcc488-416d-442f-9b50-51e3c34a65ef_6i4zzmaz Sep 28 09:40:48 devstack sudo[107228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:48 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-323783e6-79ad-491a-86e5-575ad042c825 tempest-ProjectMemberTests-186690331 None] Created reservations ['45971009-aee2-4cef-9f2f-6f1aa4f87d79', '39219c4b-1507-43b0-8861-6d5d935a8f43', '183cd924-d52e-4718-915b-dc754b1362d5', 'cdd34e67-eda7-490a-a34f-05879d16c3ce'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:40:48 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-323783e6-79ad-491a-86e5-575ad042c825 tempest-ProjectMemberTests-186690331 None] Delete snapshot completed successfully. Sep 28 09:40:48 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-323783e6-79ad-491a-86e5-575ad042c825 tempest-ProjectMemberTests-186690331 None] Lock "cinder-ed960e13-aaab-435f-8d59-c269ea5d114a-delete_snapshot" released by "delete_snapshot" :: held 2.067s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:40:48 devstack sudo[107224]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c2204081-6599-4254-8eae-e89438677d4b tempest-CreateVolumesFromSnapshotTest-1115355121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c5aab7b8-a06e-4e4c-b502-58b2418c53a7" returned: 0 in 0.470s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c2204081-6599-4254-8eae-e89438677d4b tempest-CreateVolumesFromSnapshotTest-1115355121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c5aab7b8-a06e-4e4c-b502-58b2418c53a7 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:48 devstack sudo[107235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c5aab7b8-a06e-4e4c-b502-58b2418c53a7 Sep 28 09:40:48 devstack sudo[107235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:48 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-31203ab4-190e-449d-9f08-b8c8e8884df3 tempest-ProjectMemberTests-186690331 None] Acquiring lock "cinder-9975178b-255e-43b8-af32-6fb62ef9dcfc-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:40:48 devstack sudo[107228]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1e9633a8-7885-41a1-8d38-040be5fd37b8 tempest-VolumeImageDependencyTests-692568895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8adcc488-416d-442f-9b50-51e3c34a65ef_6i4zzmaz" returned: 1 in 0.519s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1e9633a8-7885-41a1-8d38-040be5fd37b8 tempest-VolumeImageDependencyTests-692568895 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8adcc488-416d-442f-9b50-51e3c34a65ef_6i4zzmaz' failed. Not Retrying. {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 09:40:48 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d70814-4004-45f6-8464-082edab4eaa2]: (4, 'raw') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:40:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1e9633a8-7885-41a1-8d38-040be5fd37b8 tempest-VolumeImageDependencyTests-692568895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8adcc488-416d-442f-9b50-51e3c34a65ef_g62nfziqdevstack@QuobyteHD {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:48 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-31203ab4-190e-449d-9f08-b8c8e8884df3 tempest-ProjectMemberTests-186690331 None] Lock "cinder-9975178b-255e-43b8-af32-6fb62ef9dcfc-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:40:48 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-31203ab4-190e-449d-9f08-b8c8e8884df3 tempest-ProjectMemberTests-186690331 None] Acquiring lock "cinder-quobyte-9975178b-255e-43b8-af32-6fb62ef9dcfc" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:40:48 devstack sudo[107235]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c2204081-6599-4254-8eae-e89438677d4b tempest-CreateVolumesFromSnapshotTest-1115355121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c5aab7b8-a06e-4e4c-b502-58b2418c53a7" returned: 0 in 0.313s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:48 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-31203ab4-190e-449d-9f08-b8c8e8884df3 tempest-ProjectMemberTests-186690331 None] Lock "cinder-quobyte-9975178b-255e-43b8-af32-6fb62ef9dcfc" acquired by "delete_volume" :: waited 0.024s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:40:48 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-c2204081-6599-4254-8eae-e89438677d4b tempest-CreateVolumesFromSnapshotTest-1115355121 None] Lock "cinder-quobyte-c5aab7b8-a06e-4e4c-b502-58b2418c53a7" released by "delete_volume" :: held 0.891s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:40:48 devstack sudo[107239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8adcc488-416d-442f-9b50-51e3c34a65ef_g62nfziqdevstack@QuobyteHD Sep 28 09:40:48 devstack sudo[107239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:48 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e97c982-125e-4bb8-b36f-b29492504db5]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:40:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-31203ab4-190e-449d-9f08-b8c8e8884df3 tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9975178b-255e-43b8-af32-6fb62ef9dcfc {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:48 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-c2204081-6599-4254-8eae-e89438677d4b tempest-CreateVolumesFromSnapshotTest-1115355121 None] Created reservations ['ce31da43-1df0-4166-a381-d1398e088fd9', '7ce77747-6018-487c-be1b-0c92ef85e964', '9b9384c5-7eaf-47bc-9c6e-788fdfd0f8d9', '998e3ab1-7414-4b33-bca5-add63af4f25b'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:40:48 devstack sudo[107242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9975178b-255e-43b8-af32-6fb62ef9dcfc Sep 28 09:40:48 devstack sudo[107242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-c2204081-6599-4254-8eae-e89438677d4b tempest-CreateVolumesFromSnapshotTest-1115355121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:40:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-c2204081-6599-4254-8eae-e89438677d4b tempest-CreateVolumesFromSnapshotTest-1115355121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:40:48 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-c2204081-6599-4254-8eae-e89438677d4b tempest-CreateVolumesFromSnapshotTest-1115355121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:40:48 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-c2204081-6599-4254-8eae-e89438677d4b tempest-CreateVolumesFromSnapshotTest-1115355121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:40:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-c2204081-6599-4254-8eae-e89438677d4b tempest-CreateVolumesFromSnapshotTest-1115355121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:40:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c2204081-6599-4254-8eae-e89438677d4b tempest-CreateVolumesFromSnapshotTest-1115355121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:48 devstack sudo[107244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:40:48 devstack sudo[107244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:49 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-5cafc2b9-9866-49ea-b444-b6c35fc18028 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Acquiring lock "cinder-c643e8b6-491f-4c52-b083-e406e26b8a17-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:40:49 devstack sudo[107239]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1e9633a8-7885-41a1-8d38-040be5fd37b8 tempest-VolumeImageDependencyTests-692568895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8adcc488-416d-442f-9b50-51e3c34a65ef_g62nfziqdevstack@QuobyteHD" returned: 0 in 0.493s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1e9633a8-7885-41a1-8d38-040be5fd37b8 tempest-VolumeImageDependencyTests-692568895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8adcc488-416d-442f-9b50-51e3c34a65ef_g62nfziqdevstack@QuobyteHD {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:49 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-5cafc2b9-9866-49ea-b444-b6c35fc18028 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Lock "cinder-c643e8b6-491f-4c52-b083-e406e26b8a17-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:40:49 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-5cafc2b9-9866-49ea-b444-b6c35fc18028 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Acquiring lock "cinder-quobyte-c643e8b6-491f-4c52-b083-e406e26b8a17" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:40:49 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-5cafc2b9-9866-49ea-b444-b6c35fc18028 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Lock "cinder-quobyte-c643e8b6-491f-4c52-b083-e406e26b8a17" acquired by "delete_volume" :: waited 0.033s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:40:49 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e801ff-9b1a-487b-9b6d-82e9d57cb509]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:40:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-5cafc2b9-9866-49ea-b444-b6c35fc18028 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c643e8b6-491f-4c52-b083-e406e26b8a17 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:49 devstack sudo[107248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8adcc488-416d-442f-9b50-51e3c34a65ef_g62nfziqdevstack@QuobyteHD Sep 28 09:40:49 devstack sudo[107248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:49 devstack sudo[107242]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-31203ab4-190e-449d-9f08-b8c8e8884df3 tempest-ProjectMemberTests-186690331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9975178b-255e-43b8-af32-6fb62ef9dcfc" returned: 0 in 0.516s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-31203ab4-190e-449d-9f08-b8c8e8884df3 tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9975178b-255e-43b8-af32-6fb62ef9dcfc {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:49 devstack sudo[107244]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c2204081-6599-4254-8eae-e89438677d4b tempest-CreateVolumesFromSnapshotTest-1115355121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.375s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:49 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-c2204081-6599-4254-8eae-e89438677d4b tempest-CreateVolumesFromSnapshotTest-1115355121 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:40:49 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-c2204081-6599-4254-8eae-e89438677d4b tempest-CreateVolumesFromSnapshotTest-1115355121 None] Deleted volume successfully. Sep 28 09:40:49 devstack sudo[107255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9975178b-255e-43b8-af32-6fb62ef9dcfc Sep 28 09:40:49 devstack sudo[107255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:49 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-c2204081-6599-4254-8eae-e89438677d4b tempest-CreateVolumesFromSnapshotTest-1115355121 None] Lock "cinder-c5aab7b8-a06e-4e4c-b502-58b2418c53a7-delete_volume" released by "delete_volume" :: held 1.612s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:40:49 devstack sudo[107254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c643e8b6-491f-4c52-b083-e406e26b8a17 Sep 28 09:40:49 devstack sudo[107254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:49 devstack sudo[107248]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1e9633a8-7885-41a1-8d38-040be5fd37b8 tempest-VolumeImageDependencyTests-692568895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8adcc488-416d-442f-9b50-51e3c34a65ef_g62nfziqdevstack@QuobyteHD" returned: 1 in 0.432s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1e9633a8-7885-41a1-8d38-040be5fd37b8 tempest-VolumeImageDependencyTests-692568895 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8adcc488-416d-442f-9b50-51e3c34a65ef_g62nfziqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 09:40:49 devstack cinder-volume[86553]: DEBUG cinder.image.image_utils [None req-1e9633a8-7885-41a1-8d38-040be5fd37b8 tempest-VolumeImageDependencyTests-692568895 None] 8adcc488-416d-442f-9b50-51e3c34a65ef was raw, converting to qcow2 {{(pid=86553) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 09:40:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1e9633a8-7885-41a1-8d38-040be5fd37b8 tempest-VolumeImageDependencyTests-692568895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8adcc488-416d-442f-9b50-51e3c34a65ef_g62nfziqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-5f8b5af7-ce68-4ec0-8f7c-cfa93f8ef7ca {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:49 devstack sudo[107261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8adcc488-416d-442f-9b50-51e3c34a65ef_g62nfziqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-5f8b5af7-ce68-4ec0-8f7c-cfa93f8ef7ca Sep 28 09:40:49 devstack sudo[107261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:49 devstack sudo[107255]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-31203ab4-190e-449d-9f08-b8c8e8884df3 tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-9975178b-255e-43b8-af32-6fb62ef9dcfc" returned: 0 in 0.364s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:49 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-31203ab4-190e-449d-9f08-b8c8e8884df3 tempest-ProjectMemberTests-186690331 None] Lock "cinder-quobyte-9975178b-255e-43b8-af32-6fb62ef9dcfc" released by "delete_volume" :: held 0.978s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:40:49 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-31203ab4-190e-449d-9f08-b8c8e8884df3 tempest-ProjectMemberTests-186690331 None] Created reservations ['9aa57659-c451-4fa9-b47a-d17e2bc2bd8d', '44d82e88-d94b-4de0-8f59-fb5aacd2e44d', '27f4e70d-e6ff-42d6-b7d9-90c299740924', 'f7158931-93a8-48fc-ba28-2cf4a56eaaa6'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:40:49 devstack sudo[107254]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-5cafc2b9-9866-49ea-b444-b6c35fc18028 tempest-CreateVolumesFromSnapshotTest-1115355121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c643e8b6-491f-4c52-b083-e406e26b8a17" returned: 0 in 0.541s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-5cafc2b9-9866-49ea-b444-b6c35fc18028 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c643e8b6-491f-4c52-b083-e406e26b8a17 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:49 devstack sudo[107269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c643e8b6-491f-4c52-b083-e406e26b8a17 Sep 28 09:40:49 devstack sudo[107269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-31203ab4-190e-449d-9f08-b8c8e8884df3 tempest-ProjectMemberTests-186690331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:40:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-31203ab4-190e-449d-9f08-b8c8e8884df3 tempest-ProjectMemberTests-186690331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:40:49 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-31203ab4-190e-449d-9f08-b8c8e8884df3 tempest-ProjectMemberTests-186690331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:40:49 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-31203ab4-190e-449d-9f08-b8c8e8884df3 tempest-ProjectMemberTests-186690331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:40:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-31203ab4-190e-449d-9f08-b8c8e8884df3 tempest-ProjectMemberTests-186690331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:40:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-31203ab4-190e-449d-9f08-b8c8e8884df3 tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:49 devstack sudo[107272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:40:49 devstack sudo[107272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:50 devstack sudo[107261]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1e9633a8-7885-41a1-8d38-040be5fd37b8 tempest-VolumeImageDependencyTests-692568895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8adcc488-416d-442f-9b50-51e3c34a65ef_g62nfziqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-5f8b5af7-ce68-4ec0-8f7c-cfa93f8ef7ca" returned: 0 in 0.573s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:50 devstack cinder-volume[86553]: DEBUG cinder.image.image_utils [None req-1e9633a8-7885-41a1-8d38-040be5fd37b8 tempest-VolumeImageDependencyTests-692568895 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8adcc488-416d-442f-9b50-51e3c34a65ef_g62nfziqdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-5f8b5af7-ce68-4ec0-8f7c-cfa93f8ef7ca {{(pid=86553) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 09:40:50 devstack cinder-volume[86553]: INFO cinder.image.image_utils [None req-1e9633a8-7885-41a1-8d38-040be5fd37b8 tempest-VolumeImageDependencyTests-692568895 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 09:40:50 devstack sudo[107269]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1e9633a8-7885-41a1-8d38-040be5fd37b8 tempest-VolumeImageDependencyTests-692568895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-5f8b5af7-ce68-4ec0-8f7c-cfa93f8ef7ca 1G {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-5cafc2b9-9866-49ea-b444-b6c35fc18028 tempest-CreateVolumesFromSnapshotTest-1115355121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c643e8b6-491f-4c52-b083-e406e26b8a17" returned: 0 in 0.323s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:50 devstack sudo[107275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-5f8b5af7-ce68-4ec0-8f7c-cfa93f8ef7ca 1G Sep 28 09:40:50 devstack sudo[107275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:50 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-5cafc2b9-9866-49ea-b444-b6c35fc18028 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Lock "cinder-quobyte-c643e8b6-491f-4c52-b083-e406e26b8a17" released by "delete_volume" :: held 0.930s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:40:50 devstack sudo[107272]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-31203ab4-190e-449d-9f08-b8c8e8884df3 tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.309s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:50 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-31203ab4-190e-449d-9f08-b8c8e8884df3 tempest-ProjectMemberTests-186690331 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:40:50 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-31203ab4-190e-449d-9f08-b8c8e8884df3 tempest-ProjectMemberTests-186690331 None] Deleted volume successfully. Sep 28 09:40:50 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-5cafc2b9-9866-49ea-b444-b6c35fc18028 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Created reservations ['c5335916-4063-48f0-be4a-8b31aeaea049', '373e72e2-9619-4a1e-bf1a-d750e583afec', 'd053e5e5-d021-4268-bd37-9ab393abbb57', '2bdcb38d-028d-4822-bd46-a9de98b3e103'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:40:50 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-31203ab4-190e-449d-9f08-b8c8e8884df3 tempest-ProjectMemberTests-186690331 None] Lock "cinder-9975178b-255e-43b8-af32-6fb62ef9dcfc-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:40:50 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-4a53f25c-30da-49d6-a85a-0979396f8520 tempest-ProjectAdminTests-2087416010 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.1194190979004, 'free_capacity_gb': 1775.1194190979004, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86553) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 28 09:40:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-5cafc2b9-9866-49ea-b444-b6c35fc18028 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:40:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-5cafc2b9-9866-49ea-b444-b6c35fc18028 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:40:50 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-5cafc2b9-9866-49ea-b444-b6c35fc18028 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:40:50 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-5cafc2b9-9866-49ea-b444-b6c35fc18028 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:40:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-5cafc2b9-9866-49ea-b444-b6c35fc18028 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:40:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-5cafc2b9-9866-49ea-b444-b6c35fc18028 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:50 devstack sudo[107282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:40:50 devstack sudo[107282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:50 devstack sudo[107275]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-1e9633a8-7885-41a1-8d38-040be5fd37b8 tempest-VolumeImageDependencyTests-692568895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-5f8b5af7-ce68-4ec0-8f7c-cfa93f8ef7ca 1G" returned: 0 in 0.378s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:50 devstack cinder-volume[86553]: DEBUG cinder.volume.volume_utils [None req-1e9633a8-7885-41a1-8d38-040be5fd37b8 tempest-VolumeImageDependencyTests-692568895 None] Downloaded image 8adcc488-416d-442f-9b50-51e3c34a65ef ((None, [{'url': 'file:///opt/stack/data/glance/images/8adcc488-416d-442f-9b50-51e3c34a65ef', 'metadata': {}}])) to volume 5f8b5af7-ce68-4ec0-8f7c-cfa93f8ef7ca successfully. {{(pid=86553) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 09:40:50 devstack cinder-volume[86553]: DEBUG cinder.image.image_utils [None req-1e9633a8-7885-41a1-8d38-040be5fd37b8 tempest-VolumeImageDependencyTests-692568895 None] Temporary image 8adcc488-416d-442f-9b50-51e3c34a65ef for user 772044f337954beb92a4872fa52e7fce is deleted. {{(pid=86553) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 09:40:50 devstack cinder-volume[86553]: DEBUG cinder.volume.volume_utils [None req-1e9633a8-7885-41a1-8d38-040be5fd37b8 tempest-VolumeImageDependencyTests-692568895 None] Marking volume 5f8b5af7-ce68-4ec0-8f7c-cfa93f8ef7ca as bootable. {{(pid=86553) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 09:40:50 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e9633a8-7885-41a1-8d38-040be5fd37b8 tempest-VolumeImageDependencyTests-692568895 None] Copying metadata from image 8adcc488-416d-442f-9b50-51e3c34a65ef to 5f8b5af7-ce68-4ec0-8f7c-cfa93f8ef7ca. {{(pid=86553) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 09:40:50 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e9633a8-7885-41a1-8d38-040be5fd37b8 tempest-VolumeImageDependencyTests-692568895 None] Creating volume glance metadata for volume 5f8b5af7-ce68-4ec0-8f7c-cfa93f8ef7ca backed by image 8adcc488-416d-442f-9b50-51e3c34a65ef with: {'image_id': '8adcc488-416d-442f-9b50-51e3c34a65ef', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '3b8d3b2a5a91aad8ea97a0f1705b825f', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86553) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 09:40:50 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-1e9633a8-7885-41a1-8d38-040be5fd37b8 tempest-VolumeImageDependencyTests-692568895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6fb5af2-c23f-4099-93f1-4159668ea23e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f8b5af7-ce68-4ec0-8f7c-cfa93f8ef7ca', 'volume_size': 1, 'image_id': '8adcc488-416d-442f-9b50-51e3c34a65ef', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8adcc488-416d-442f-9b50-51e3c34a65ef', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3b8d3b2a5a91aad8ea97a0f1705b825f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2037b41767c14b239bb7c4d6bf71ad7e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '83a97584cf472274ad173645e7755f14d99d017aef275d63f94571266ad1868901cb039482fe12eb60fabca5e8152c5e635c575f64259cf617e6533acd61a71e', 'id': '8adcc488-416d-442f-9b50-51e3c34a65ef', 'created_at': datetime.datetime(2026, 9, 28, 7, 40, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 7, 40, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8adcc488-416d-442f-9b50-51e3c34a65ef/file', 'properties': {}}, 'image_service': }' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:50 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-1e9633a8-7885-41a1-8d38-040be5fd37b8 tempest-VolumeImageDependencyTests-692568895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cfdf9f2-248e-417d-9c7d-538d1673b90f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:50 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-1e9633a8-7885-41a1-8d38-040be5fd37b8 tempest-VolumeImageDependencyTests-692568895 None] Volume volume-5f8b5af7-ce68-4ec0-8f7c-cfa93f8ef7ca (5f8b5af7-ce68-4ec0-8f7c-cfa93f8ef7ca): created successfully Sep 28 09:40:50 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-1e9633a8-7885-41a1-8d38-040be5fd37b8 tempest-VolumeImageDependencyTests-692568895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cfdf9f2-248e-417d-9c7d-538d1673b90f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:50 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-1e9633a8-7885-41a1-8d38-040be5fd37b8 tempest-VolumeImageDependencyTests-692568895 None] Flow 'volume_create_manager' (42b63364-6418-4c56-ad8b-498b55978996) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:40:50 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-1e9633a8-7885-41a1-8d38-040be5fd37b8 tempest-VolumeImageDependencyTests-692568895 None] Created volume successfully. Sep 28 09:40:50 devstack sudo[107282]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-5cafc2b9-9866-49ea-b444-b6c35fc18028 tempest-CreateVolumesFromSnapshotTest-1115355121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.285s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:50 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-5cafc2b9-9866-49ea-b444-b6c35fc18028 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:40:50 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-5cafc2b9-9866-49ea-b444-b6c35fc18028 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Deleted volume successfully. Sep 28 09:40:50 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-5cafc2b9-9866-49ea-b444-b6c35fc18028 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Lock "cinder-c643e8b6-491f-4c52-b083-e406e26b8a17-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:40:51 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b6a6405-8e7f-40e0-a6af-2c5cdeb5610d tempest-ProjectMemberTests-186690331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:40:51 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0b6a6405-8e7f-40e0-a6af-2c5cdeb5610d tempest-ProjectMemberTests-186690331 None] Flow 'volume_create_manager' (1986a6a6-10ae-4141-950a-afc116aa9b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:40:51 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0b6a6405-8e7f-40e0-a6af-2c5cdeb5610d tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (131269b3-d75e-45e5-bd63-4e46def2a2fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:51 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0b6a6405-8e7f-40e0-a6af-2c5cdeb5610d tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (131269b3-d75e-45e5-bd63-4e46def2a2fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:40:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1892261705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6978c83-e4a7-4334-9f5a-696a183c0dcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50c5ebfa35e84e1fa822f83efd2739e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:40:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:40:51Z,use_quota=True,user_id='029e33208bca4e258a762ad19e5ed78e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:51 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0b6a6405-8e7f-40e0-a6af-2c5cdeb5610d tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9eec2f7a-c26f-4958-8b87-3590032a72fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:51 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0b6a6405-8e7f-40e0-a6af-2c5cdeb5610d tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9eec2f7a-c26f-4958-8b87-3590032a72fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:51 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0b6a6405-8e7f-40e0-a6af-2c5cdeb5610d tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e57f54b1-ea6f-4b1a-ab34-6843dae70b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:51 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0b6a6405-8e7f-40e0-a6af-2c5cdeb5610d tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e57f54b1-ea6f-4b1a-ab34-6843dae70b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6978c83-e4a7-4334-9f5a-696a183c0dcf', 'volume_name': 'volume-d6978c83-e4a7-4334-9f5a-696a183c0dcf', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:51 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0b6a6405-8e7f-40e0-a6af-2c5cdeb5610d tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b681c2f-afef-4e95-904f-0b38d62d9f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:51 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0b6a6405-8e7f-40e0-a6af-2c5cdeb5610d tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b681c2f-afef-4e95-904f-0b38d62d9f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:51 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0b6a6405-8e7f-40e0-a6af-2c5cdeb5610d tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6ebd0ca-8837-402a-a8d0-f18b80b185ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:51 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-0b6a6405-8e7f-40e0-a6af-2c5cdeb5610d tempest-ProjectMemberTests-186690331 None] Volume d6978c83-e4a7-4334-9f5a-696a183c0dcf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6978c83-e4a7-4334-9f5a-696a183c0dcf', 'volume_size': 1} Sep 28 09:40:51 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-0b6a6405-8e7f-40e0-a6af-2c5cdeb5610d tempest-ProjectMemberTests-186690331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:40:51 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-0b6a6405-8e7f-40e0-a6af-2c5cdeb5610d tempest-ProjectMemberTests-186690331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:40:51 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-0b6a6405-8e7f-40e0-a6af-2c5cdeb5610d tempest-ProjectMemberTests-186690331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:40:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1892261705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6978c83-e4a7-4334-9f5a-696a183c0dcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50c5ebfa35e84e1fa822f83efd2739e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:40:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:40:51Z,use_quota=True,user_id='029e33208bca4e258a762ad19e5ed78e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:40:51 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-0b6a6405-8e7f-40e0-a6af-2c5cdeb5610d tempest-ProjectMemberTests-186690331 None] Creating volume d6978c83-e4a7-4334-9f5a-696a183c0dcf {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:40:51 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-0b6a6405-8e7f-40e0-a6af-2c5cdeb5610d tempest-ProjectMemberTests-186690331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:40:51 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-0b6a6405-8e7f-40e0-a6af-2c5cdeb5610d tempest-ProjectMemberTests-186690331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:40:51 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-0b6a6405-8e7f-40e0-a6af-2c5cdeb5610d tempest-ProjectMemberTests-186690331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:40:51 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-0b6a6405-8e7f-40e0-a6af-2c5cdeb5610d tempest-ProjectMemberTests-186690331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:40:51 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-0b6a6405-8e7f-40e0-a6af-2c5cdeb5610d tempest-ProjectMemberTests-186690331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:40:51 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-0b6a6405-8e7f-40e0-a6af-2c5cdeb5610d tempest-ProjectMemberTests-186690331 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:40:51 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-0b6a6405-8e7f-40e0-a6af-2c5cdeb5610d tempest-ProjectMemberTests-186690331 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:40:51 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0b6a6405-8e7f-40e0-a6af-2c5cdeb5610d tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d6978c83-e4a7-4334-9f5a-696a183c0dcf 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:51 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-30a5304d-562a-4f60-b732-bf4c78169f82 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Acquiring lock "cinder-242fd277-0f68-43bf-9a72-b0c556e21726-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:40:51 devstack sudo[107285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d6978c83-e4a7-4334-9f5a-696a183c0dcf 1073741824 Sep 28 09:40:51 devstack sudo[107285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:51 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-30a5304d-562a-4f60-b732-bf4c78169f82 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Lock "cinder-242fd277-0f68-43bf-9a72-b0c556e21726-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:40:51 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-30a5304d-562a-4f60-b732-bf4c78169f82 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Acquiring lock "cinder-quobyte-242fd277-0f68-43bf-9a72-b0c556e21726" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:40:51 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-30a5304d-562a-4f60-b732-bf4c78169f82 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Lock "cinder-quobyte-242fd277-0f68-43bf-9a72-b0c556e21726" acquired by "delete_volume" :: waited 0.020s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:40:51 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd95928-3c87-42db-a201-52fa36722196]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:40:51 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-30a5304d-562a-4f60-b732-bf4c78169f82 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-242fd277-0f68-43bf-9a72-b0c556e21726 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:51 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-34255bf6-b983-4662-b056-da3033e0ff1e tempest-VolumeImageDependencyTests-692568895 None] Acquiring lock "cinder-5f8b5af7-ce68-4ec0-8f7c-cfa93f8ef7ca-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:40:51 devstack sudo[107287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-242fd277-0f68-43bf-9a72-b0c556e21726 Sep 28 09:40:51 devstack sudo[107287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:51 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-34255bf6-b983-4662-b056-da3033e0ff1e tempest-VolumeImageDependencyTests-692568895 None] Lock "cinder-5f8b5af7-ce68-4ec0-8f7c-cfa93f8ef7ca-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:40:51 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-34255bf6-b983-4662-b056-da3033e0ff1e tempest-VolumeImageDependencyTests-692568895 None] Acquiring lock "cinder-quobyte-5f8b5af7-ce68-4ec0-8f7c-cfa93f8ef7ca" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:40:51 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-34255bf6-b983-4662-b056-da3033e0ff1e tempest-VolumeImageDependencyTests-692568895 None] Lock "cinder-quobyte-5f8b5af7-ce68-4ec0-8f7c-cfa93f8ef7ca" acquired by "delete_volume" :: waited 0.022s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:40:51 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4eaa3ed-39a6-4ef1-9ba9-59d8c4c0d43b]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:40:51 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-34255bf6-b983-4662-b056-da3033e0ff1e tempest-VolumeImageDependencyTests-692568895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-5f8b5af7-ce68-4ec0-8f7c-cfa93f8ef7ca {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:51 devstack sudo[107292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-5f8b5af7-ce68-4ec0-8f7c-cfa93f8ef7ca Sep 28 09:40:51 devstack sudo[107292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:52 devstack sudo[107287]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:52 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-30a5304d-562a-4f60-b732-bf4c78169f82 tempest-CreateVolumesFromSnapshotTest-1115355121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-242fd277-0f68-43bf-9a72-b0c556e21726" returned: 0 in 0.476s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:52 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-30a5304d-562a-4f60-b732-bf4c78169f82 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-242fd277-0f68-43bf-9a72-b0c556e21726 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:52 devstack sudo[107285]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:52 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0b6a6405-8e7f-40e0-a6af-2c5cdeb5610d tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d6978c83-e4a7-4334-9f5a-696a183c0dcf 1073741824" returned: 0 in 0.640s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:52 devstack sudo[107298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-242fd277-0f68-43bf-9a72-b0c556e21726 Sep 28 09:40:52 devstack sudo[107298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:52 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0b6a6405-8e7f-40e0-a6af-2c5cdeb5610d tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d6978c83-e4a7-4334-9f5a-696a183c0dcf {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:52 devstack sudo[107300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d6978c83-e4a7-4334-9f5a-696a183c0dcf Sep 28 09:40:52 devstack sudo[107300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:52 devstack sudo[107292]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:52 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-34255bf6-b983-4662-b056-da3033e0ff1e tempest-VolumeImageDependencyTests-692568895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-5f8b5af7-ce68-4ec0-8f7c-cfa93f8ef7ca" returned: 0 in 0.500s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:52 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-34255bf6-b983-4662-b056-da3033e0ff1e tempest-VolumeImageDependencyTests-692568895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-5f8b5af7-ce68-4ec0-8f7c-cfa93f8ef7ca {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:52 devstack sudo[107306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-5f8b5af7-ce68-4ec0-8f7c-cfa93f8ef7ca Sep 28 09:40:52 devstack sudo[107306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:52 devstack sudo[107298]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:52 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-30a5304d-562a-4f60-b732-bf4c78169f82 tempest-CreateVolumesFromSnapshotTest-1115355121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-242fd277-0f68-43bf-9a72-b0c556e21726" returned: 0 in 0.326s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:52 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-30a5304d-562a-4f60-b732-bf4c78169f82 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Lock "cinder-quobyte-242fd277-0f68-43bf-9a72-b0c556e21726" released by "delete_volume" :: held 0.862s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:40:52 devstack sudo[107300]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:52 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0b6a6405-8e7f-40e0-a6af-2c5cdeb5610d tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d6978c83-e4a7-4334-9f5a-696a183c0dcf" returned: 0 in 0.312s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:52 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-0b6a6405-8e7f-40e0-a6af-2c5cdeb5610d tempest-ProjectMemberTests-186690331 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:40:52 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-0b6a6405-8e7f-40e0-a6af-2c5cdeb5610d tempest-ProjectMemberTests-186690331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:40:52 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0b6a6405-8e7f-40e0-a6af-2c5cdeb5610d tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6ebd0ca-8837-402a-a8d0-f18b80b185ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6978c83-e4a7-4334-9f5a-696a183c0dcf', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:52 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0b6a6405-8e7f-40e0-a6af-2c5cdeb5610d tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ff4cfb0-0a43-4174-8c89-584762737fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:40:52 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-0b6a6405-8e7f-40e0-a6af-2c5cdeb5610d tempest-ProjectMemberTests-186690331 None] Volume volume-d6978c83-e4a7-4334-9f5a-696a183c0dcf (d6978c83-e4a7-4334-9f5a-696a183c0dcf): created successfully Sep 28 09:40:52 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0b6a6405-8e7f-40e0-a6af-2c5cdeb5610d tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ff4cfb0-0a43-4174-8c89-584762737fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:40:52 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0b6a6405-8e7f-40e0-a6af-2c5cdeb5610d tempest-ProjectMemberTests-186690331 None] Flow 'volume_create_manager' (1986a6a6-10ae-4141-950a-afc116aa9b17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:40:52 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-30a5304d-562a-4f60-b732-bf4c78169f82 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Created reservations ['942dd325-3e97-4bed-9abb-0f57420d9bb2', '910105e3-5228-40d5-8e94-a9a4e0e56754', '11cab5f2-2f1c-43f8-9651-e6ed9ddb83e3', 'd74dc11f-f890-4b82-b03a-01fc7d68f69c'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:40:52 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-0b6a6405-8e7f-40e0-a6af-2c5cdeb5610d tempest-ProjectMemberTests-186690331 None] Created volume successfully. Sep 28 09:40:52 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-30a5304d-562a-4f60-b732-bf4c78169f82 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:40:52 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-30a5304d-562a-4f60-b732-bf4c78169f82 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:40:52 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-30a5304d-562a-4f60-b732-bf4c78169f82 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:40:52 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-30a5304d-562a-4f60-b732-bf4c78169f82 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:40:52 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-30a5304d-562a-4f60-b732-bf4c78169f82 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:40:52 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-30a5304d-562a-4f60-b732-bf4c78169f82 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:52 devstack sudo[107309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:40:52 devstack sudo[107309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:52 devstack sudo[107306]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:52 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-34255bf6-b983-4662-b056-da3033e0ff1e tempest-VolumeImageDependencyTests-692568895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-5f8b5af7-ce68-4ec0-8f7c-cfa93f8ef7ca" returned: 0 in 0.325s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:52 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-34255bf6-b983-4662-b056-da3033e0ff1e tempest-VolumeImageDependencyTests-692568895 None] Lock "cinder-quobyte-5f8b5af7-ce68-4ec0-8f7c-cfa93f8ef7ca" released by "delete_volume" :: held 0.892s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:40:52 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-34255bf6-b983-4662-b056-da3033e0ff1e tempest-VolumeImageDependencyTests-692568895 None] Created reservations ['a44be26a-b850-48ef-875e-fda9cbb511b7', '591ad02a-84c7-46f6-970a-08dcab28213b', '231c5cbf-7aab-44d0-8000-fcdf929efcd6', 'daf2e81c-aa76-49b9-b0d9-de82d03106d6'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:40:52 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-34255bf6-b983-4662-b056-da3033e0ff1e tempest-VolumeImageDependencyTests-692568895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:40:52 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-34255bf6-b983-4662-b056-da3033e0ff1e tempest-VolumeImageDependencyTests-692568895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:40:52 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-34255bf6-b983-4662-b056-da3033e0ff1e tempest-VolumeImageDependencyTests-692568895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:40:52 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-34255bf6-b983-4662-b056-da3033e0ff1e tempest-VolumeImageDependencyTests-692568895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:40:52 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-34255bf6-b983-4662-b056-da3033e0ff1e tempest-VolumeImageDependencyTests-692568895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:40:52 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-34255bf6-b983-4662-b056-da3033e0ff1e tempest-VolumeImageDependencyTests-692568895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:52 devstack sudo[107313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:40:52 devstack sudo[107313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:52 devstack sudo[107309]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:52 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-30a5304d-562a-4f60-b732-bf4c78169f82 tempest-CreateVolumesFromSnapshotTest-1115355121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.297s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:52 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-30a5304d-562a-4f60-b732-bf4c78169f82 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:40:52 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-30a5304d-562a-4f60-b732-bf4c78169f82 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Deleted volume successfully. Sep 28 09:40:52 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-30a5304d-562a-4f60-b732-bf4c78169f82 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Lock "cinder-242fd277-0f68-43bf-9a72-b0c556e21726-delete_volume" released by "delete_volume" :: held 1.448s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:40:53 devstack sudo[107313]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:53 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-34255bf6-b983-4662-b056-da3033e0ff1e tempest-VolumeImageDependencyTests-692568895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.279s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:53 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-34255bf6-b983-4662-b056-da3033e0ff1e tempest-VolumeImageDependencyTests-692568895 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:40:53 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-34255bf6-b983-4662-b056-da3033e0ff1e tempest-VolumeImageDependencyTests-692568895 None] Deleted volume successfully. Sep 28 09:40:53 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-34255bf6-b983-4662-b056-da3033e0ff1e tempest-VolumeImageDependencyTests-692568895 None] Lock "cinder-5f8b5af7-ce68-4ec0-8f7c-cfa93f8ef7ca-delete_volume" released by "delete_volume" :: held 1.389s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:40:53 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-b41d0bb1-dd31-4aac-adfa-94c9deb620ec tempest-CreateVolumesFromSnapshotTest-1115355121 None] Acquiring lock "cinder-2f565bbc-14cf-4711-8b3c-c71c345a1cd8-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:40:53 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-b41d0bb1-dd31-4aac-adfa-94c9deb620ec tempest-CreateVolumesFromSnapshotTest-1115355121 None] Lock "cinder-2f565bbc-14cf-4711-8b3c-c71c345a1cd8-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:40:53 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-571d552e-fb24-4af7-93a1-e1b56411a638 tempest-ProjectMemberTests-186690331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:40:53 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-571d552e-fb24-4af7-93a1-e1b56411a638 tempest-ProjectMemberTests-186690331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:40:53 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-571d552e-fb24-4af7-93a1-e1b56411a638 tempest-ProjectMemberTests-186690331 None] Creating offline snapshot d4a51187-1671-4a7b-a953-39b0a2e05230 of volume d6978c83-e4a7-4334-9f5a-696a183c0dcf {{(pid=86553) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 09:40:53 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-b41d0bb1-dd31-4aac-adfa-94c9deb620ec tempest-CreateVolumesFromSnapshotTest-1115355121 None] Acquiring lock "cinder-quobyte-2f565bbc-14cf-4711-8b3c-c71c345a1cd8" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:40:53 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c9d5fd-dff3-4743-a282-8b2d5f0f6862]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:40:53 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-571d552e-fb24-4af7-93a1-e1b56411a638 tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d6978c83-e4a7-4334-9f5a-696a183c0dcf {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:53 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-b41d0bb1-dd31-4aac-adfa-94c9deb620ec tempest-CreateVolumesFromSnapshotTest-1115355121 None] Lock "cinder-quobyte-2f565bbc-14cf-4711-8b3c-c71c345a1cd8" acquired by "delete_volume" :: waited 0.042s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:40:53 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[759eba0d-df3d-48f0-a4c4-ab543cd803f6]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:40:53 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b41d0bb1-dd31-4aac-adfa-94c9deb620ec tempest-CreateVolumesFromSnapshotTest-1115355121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-2f565bbc-14cf-4711-8b3c-c71c345a1cd8 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:53 devstack sudo[107316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d6978c83-e4a7-4334-9f5a-696a183c0dcf Sep 28 09:40:53 devstack sudo[107316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:53 devstack sudo[107317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-2f565bbc-14cf-4711-8b3c-c71c345a1cd8 Sep 28 09:40:53 devstack sudo[107317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:54 devstack sudo[107316]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:54 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-571d552e-fb24-4af7-93a1-e1b56411a638 tempest-ProjectMemberTests-186690331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d6978c83-e4a7-4334-9f5a-696a183c0dcf" returned: 0 in 0.479s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:54 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-571d552e-fb24-4af7-93a1-e1b56411a638 tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d6978c83-e4a7-4334-9f5a-696a183c0dcf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d6978c83-e4a7-4334-9f5a-696a183c0dcf.d4a51187-1671-4a7b-a953-39b0a2e05230 1G {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:54 devstack sudo[107324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d6978c83-e4a7-4334-9f5a-696a183c0dcf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d6978c83-e4a7-4334-9f5a-696a183c0dcf.d4a51187-1671-4a7b-a953-39b0a2e05230 1G Sep 28 09:40:54 devstack sudo[107324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:54 devstack sudo[107317]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:54 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b41d0bb1-dd31-4aac-adfa-94c9deb620ec tempest-CreateVolumesFromSnapshotTest-1115355121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-2f565bbc-14cf-4711-8b3c-c71c345a1cd8" returned: 0 in 0.565s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:54 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b41d0bb1-dd31-4aac-adfa-94c9deb620ec tempest-CreateVolumesFromSnapshotTest-1115355121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-2f565bbc-14cf-4711-8b3c-c71c345a1cd8 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:54 devstack sudo[107330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-2f565bbc-14cf-4711-8b3c-c71c345a1cd8 Sep 28 09:40:54 devstack sudo[107330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:54 devstack sudo[107330]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:54 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b41d0bb1-dd31-4aac-adfa-94c9deb620ec tempest-CreateVolumesFromSnapshotTest-1115355121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-2f565bbc-14cf-4711-8b3c-c71c345a1cd8" returned: 0 in 0.337s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:54 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-b41d0bb1-dd31-4aac-adfa-94c9deb620ec tempest-CreateVolumesFromSnapshotTest-1115355121 None] Lock "cinder-quobyte-2f565bbc-14cf-4711-8b3c-c71c345a1cd8" released by "delete_volume" :: held 0.955s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:40:54 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-b41d0bb1-dd31-4aac-adfa-94c9deb620ec tempest-CreateVolumesFromSnapshotTest-1115355121 None] Created reservations ['4acc6804-e0c3-4625-acb4-942497b97f5a', '115e6d14-8e43-47f0-a02b-580dde1fc3e4', 'a0c3773d-030e-4142-850c-45cb26625d28', '17ccb537-21e0-461b-86ce-aab0fce0af53'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:40:54 devstack sudo[107324]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:54 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-571d552e-fb24-4af7-93a1-e1b56411a638 tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d6978c83-e4a7-4334-9f5a-696a183c0dcf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d6978c83-e4a7-4334-9f5a-696a183c0dcf.d4a51187-1671-4a7b-a953-39b0a2e05230 1G" returned: 0 in 0.620s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:54 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-571d552e-fb24-4af7-93a1-e1b56411a638 tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6978c83-e4a7-4334-9f5a-696a183c0dcf -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d6978c83-e4a7-4334-9f5a-696a183c0dcf.d4a51187-1671-4a7b-a953-39b0a2e05230 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:54 devstack sudo[107337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6978c83-e4a7-4334-9f5a-696a183c0dcf -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d6978c83-e4a7-4334-9f5a-696a183c0dcf.d4a51187-1671-4a7b-a953-39b0a2e05230 Sep 28 09:40:54 devstack sudo[107337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:54 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-b41d0bb1-dd31-4aac-adfa-94c9deb620ec tempest-CreateVolumesFromSnapshotTest-1115355121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:40:54 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-b41d0bb1-dd31-4aac-adfa-94c9deb620ec tempest-CreateVolumesFromSnapshotTest-1115355121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:40:54 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-b41d0bb1-dd31-4aac-adfa-94c9deb620ec tempest-CreateVolumesFromSnapshotTest-1115355121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:40:54 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-b41d0bb1-dd31-4aac-adfa-94c9deb620ec tempest-CreateVolumesFromSnapshotTest-1115355121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:40:54 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-b41d0bb1-dd31-4aac-adfa-94c9deb620ec tempest-CreateVolumesFromSnapshotTest-1115355121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:40:54 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b41d0bb1-dd31-4aac-adfa-94c9deb620ec tempest-CreateVolumesFromSnapshotTest-1115355121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:54 devstack sudo[107339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:40:54 devstack sudo[107339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:55 devstack sudo[107337]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:55 devstack sudo[107339]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:55 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-571d552e-fb24-4af7-93a1-e1b56411a638 tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6978c83-e4a7-4334-9f5a-696a183c0dcf -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d6978c83-e4a7-4334-9f5a-696a183c0dcf.d4a51187-1671-4a7b-a953-39b0a2e05230" returned: 0 in 0.392s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:55 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-571d552e-fb24-4af7-93a1-e1b56411a638 tempest-ProjectMemberTests-186690331 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d6978c83-e4a7-4334-9f5a-696a183c0dcf.d4a51187-1671-4a7b-a953-39b0a2e05230 is being set with open permissions: ugo+rw Sep 28 09:40:55 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-571d552e-fb24-4af7-93a1-e1b56411a638 tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d6978c83-e4a7-4334-9f5a-696a183c0dcf.d4a51187-1671-4a7b-a953-39b0a2e05230 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:55 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b41d0bb1-dd31-4aac-adfa-94c9deb620ec tempest-CreateVolumesFromSnapshotTest-1115355121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.317s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:55 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-b41d0bb1-dd31-4aac-adfa-94c9deb620ec tempest-CreateVolumesFromSnapshotTest-1115355121 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:40:55 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-b41d0bb1-dd31-4aac-adfa-94c9deb620ec tempest-CreateVolumesFromSnapshotTest-1115355121 None] Deleted volume successfully. Sep 28 09:40:55 devstack sudo[107346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d6978c83-e4a7-4334-9f5a-696a183c0dcf.d4a51187-1671-4a7b-a953-39b0a2e05230 Sep 28 09:40:55 devstack sudo[107346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:55 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-b41d0bb1-dd31-4aac-adfa-94c9deb620ec tempest-CreateVolumesFromSnapshotTest-1115355121 None] Lock "cinder-2f565bbc-14cf-4711-8b3c-c71c345a1cd8-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:40:55 devstack sudo[107346]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:55 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-571d552e-fb24-4af7-93a1-e1b56411a638 tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d6978c83-e4a7-4334-9f5a-696a183c0dcf.d4a51187-1671-4a7b-a953-39b0a2e05230" returned: 0 in 0.259s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:55 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-571d552e-fb24-4af7-93a1-e1b56411a638 tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d6978c83-e4a7-4334-9f5a-696a183c0dcf.info {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:55 devstack sudo[107349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d6978c83-e4a7-4334-9f5a-696a183c0dcf.info Sep 28 09:40:55 devstack sudo[107349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:55 devstack sudo[107349]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:55 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-571d552e-fb24-4af7-93a1-e1b56411a638 tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d6978c83-e4a7-4334-9f5a-696a183c0dcf.info" returned: 0 in 0.265s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:55 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-571d552e-fb24-4af7-93a1-e1b56411a638 tempest-ProjectMemberTests-186690331 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d6978c83-e4a7-4334-9f5a-696a183c0dcf.info is being set with open permissions: ugo+rw Sep 28 09:40:55 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-571d552e-fb24-4af7-93a1-e1b56411a638 tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d6978c83-e4a7-4334-9f5a-696a183c0dcf.info {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:55 devstack sudo[107352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d6978c83-e4a7-4334-9f5a-696a183c0dcf.info Sep 28 09:40:55 devstack sudo[107352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:55 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-e4a7e3c9-6873-414d-9265-ea7d7d717989 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Acquiring lock "cinder-de4d4e39-cf09-44fd-a0e8-9ffead2cd014-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:40:55 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-e4a7e3c9-6873-414d-9265-ea7d7d717989 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Lock "cinder-de4d4e39-cf09-44fd-a0e8-9ffead2cd014-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:40:56 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-e4a7e3c9-6873-414d-9265-ea7d7d717989 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Acquiring lock "cinder-quobyte-de4d4e39-cf09-44fd-a0e8-9ffead2cd014" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:40:56 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-e4a7e3c9-6873-414d-9265-ea7d7d717989 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Lock "cinder-quobyte-de4d4e39-cf09-44fd-a0e8-9ffead2cd014" acquired by "delete_volume" :: waited 0.030s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:40:56 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b34eca6-7db4-40e2-b358-4d4422c4d4ce]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:40:56 devstack sudo[107352]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:56 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e4a7e3c9-6873-414d-9265-ea7d7d717989 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-de4d4e39-cf09-44fd-a0e8-9ffead2cd014 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:56 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-571d552e-fb24-4af7-93a1-e1b56411a638 tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d6978c83-e4a7-4334-9f5a-696a183c0dcf.info" returned: 0 in 0.336s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:56 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-571d552e-fb24-4af7-93a1-e1b56411a638 tempest-ProjectMemberTests-186690331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.469s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:40:56 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-571d552e-fb24-4af7-93a1-e1b56411a638 tempest-ProjectMemberTests-186690331 None] Create snapshot completed successfully Sep 28 09:40:56 devstack sudo[107355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-de4d4e39-cf09-44fd-a0e8-9ffead2cd014 Sep 28 09:40:56 devstack sudo[107355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:56 devstack sudo[107355]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:56 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e4a7e3c9-6873-414d-9265-ea7d7d717989 tempest-CreateVolumesFromSnapshotTest-1115355121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-de4d4e39-cf09-44fd-a0e8-9ffead2cd014" returned: 0 in 0.418s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:56 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e4a7e3c9-6873-414d-9265-ea7d7d717989 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-de4d4e39-cf09-44fd-a0e8-9ffead2cd014 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:56 devstack sudo[107360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-de4d4e39-cf09-44fd-a0e8-9ffead2cd014 Sep 28 09:40:56 devstack sudo[107360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:56 devstack sudo[107360]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:56 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e4a7e3c9-6873-414d-9265-ea7d7d717989 tempest-CreateVolumesFromSnapshotTest-1115355121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-de4d4e39-cf09-44fd-a0e8-9ffead2cd014" returned: 0 in 0.308s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:56 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-e4a7e3c9-6873-414d-9265-ea7d7d717989 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Lock "cinder-quobyte-de4d4e39-cf09-44fd-a0e8-9ffead2cd014" released by "delete_volume" :: held 0.796s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:40:56 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-e4a7e3c9-6873-414d-9265-ea7d7d717989 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Created reservations ['8212463b-e042-4108-b5e2-b323f67f4d76', '8fd32393-af65-46f3-9cf8-2f94518299c8', '20336ca2-ff3e-484a-9926-846a13640bdf', '812fd2d7-a804-4a38-b53f-898b504c4da5'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:40:56 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-5a29ca87-93fb-4882-bbd1-5571be07f5fa tempest-ProjectMemberTests-186690331 None] Acquiring lock "cinder-d4a51187-1671-4a7b-a953-39b0a2e05230-delete_snapshot" by "delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:40:57 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-e4a7e3c9-6873-414d-9265-ea7d7d717989 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:40:57 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-e4a7e3c9-6873-414d-9265-ea7d7d717989 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:40:57 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-e4a7e3c9-6873-414d-9265-ea7d7d717989 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:40:57 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-e4a7e3c9-6873-414d-9265-ea7d7d717989 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:40:57 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-e4a7e3c9-6873-414d-9265-ea7d7d717989 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:40:57 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e4a7e3c9-6873-414d-9265-ea7d7d717989 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:57 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-5a29ca87-93fb-4882-bbd1-5571be07f5fa tempest-ProjectMemberTests-186690331 None] Lock "cinder-d4a51187-1671-4a7b-a953-39b0a2e05230-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:40:57 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-5a29ca87-93fb-4882-bbd1-5571be07f5fa tempest-ProjectMemberTests-186690331 None] Acquiring lock "cinder-quobyte-d6978c83-e4a7-4334-9f5a-696a183c0dcf" by "delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:40:57 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-5a29ca87-93fb-4882-bbd1-5571be07f5fa tempest-ProjectMemberTests-186690331 None] Lock "cinder-quobyte-d6978c83-e4a7-4334-9f5a-696a183c0dcf" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:40:57 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-5a29ca87-93fb-4882-bbd1-5571be07f5fa tempest-ProjectMemberTests-186690331 None] Acquiring lock "cinder-quobyte-d4a51187-1671-4a7b-a953-39b0a2e05230" by "_delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:40:57 devstack sudo[107363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:40:57 devstack sudo[107363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:57 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-5a29ca87-93fb-4882-bbd1-5571be07f5fa tempest-ProjectMemberTests-186690331 None] Lock "cinder-quobyte-d4a51187-1671-4a7b-a953-39b0a2e05230" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:40:57 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-5a29ca87-93fb-4882-bbd1-5571be07f5fa tempest-ProjectMemberTests-186690331 None] Deleting offline snapshot d4a51187-1671-4a7b-a953-39b0a2e05230 of volume d6978c83-e4a7-4334-9f5a-696a183c0dcf {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 09:40:57 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-5a29ca87-93fb-4882-bbd1-5571be07f5fa tempest-ProjectMemberTests-186690331 None] snapshot_file for this snap is: volume-d6978c83-e4a7-4334-9f5a-696a183c0dcf.d4a51187-1671-4a7b-a953-39b0a2e05230 {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 09:40:57 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[947cf671-452b-4abf-930b-52d39ac6234b]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:40:57 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-5a29ca87-93fb-4882-bbd1-5571be07f5fa tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d6978c83-e4a7-4334-9f5a-696a183c0dcf.d4a51187-1671-4a7b-a953-39b0a2e05230 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:57 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-707a496b-c5ab-4a77-8bb5-3886f5259e0f tempest-CreateVolumesFromSnapshotTest-1115355121 None] Acquiring lock "cinder-480142d1-093a-4429-bc64-f5c651ff5ba0-delete_snapshot" by "delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:40:57 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-707a496b-c5ab-4a77-8bb5-3886f5259e0f tempest-CreateVolumesFromSnapshotTest-1115355121 None] Lock "cinder-480142d1-093a-4429-bc64-f5c651ff5ba0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:40:57 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-707a496b-c5ab-4a77-8bb5-3886f5259e0f tempest-CreateVolumesFromSnapshotTest-1115355121 None] Acquiring lock "cinder-quobyte-1746e80c-66c0-4799-83e8-63f25f7db499" by "delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:40:57 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-707a496b-c5ab-4a77-8bb5-3886f5259e0f tempest-CreateVolumesFromSnapshotTest-1115355121 None] Lock "cinder-quobyte-1746e80c-66c0-4799-83e8-63f25f7db499" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:40:57 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-707a496b-c5ab-4a77-8bb5-3886f5259e0f tempest-CreateVolumesFromSnapshotTest-1115355121 None] Acquiring lock "cinder-quobyte-480142d1-093a-4429-bc64-f5c651ff5ba0" by "_delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:40:57 devstack sudo[107365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d6978c83-e4a7-4334-9f5a-696a183c0dcf.d4a51187-1671-4a7b-a953-39b0a2e05230 Sep 28 09:40:57 devstack sudo[107365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:57 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-707a496b-c5ab-4a77-8bb5-3886f5259e0f tempest-CreateVolumesFromSnapshotTest-1115355121 None] Lock "cinder-quobyte-480142d1-093a-4429-bc64-f5c651ff5ba0" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:40:57 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-707a496b-c5ab-4a77-8bb5-3886f5259e0f tempest-CreateVolumesFromSnapshotTest-1115355121 None] Deleting offline snapshot 480142d1-093a-4429-bc64-f5c651ff5ba0 of volume 1746e80c-66c0-4799-83e8-63f25f7db499 {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 09:40:57 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-707a496b-c5ab-4a77-8bb5-3886f5259e0f tempest-CreateVolumesFromSnapshotTest-1115355121 None] snapshot_file for this snap is: volume-1746e80c-66c0-4799-83e8-63f25f7db499.480142d1-093a-4429-bc64-f5c651ff5ba0 {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 09:40:57 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c04d56-7b98-46a2-b484-3cb90ca8a556]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:40:57 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-707a496b-c5ab-4a77-8bb5-3886f5259e0f tempest-CreateVolumesFromSnapshotTest-1115355121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1746e80c-66c0-4799-83e8-63f25f7db499.480142d1-093a-4429-bc64-f5c651ff5ba0 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:57 devstack sudo[107363]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:57 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e4a7e3c9-6873-414d-9265-ea7d7d717989 tempest-CreateVolumesFromSnapshotTest-1115355121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.488s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:57 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-e4a7e3c9-6873-414d-9265-ea7d7d717989 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:40:57 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-e4a7e3c9-6873-414d-9265-ea7d7d717989 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Deleted volume successfully. Sep 28 09:40:57 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-e4a7e3c9-6873-414d-9265-ea7d7d717989 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Lock "cinder-de4d4e39-cf09-44fd-a0e8-9ffead2cd014-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:40:57 devstack sudo[107368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1746e80c-66c0-4799-83e8-63f25f7db499.480142d1-093a-4429-bc64-f5c651ff5ba0 Sep 28 09:40:57 devstack sudo[107368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:57 devstack sudo[107365]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:57 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-5a29ca87-93fb-4882-bbd1-5571be07f5fa tempest-ProjectMemberTests-186690331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d6978c83-e4a7-4334-9f5a-696a183c0dcf.d4a51187-1671-4a7b-a953-39b0a2e05230" returned: 0 in 0.569s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:57 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-5a29ca87-93fb-4882-bbd1-5571be07f5fa tempest-ProjectMemberTests-186690331 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d6978c83-e4a7-4334-9f5a-696a183c0dcf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86553) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 09:40:57 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[e08da4db-d0d5-47d0-9e1a-ceada0d6b4ac]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:40:57 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-5a29ca87-93fb-4882-bbd1-5571be07f5fa tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d6978c83-e4a7-4334-9f5a-696a183c0dcf {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:57 devstack sudo[107368]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:57 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-707a496b-c5ab-4a77-8bb5-3886f5259e0f tempest-CreateVolumesFromSnapshotTest-1115355121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1746e80c-66c0-4799-83e8-63f25f7db499.480142d1-093a-4429-bc64-f5c651ff5ba0" returned: 0 in 0.413s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:57 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-707a496b-c5ab-4a77-8bb5-3886f5259e0f tempest-CreateVolumesFromSnapshotTest-1115355121 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1746e80c-66c0-4799-83e8-63f25f7db499(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86553) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 09:40:57 devstack sudo[107373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d6978c83-e4a7-4334-9f5a-696a183c0dcf Sep 28 09:40:57 devstack sudo[107373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:57 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e9ed21-4e1c-4933-99c7-9f059ef805b4]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:40:57 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-707a496b-c5ab-4a77-8bb5-3886f5259e0f tempest-CreateVolumesFromSnapshotTest-1115355121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1746e80c-66c0-4799-83e8-63f25f7db499 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:58 devstack sudo[107378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1746e80c-66c0-4799-83e8-63f25f7db499 Sep 28 09:40:58 devstack sudo[107378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:58 devstack sudo[107373]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:58 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-5a29ca87-93fb-4882-bbd1-5571be07f5fa tempest-ProjectMemberTests-186690331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d6978c83-e4a7-4334-9f5a-696a183c0dcf" returned: 0 in 0.418s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:58 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-5a29ca87-93fb-4882-bbd1-5571be07f5fa tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d6978c83-e4a7-4334-9f5a-696a183c0dcf.d4a51187-1671-4a7b-a953-39b0a2e05230 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:58 devstack sudo[107384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d6978c83-e4a7-4334-9f5a-696a183c0dcf.d4a51187-1671-4a7b-a953-39b0a2e05230 Sep 28 09:40:58 devstack sudo[107384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:58 devstack sudo[107378]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:58 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-707a496b-c5ab-4a77-8bb5-3886f5259e0f tempest-CreateVolumesFromSnapshotTest-1115355121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1746e80c-66c0-4799-83e8-63f25f7db499" returned: 0 in 0.482s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:58 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-707a496b-c5ab-4a77-8bb5-3886f5259e0f tempest-CreateVolumesFromSnapshotTest-1115355121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1746e80c-66c0-4799-83e8-63f25f7db499.480142d1-093a-4429-bc64-f5c651ff5ba0 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:58 devstack sudo[107389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1746e80c-66c0-4799-83e8-63f25f7db499.480142d1-093a-4429-bc64-f5c651ff5ba0 Sep 28 09:40:58 devstack sudo[107389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:58 devstack sudo[107384]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:58 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-5a29ca87-93fb-4882-bbd1-5571be07f5fa tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d6978c83-e4a7-4334-9f5a-696a183c0dcf.d4a51187-1671-4a7b-a953-39b0a2e05230" returned: 0 in 0.466s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:58 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-5a29ca87-93fb-4882-bbd1-5571be07f5fa tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d6978c83-e4a7-4334-9f5a-696a183c0dcf.d4a51187-1671-4a7b-a953-39b0a2e05230 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:58 devstack sudo[107396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d6978c83-e4a7-4334-9f5a-696a183c0dcf.d4a51187-1671-4a7b-a953-39b0a2e05230 Sep 28 09:40:58 devstack sudo[107396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:58 devstack sudo[107389]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:58 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-707a496b-c5ab-4a77-8bb5-3886f5259e0f tempest-CreateVolumesFromSnapshotTest-1115355121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1746e80c-66c0-4799-83e8-63f25f7db499.480142d1-093a-4429-bc64-f5c651ff5ba0" returned: 0 in 0.465s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:58 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-707a496b-c5ab-4a77-8bb5-3886f5259e0f tempest-CreateVolumesFromSnapshotTest-1115355121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1746e80c-66c0-4799-83e8-63f25f7db499.480142d1-093a-4429-bc64-f5c651ff5ba0 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:58 devstack sudo[107401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1746e80c-66c0-4799-83e8-63f25f7db499.480142d1-093a-4429-bc64-f5c651ff5ba0 Sep 28 09:40:58 devstack sudo[107401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:40:58 devstack sudo[107396]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:58 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-5a29ca87-93fb-4882-bbd1-5571be07f5fa tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d6978c83-e4a7-4334-9f5a-696a183c0dcf.d4a51187-1671-4a7b-a953-39b0a2e05230" returned: 0 in 0.335s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:59 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-5a29ca87-93fb-4882-bbd1-5571be07f5fa tempest-ProjectMemberTests-186690331 None] Lock "cinder-quobyte-d4a51187-1671-4a7b-a953-39b0a2e05230" released by "_delete_snapshot" :: held 1.949s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:40:59 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-5a29ca87-93fb-4882-bbd1-5571be07f5fa tempest-ProjectMemberTests-186690331 None] Lock "cinder-quobyte-d6978c83-e4a7-4334-9f5a-696a183c0dcf" released by "delete_snapshot" :: held 1.977s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:40:59 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-5a29ca87-93fb-4882-bbd1-5571be07f5fa tempest-ProjectMemberTests-186690331 None] Created reservations ['9b5c5594-174f-4bfb-bbf5-810ecb27ae86', '8966b70a-0424-4e9b-970a-8ba1f37634c0', '3830d4f8-4c79-44b6-8959-cd06b8b916a2', '8aec6257-34b4-41b7-90fa-f190c4696051'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:40:59 devstack sudo[107401]: pam_unix(sudo:session): session closed for user root Sep 28 09:40:59 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-707a496b-c5ab-4a77-8bb5-3886f5259e0f tempest-CreateVolumesFromSnapshotTest-1115355121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1746e80c-66c0-4799-83e8-63f25f7db499.480142d1-093a-4429-bc64-f5c651ff5ba0" returned: 0 in 0.301s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:40:59 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-5a29ca87-93fb-4882-bbd1-5571be07f5fa tempest-ProjectMemberTests-186690331 None] Delete snapshot completed successfully. Sep 28 09:40:59 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-5a29ca87-93fb-4882-bbd1-5571be07f5fa tempest-ProjectMemberTests-186690331 None] Lock "cinder-d4a51187-1671-4a7b-a953-39b0a2e05230-delete_snapshot" released by "delete_snapshot" :: held 2.192s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:40:59 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-707a496b-c5ab-4a77-8bb5-3886f5259e0f tempest-CreateVolumesFromSnapshotTest-1115355121 None] Lock "cinder-quobyte-480142d1-093a-4429-bc64-f5c651ff5ba0" released by "_delete_snapshot" :: held 1.836s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:40:59 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-707a496b-c5ab-4a77-8bb5-3886f5259e0f tempest-CreateVolumesFromSnapshotTest-1115355121 None] Lock "cinder-quobyte-1746e80c-66c0-4799-83e8-63f25f7db499" released by "delete_snapshot" :: held 1.879s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:40:59 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-707a496b-c5ab-4a77-8bb5-3886f5259e0f tempest-CreateVolumesFromSnapshotTest-1115355121 None] Created reservations ['45e8ad69-abfc-4544-8835-f92f57ba5f32', 'cc94c764-d5ac-41c0-8851-9a6cbc6bef54', '400a8796-d5ae-424d-a788-3433f9cb37ec', '9ee7c452-482d-4331-b07c-8403b9fa69af'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:40:59 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-707a496b-c5ab-4a77-8bb5-3886f5259e0f tempest-CreateVolumesFromSnapshotTest-1115355121 None] Delete snapshot completed successfully. Sep 28 09:40:59 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-707a496b-c5ab-4a77-8bb5-3886f5259e0f tempest-CreateVolumesFromSnapshotTest-1115355121 None] Lock "cinder-480142d1-093a-4429-bc64-f5c651ff5ba0-delete_snapshot" released by "delete_snapshot" :: held 2.048s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:40:59 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-da24d163-34a7-4551-9964-9bc91f3c3c41 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Acquiring lock "cinder-1746e80c-66c0-4799-83e8-63f25f7db499-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:40:59 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-da24d163-34a7-4551-9964-9bc91f3c3c41 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Lock "cinder-1746e80c-66c0-4799-83e8-63f25f7db499-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:40:59 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-da24d163-34a7-4551-9964-9bc91f3c3c41 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Acquiring lock "cinder-quobyte-1746e80c-66c0-4799-83e8-63f25f7db499" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:40:59 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-da24d163-34a7-4551-9964-9bc91f3c3c41 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Lock "cinder-quobyte-1746e80c-66c0-4799-83e8-63f25f7db499" acquired by "delete_volume" :: waited 0.020s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:40:59 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b8b702-fda6-4ed1-9972-ac9e80f43ccf]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:40:59 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-da24d163-34a7-4551-9964-9bc91f3c3c41 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1746e80c-66c0-4799-83e8-63f25f7db499 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:40:59 devstack sudo[107405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1746e80c-66c0-4799-83e8-63f25f7db499 Sep 28 09:40:59 devstack sudo[107405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:00 devstack sudo[107405]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:00 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-da24d163-34a7-4551-9964-9bc91f3c3c41 tempest-CreateVolumesFromSnapshotTest-1115355121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1746e80c-66c0-4799-83e8-63f25f7db499" returned: 0 in 0.423s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:00 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-da24d163-34a7-4551-9964-9bc91f3c3c41 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1746e80c-66c0-4799-83e8-63f25f7db499 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:00 devstack sudo[107410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1746e80c-66c0-4799-83e8-63f25f7db499 Sep 28 09:41:00 devstack sudo[107410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:00 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-405ab73b-9669-4779-ad12-448f98d068cb tempest-ProjectMemberTests-186690331 None] Acquiring lock "cinder-d6978c83-e4a7-4334-9f5a-696a183c0dcf-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:41:00 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-405ab73b-9669-4779-ad12-448f98d068cb tempest-ProjectMemberTests-186690331 None] Lock "cinder-d6978c83-e4a7-4334-9f5a-696a183c0dcf-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:41:00 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-405ab73b-9669-4779-ad12-448f98d068cb tempest-ProjectMemberTests-186690331 None] Acquiring lock "cinder-quobyte-d6978c83-e4a7-4334-9f5a-696a183c0dcf" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:41:00 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-405ab73b-9669-4779-ad12-448f98d068cb tempest-ProjectMemberTests-186690331 None] Lock "cinder-quobyte-d6978c83-e4a7-4334-9f5a-696a183c0dcf" acquired by "delete_volume" :: waited 0.020s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:41:00 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f3f766-341c-4e5e-a21a-2dc4689c4b92]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:41:00 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-405ab73b-9669-4779-ad12-448f98d068cb tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d6978c83-e4a7-4334-9f5a-696a183c0dcf {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:00 devstack sudo[107410]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:00 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-da24d163-34a7-4551-9964-9bc91f3c3c41 tempest-CreateVolumesFromSnapshotTest-1115355121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1746e80c-66c0-4799-83e8-63f25f7db499" returned: 0 in 0.414s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:00 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-da24d163-34a7-4551-9964-9bc91f3c3c41 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Lock "cinder-quobyte-1746e80c-66c0-4799-83e8-63f25f7db499" released by "delete_volume" :: held 0.937s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:41:00 devstack sudo[107412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d6978c83-e4a7-4334-9f5a-696a183c0dcf Sep 28 09:41:00 devstack sudo[107412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:00 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-da24d163-34a7-4551-9964-9bc91f3c3c41 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Created reservations ['640f9c05-feea-44fb-88de-7a7dd81755e5', '49c8548d-39ed-476c-989e-26f0cb1994a9', 'b2934193-9836-4839-8069-32b7ffbd4fac', '8474cc0a-515c-4d99-a91b-70e08bddc17a'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:41:00 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-da24d163-34a7-4551-9964-9bc91f3c3c41 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:41:00 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-da24d163-34a7-4551-9964-9bc91f3c3c41 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:41:00 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-da24d163-34a7-4551-9964-9bc91f3c3c41 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:41:00 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-da24d163-34a7-4551-9964-9bc91f3c3c41 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:41:00 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-da24d163-34a7-4551-9964-9bc91f3c3c41 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:41:00 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-da24d163-34a7-4551-9964-9bc91f3c3c41 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:00 devstack sudo[107415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:41:00 devstack sudo[107415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:00 devstack sudo[107412]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:00 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-405ab73b-9669-4779-ad12-448f98d068cb tempest-ProjectMemberTests-186690331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d6978c83-e4a7-4334-9f5a-696a183c0dcf" returned: 0 in 0.506s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:00 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-405ab73b-9669-4779-ad12-448f98d068cb tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d6978c83-e4a7-4334-9f5a-696a183c0dcf {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:01 devstack sudo[107420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d6978c83-e4a7-4334-9f5a-696a183c0dcf Sep 28 09:41:01 devstack sudo[107420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:01 devstack sudo[107415]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:01 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-da24d163-34a7-4551-9964-9bc91f3c3c41 tempest-CreateVolumesFromSnapshotTest-1115355121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.325s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:01 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-da24d163-34a7-4551-9964-9bc91f3c3c41 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:41:01 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-da24d163-34a7-4551-9964-9bc91f3c3c41 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Deleted volume successfully. Sep 28 09:41:01 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-da24d163-34a7-4551-9964-9bc91f3c3c41 tempest-CreateVolumesFromSnapshotTest-1115355121 None] Lock "cinder-1746e80c-66c0-4799-83e8-63f25f7db499-delete_volume" released by "delete_volume" :: held 1.550s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:41:01 devstack sudo[107420]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:01 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-405ab73b-9669-4779-ad12-448f98d068cb tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d6978c83-e4a7-4334-9f5a-696a183c0dcf" returned: 0 in 0.337s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:01 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-405ab73b-9669-4779-ad12-448f98d068cb tempest-ProjectMemberTests-186690331 None] Lock "cinder-quobyte-d6978c83-e4a7-4334-9f5a-696a183c0dcf" released by "delete_volume" :: held 0.939s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:41:01 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-405ab73b-9669-4779-ad12-448f98d068cb tempest-ProjectMemberTests-186690331 None] Created reservations ['c98a454e-28ca-4ed2-849c-27434b0222a3', 'b6fdb41d-fd1c-4ba9-8c4c-96d82e4c4c59', 'add5c07f-ed2b-4238-804c-5cc2ff944922', 'e40955a6-9d08-4239-bde0-75c9d9caceba'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:41:01 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-405ab73b-9669-4779-ad12-448f98d068cb tempest-ProjectMemberTests-186690331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:41:01 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-405ab73b-9669-4779-ad12-448f98d068cb tempest-ProjectMemberTests-186690331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:41:01 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-405ab73b-9669-4779-ad12-448f98d068cb tempest-ProjectMemberTests-186690331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:41:01 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-405ab73b-9669-4779-ad12-448f98d068cb tempest-ProjectMemberTests-186690331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:41:01 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-405ab73b-9669-4779-ad12-448f98d068cb tempest-ProjectMemberTests-186690331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:41:01 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-405ab73b-9669-4779-ad12-448f98d068cb tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:01 devstack sudo[107426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:41:01 devstack sudo[107426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:01 devstack sudo[107426]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:01 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-405ab73b-9669-4779-ad12-448f98d068cb tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.328s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:01 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-405ab73b-9669-4779-ad12-448f98d068cb tempest-ProjectMemberTests-186690331 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:41:01 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-405ab73b-9669-4779-ad12-448f98d068cb tempest-ProjectMemberTests-186690331 None] Deleted volume successfully. Sep 28 09:41:01 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-405ab73b-9669-4779-ad12-448f98d068cb tempest-ProjectMemberTests-186690331 None] Lock "cinder-d6978c83-e4a7-4334-9f5a-696a183c0dcf-delete_volume" released by "delete_volume" :: held 1.538s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:41:02 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-0356af5c-4d77-4993-bc30-7e83508fae1c tempest-ProjectMemberTests-186690331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:41:02 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0356af5c-4d77-4993-bc30-7e83508fae1c tempest-ProjectMemberTests-186690331 None] Flow 'volume_create_manager' (973cbdac-8ba2-4b6f-aae9-e27d07432894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:41:02 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0356af5c-4d77-4993-bc30-7e83508fae1c tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e85d8db-d6d6-467b-9467-ed589805cabd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:02 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0356af5c-4d77-4993-bc30-7e83508fae1c tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e85d8db-d6d6-467b-9467-ed589805cabd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:41:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-186959702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9b0c11c-e13b-4e8b-9911-675f31019385,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50c5ebfa35e84e1fa822f83efd2739e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:41:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:41:02Z,use_quota=True,user_id='029e33208bca4e258a762ad19e5ed78e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:02 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0356af5c-4d77-4993-bc30-7e83508fae1c tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (408c712e-8329-4779-bbfb-71adbd7ca17b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:02 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0356af5c-4d77-4993-bc30-7e83508fae1c tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (408c712e-8329-4779-bbfb-71adbd7ca17b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:02 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0356af5c-4d77-4993-bc30-7e83508fae1c tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5699b36-e4c5-4087-bb49-76c0f5b45db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:02 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0356af5c-4d77-4993-bc30-7e83508fae1c tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5699b36-e4c5-4087-bb49-76c0f5b45db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9b0c11c-e13b-4e8b-9911-675f31019385', 'volume_name': 'volume-c9b0c11c-e13b-4e8b-9911-675f31019385', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:02 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0356af5c-4d77-4993-bc30-7e83508fae1c tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a15591d-6f94-4fc0-a849-e2ef7778fdd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:02 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0356af5c-4d77-4993-bc30-7e83508fae1c tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a15591d-6f94-4fc0-a849-e2ef7778fdd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:02 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0356af5c-4d77-4993-bc30-7e83508fae1c tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eab0e628-47c2-4121-9df0-e5a2df609636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:02 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-0356af5c-4d77-4993-bc30-7e83508fae1c tempest-ProjectMemberTests-186690331 None] Volume c9b0c11c-e13b-4e8b-9911-675f31019385: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9b0c11c-e13b-4e8b-9911-675f31019385', 'volume_size': 1} Sep 28 09:41:02 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-0356af5c-4d77-4993-bc30-7e83508fae1c tempest-ProjectMemberTests-186690331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:41:02 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-0356af5c-4d77-4993-bc30-7e83508fae1c tempest-ProjectMemberTests-186690331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:41:02 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-0356af5c-4d77-4993-bc30-7e83508fae1c tempest-ProjectMemberTests-186690331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:41:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-186959702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9b0c11c-e13b-4e8b-9911-675f31019385,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50c5ebfa35e84e1fa822f83efd2739e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:41:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:41:02Z,use_quota=True,user_id='029e33208bca4e258a762ad19e5ed78e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:41:02 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-0356af5c-4d77-4993-bc30-7e83508fae1c tempest-ProjectMemberTests-186690331 None] Creating volume c9b0c11c-e13b-4e8b-9911-675f31019385 {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:41:02 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-0356af5c-4d77-4993-bc30-7e83508fae1c tempest-ProjectMemberTests-186690331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:41:02 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-0356af5c-4d77-4993-bc30-7e83508fae1c tempest-ProjectMemberTests-186690331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:41:02 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-0356af5c-4d77-4993-bc30-7e83508fae1c tempest-ProjectMemberTests-186690331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:41:02 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-0356af5c-4d77-4993-bc30-7e83508fae1c tempest-ProjectMemberTests-186690331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:41:02 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-0356af5c-4d77-4993-bc30-7e83508fae1c tempest-ProjectMemberTests-186690331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:41:02 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-0356af5c-4d77-4993-bc30-7e83508fae1c tempest-ProjectMemberTests-186690331 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:41:02 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-0356af5c-4d77-4993-bc30-7e83508fae1c tempest-ProjectMemberTests-186690331 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:41:02 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0356af5c-4d77-4993-bc30-7e83508fae1c tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c9b0c11c-e13b-4e8b-9911-675f31019385 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:02 devstack sudo[107429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c9b0c11c-e13b-4e8b-9911-675f31019385 1073741824 Sep 28 09:41:02 devstack sudo[107429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:02 devstack sudo[107429]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:02 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0356af5c-4d77-4993-bc30-7e83508fae1c tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c9b0c11c-e13b-4e8b-9911-675f31019385 1073741824" returned: 0 in 0.656s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:02 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0356af5c-4d77-4993-bc30-7e83508fae1c tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c9b0c11c-e13b-4e8b-9911-675f31019385 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:02 devstack sudo[107435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c9b0c11c-e13b-4e8b-9911-675f31019385 Sep 28 09:41:02 devstack sudo[107435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:03 devstack sudo[107435]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:03 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0356af5c-4d77-4993-bc30-7e83508fae1c tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c9b0c11c-e13b-4e8b-9911-675f31019385" returned: 0 in 0.330s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:03 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-0356af5c-4d77-4993-bc30-7e83508fae1c tempest-ProjectMemberTests-186690331 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:41:03 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-0356af5c-4d77-4993-bc30-7e83508fae1c tempest-ProjectMemberTests-186690331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:41:03 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0356af5c-4d77-4993-bc30-7e83508fae1c tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eab0e628-47c2-4121-9df0-e5a2df609636) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9b0c11c-e13b-4e8b-9911-675f31019385', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:03 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0356af5c-4d77-4993-bc30-7e83508fae1c tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (813b1898-31b5-4ed9-a7ff-0cb0bf2efe06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:03 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-0356af5c-4d77-4993-bc30-7e83508fae1c tempest-ProjectMemberTests-186690331 None] Volume volume-c9b0c11c-e13b-4e8b-9911-675f31019385 (c9b0c11c-e13b-4e8b-9911-675f31019385): created successfully Sep 28 09:41:03 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0356af5c-4d77-4993-bc30-7e83508fae1c tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (813b1898-31b5-4ed9-a7ff-0cb0bf2efe06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:03 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-0356af5c-4d77-4993-bc30-7e83508fae1c tempest-ProjectMemberTests-186690331 None] Flow 'volume_create_manager' (973cbdac-8ba2-4b6f-aae9-e27d07432894) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:41:03 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-0356af5c-4d77-4993-bc30-7e83508fae1c tempest-ProjectMemberTests-186690331 None] Created volume successfully. Sep 28 09:41:03 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fc42cb2-9a06-46fa-8b96-697e8460ae52 tempest-ProjectReaderTests-1337840947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:41:03 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7fc42cb2-9a06-46fa-8b96-697e8460ae52 tempest-ProjectReaderTests-1337840947 None] Flow 'volume_create_manager' (1a39baad-2ed0-47a6-8237-191ca05855ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:41:03 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7fc42cb2-9a06-46fa-8b96-697e8460ae52 tempest-ProjectReaderTests-1337840947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed22530c-9596-4d5b-ab77-836fdd451154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:03 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7fc42cb2-9a06-46fa-8b96-697e8460ae52 tempest-ProjectReaderTests-1337840947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed22530c-9596-4d5b-ab77-836fdd451154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:41:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-324627752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0c11ba1-6f5d-4795-9978-39248d8afe9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fae6883da88d4555ae0bbd24a1c9b251',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:41:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:41:04Z,use_quota=True,user_id='1daf865517454e75896cd4d9e1c08cc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:03 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7fc42cb2-9a06-46fa-8b96-697e8460ae52 tempest-ProjectReaderTests-1337840947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6822e9ef-2d1e-4fdb-abec-45d46081e3d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:03 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7fc42cb2-9a06-46fa-8b96-697e8460ae52 tempest-ProjectReaderTests-1337840947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6822e9ef-2d1e-4fdb-abec-45d46081e3d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:03 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7fc42cb2-9a06-46fa-8b96-697e8460ae52 tempest-ProjectReaderTests-1337840947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e5c58d6-b8ea-44eb-b488-187dbd9969df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:03 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7fc42cb2-9a06-46fa-8b96-697e8460ae52 tempest-ProjectReaderTests-1337840947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e5c58d6-b8ea-44eb-b488-187dbd9969df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0c11ba1-6f5d-4795-9978-39248d8afe9a', 'volume_name': 'volume-c0c11ba1-6f5d-4795-9978-39248d8afe9a', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:03 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7fc42cb2-9a06-46fa-8b96-697e8460ae52 tempest-ProjectReaderTests-1337840947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9397ee3-946e-46d1-a164-86c47f4e0690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:03 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7fc42cb2-9a06-46fa-8b96-697e8460ae52 tempest-ProjectReaderTests-1337840947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9397ee3-946e-46d1-a164-86c47f4e0690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:03 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7fc42cb2-9a06-46fa-8b96-697e8460ae52 tempest-ProjectReaderTests-1337840947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cacb2f24-9035-4bc9-83a4-f8f55990d322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:03 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-7fc42cb2-9a06-46fa-8b96-697e8460ae52 tempest-ProjectReaderTests-1337840947 None] Volume c0c11ba1-6f5d-4795-9978-39248d8afe9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0c11ba1-6f5d-4795-9978-39248d8afe9a', 'volume_size': 1} Sep 28 09:41:03 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-7fc42cb2-9a06-46fa-8b96-697e8460ae52 tempest-ProjectReaderTests-1337840947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:41:03 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-7fc42cb2-9a06-46fa-8b96-697e8460ae52 tempest-ProjectReaderTests-1337840947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:41:03 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-7fc42cb2-9a06-46fa-8b96-697e8460ae52 tempest-ProjectReaderTests-1337840947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:41:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-324627752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0c11ba1-6f5d-4795-9978-39248d8afe9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fae6883da88d4555ae0bbd24a1c9b251',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:41:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:41:04Z,use_quota=True,user_id='1daf865517454e75896cd4d9e1c08cc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:41:03 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-7fc42cb2-9a06-46fa-8b96-697e8460ae52 tempest-ProjectReaderTests-1337840947 None] Creating volume c0c11ba1-6f5d-4795-9978-39248d8afe9a {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:41:03 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-7fc42cb2-9a06-46fa-8b96-697e8460ae52 tempest-ProjectReaderTests-1337840947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:41:04 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-7fc42cb2-9a06-46fa-8b96-697e8460ae52 tempest-ProjectReaderTests-1337840947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:41:04 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-7fc42cb2-9a06-46fa-8b96-697e8460ae52 tempest-ProjectReaderTests-1337840947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:41:04 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-7fc42cb2-9a06-46fa-8b96-697e8460ae52 tempest-ProjectReaderTests-1337840947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:41:04 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-7fc42cb2-9a06-46fa-8b96-697e8460ae52 tempest-ProjectReaderTests-1337840947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:41:04 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-7fc42cb2-9a06-46fa-8b96-697e8460ae52 tempest-ProjectReaderTests-1337840947 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:41:04 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-7fc42cb2-9a06-46fa-8b96-697e8460ae52 tempest-ProjectReaderTests-1337840947 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:41:04 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-7fc42cb2-9a06-46fa-8b96-697e8460ae52 tempest-ProjectReaderTests-1337840947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c0c11ba1-6f5d-4795-9978-39248d8afe9a 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:04 devstack sudo[107438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c0c11ba1-6f5d-4795-9978-39248d8afe9a 1073741824 Sep 28 09:41:04 devstack sudo[107438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:04 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-b5e5df00-a00f-4aaa-9bdb-7c3c22df1da1 tempest-ProjectMemberTests-186690331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:41:04 devstack sudo[107438]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:04 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-7fc42cb2-9a06-46fa-8b96-697e8460ae52 tempest-ProjectReaderTests-1337840947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c0c11ba1-6f5d-4795-9978-39248d8afe9a 1073741824" returned: 0 in 0.589s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:04 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-7fc42cb2-9a06-46fa-8b96-697e8460ae52 tempest-ProjectReaderTests-1337840947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c0c11ba1-6f5d-4795-9978-39248d8afe9a {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:04 devstack sudo[107444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c0c11ba1-6f5d-4795-9978-39248d8afe9a Sep 28 09:41:04 devstack sudo[107444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:04 devstack sudo[107444]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:04 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-7fc42cb2-9a06-46fa-8b96-697e8460ae52 tempest-ProjectReaderTests-1337840947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c0c11ba1-6f5d-4795-9978-39248d8afe9a" returned: 0 in 0.299s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:04 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-7fc42cb2-9a06-46fa-8b96-697e8460ae52 tempest-ProjectReaderTests-1337840947 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:41:04 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-7fc42cb2-9a06-46fa-8b96-697e8460ae52 tempest-ProjectReaderTests-1337840947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:41:04 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-b5e5df00-a00f-4aaa-9bdb-7c3c22df1da1 tempest-ProjectMemberTests-186690331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.560s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:41:04 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-b5e5df00-a00f-4aaa-9bdb-7c3c22df1da1 tempest-ProjectMemberTests-186690331 None] Creating offline snapshot b1dbc504-c408-4b89-b441-119457d4392f of volume c9b0c11c-e13b-4e8b-9911-675f31019385 {{(pid=86553) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 09:41:04 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7fc42cb2-9a06-46fa-8b96-697e8460ae52 tempest-ProjectReaderTests-1337840947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cacb2f24-9035-4bc9-83a4-f8f55990d322) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0c11ba1-6f5d-4795-9978-39248d8afe9a', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:04 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7fc42cb2-9a06-46fa-8b96-697e8460ae52 tempest-ProjectReaderTests-1337840947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05b835ed-66b5-4702-84dd-59f1a923e7dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:04 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[da4c3074-264c-4a86-971b-a356cd9aef85]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:41:04 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b5e5df00-a00f-4aaa-9bdb-7c3c22df1da1 tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c9b0c11c-e13b-4e8b-9911-675f31019385 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:05 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-7fc42cb2-9a06-46fa-8b96-697e8460ae52 tempest-ProjectReaderTests-1337840947 None] Volume volume-c0c11ba1-6f5d-4795-9978-39248d8afe9a (c0c11ba1-6f5d-4795-9978-39248d8afe9a): created successfully Sep 28 09:41:05 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7fc42cb2-9a06-46fa-8b96-697e8460ae52 tempest-ProjectReaderTests-1337840947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05b835ed-66b5-4702-84dd-59f1a923e7dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:05 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-7fc42cb2-9a06-46fa-8b96-697e8460ae52 tempest-ProjectReaderTests-1337840947 None] Flow 'volume_create_manager' (1a39baad-2ed0-47a6-8237-191ca05855ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:41:05 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-7fc42cb2-9a06-46fa-8b96-697e8460ae52 tempest-ProjectReaderTests-1337840947 None] Created volume successfully. Sep 28 09:41:05 devstack sudo[107447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c9b0c11c-e13b-4e8b-9911-675f31019385 Sep 28 09:41:05 devstack sudo[107447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:05 devstack sudo[107447]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:05 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b5e5df00-a00f-4aaa-9bdb-7c3c22df1da1 tempest-ProjectMemberTests-186690331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c9b0c11c-e13b-4e8b-9911-675f31019385" returned: 0 in 0.498s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:05 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b5e5df00-a00f-4aaa-9bdb-7c3c22df1da1 tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c9b0c11c-e13b-4e8b-9911-675f31019385,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c9b0c11c-e13b-4e8b-9911-675f31019385.b1dbc504-c408-4b89-b441-119457d4392f 1G {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:05 devstack sudo[107453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c9b0c11c-e13b-4e8b-9911-675f31019385,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c9b0c11c-e13b-4e8b-9911-675f31019385.b1dbc504-c408-4b89-b441-119457d4392f 1G Sep 28 09:41:05 devstack sudo[107453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:05 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-46a641a2-9377-47c9-9d3f-9cd1a4c67c2a tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:41:05 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-46a641a2-9377-47c9-9d3f-9cd1a4c67c2a tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Flow 'volume_create_manager' (44c48ee8-53a1-4297-ada9-244bee3acaef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:41:05 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-46a641a2-9377-47c9-9d3f-9cd1a4c67c2a tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22618376-524d-45b0-a97a-01e6476bd779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:05 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-46a641a2-9377-47c9-9d3f-9cd1a4c67c2a tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22618376-524d-45b0-a97a-01e6476bd779) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:41:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1902161896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d75811e9-ba45-4ee3-a480-1e931bd988bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='835910649f2f4c438b6bfc6df82fc4bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:41:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:41:06Z,use_quota=True,user_id='4fccccf4a9d0435a92f4fae7d0ae6216',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:05 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-46a641a2-9377-47c9-9d3f-9cd1a4c67c2a tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df970e27-327e-43c6-aa22-814243ce55e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:05 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-46a641a2-9377-47c9-9d3f-9cd1a4c67c2a tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df970e27-327e-43c6-aa22-814243ce55e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:05 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-46a641a2-9377-47c9-9d3f-9cd1a4c67c2a tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be14ff69-6d3d-4b01-ab5b-90f9cff47198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:05 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-46a641a2-9377-47c9-9d3f-9cd1a4c67c2a tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be14ff69-6d3d-4b01-ab5b-90f9cff47198) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd75811e9-ba45-4ee3-a480-1e931bd988bb', 'volume_name': 'volume-d75811e9-ba45-4ee3-a480-1e931bd988bb', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:05 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-46a641a2-9377-47c9-9d3f-9cd1a4c67c2a tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64ef7e0a-d184-4e17-ba1c-da7062bc5240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:05 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-46a641a2-9377-47c9-9d3f-9cd1a4c67c2a tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64ef7e0a-d184-4e17-ba1c-da7062bc5240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:05 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-46a641a2-9377-47c9-9d3f-9cd1a4c67c2a tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20e2364e-3276-49ec-b3d5-6097b9c6cc5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:05 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-46a641a2-9377-47c9-9d3f-9cd1a4c67c2a tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Volume d75811e9-ba45-4ee3-a480-1e931bd988bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d75811e9-ba45-4ee3-a480-1e931bd988bb', 'volume_size': 1} Sep 28 09:41:05 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-46a641a2-9377-47c9-9d3f-9cd1a4c67c2a tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:41:05 devstack sudo[107453]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:05 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b5e5df00-a00f-4aaa-9bdb-7c3c22df1da1 tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c9b0c11c-e13b-4e8b-9911-675f31019385,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c9b0c11c-e13b-4e8b-9911-675f31019385.b1dbc504-c408-4b89-b441-119457d4392f 1G" returned: 0 in 0.485s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:05 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b5e5df00-a00f-4aaa-9bdb-7c3c22df1da1 tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9b0c11c-e13b-4e8b-9911-675f31019385 -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c9b0c11c-e13b-4e8b-9911-675f31019385.b1dbc504-c408-4b89-b441-119457d4392f {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:06 devstack sudo[107459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9b0c11c-e13b-4e8b-9911-675f31019385 -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c9b0c11c-e13b-4e8b-9911-675f31019385.b1dbc504-c408-4b89-b441-119457d4392f Sep 28 09:41:06 devstack sudo[107459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:06 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-8380f3d4-4daf-4338-96b3-f857bfa9cc60 tempest-ProjectReaderTests-1337840947 None] Acquiring lock "cinder-c0c11ba1-6f5d-4795-9978-39248d8afe9a-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:41:06 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-8380f3d4-4daf-4338-96b3-f857bfa9cc60 tempest-ProjectReaderTests-1337840947 None] Lock "cinder-c0c11ba1-6f5d-4795-9978-39248d8afe9a-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:41:06 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-8380f3d4-4daf-4338-96b3-f857bfa9cc60 tempest-ProjectReaderTests-1337840947 None] Acquiring lock "cinder-quobyte-c0c11ba1-6f5d-4795-9978-39248d8afe9a" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:41:06 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-8380f3d4-4daf-4338-96b3-f857bfa9cc60 tempest-ProjectReaderTests-1337840947 None] Lock "cinder-quobyte-c0c11ba1-6f5d-4795-9978-39248d8afe9a" acquired by "delete_volume" :: waited 0.023s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:41:06 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[096e73a2-5ae2-43fd-9f8b-df2a220af282]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:41:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-8380f3d4-4daf-4338-96b3-f857bfa9cc60 tempest-ProjectReaderTests-1337840947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c0c11ba1-6f5d-4795-9978-39248d8afe9a {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:06 devstack sudo[107459]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b5e5df00-a00f-4aaa-9bdb-7c3c22df1da1 tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9b0c11c-e13b-4e8b-9911-675f31019385 -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c9b0c11c-e13b-4e8b-9911-675f31019385.b1dbc504-c408-4b89-b441-119457d4392f" returned: 0 in 0.391s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:06 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-b5e5df00-a00f-4aaa-9bdb-7c3c22df1da1 tempest-ProjectMemberTests-186690331 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c9b0c11c-e13b-4e8b-9911-675f31019385.b1dbc504-c408-4b89-b441-119457d4392f is being set with open permissions: ugo+rw Sep 28 09:41:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b5e5df00-a00f-4aaa-9bdb-7c3c22df1da1 tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c9b0c11c-e13b-4e8b-9911-675f31019385.b1dbc504-c408-4b89-b441-119457d4392f {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:06 devstack sudo[107466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c9b0c11c-e13b-4e8b-9911-675f31019385.b1dbc504-c408-4b89-b441-119457d4392f Sep 28 09:41:06 devstack sudo[107466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:06 devstack sudo[107465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c0c11ba1-6f5d-4795-9978-39248d8afe9a Sep 28 09:41:06 devstack sudo[107465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:06 devstack sudo[107466]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b5e5df00-a00f-4aaa-9bdb-7c3c22df1da1 tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c9b0c11c-e13b-4e8b-9911-675f31019385.b1dbc504-c408-4b89-b441-119457d4392f" returned: 0 in 0.256s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b5e5df00-a00f-4aaa-9bdb-7c3c22df1da1 tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c9b0c11c-e13b-4e8b-9911-675f31019385.info {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:06 devstack sudo[107473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c9b0c11c-e13b-4e8b-9911-675f31019385.info Sep 28 09:41:06 devstack sudo[107473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:06 devstack sudo[107465]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-8380f3d4-4daf-4338-96b3-f857bfa9cc60 tempest-ProjectReaderTests-1337840947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c0c11ba1-6f5d-4795-9978-39248d8afe9a" returned: 0 in 0.386s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-8380f3d4-4daf-4338-96b3-f857bfa9cc60 tempest-ProjectReaderTests-1337840947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c0c11ba1-6f5d-4795-9978-39248d8afe9a {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:06 devstack sudo[107475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c0c11ba1-6f5d-4795-9978-39248d8afe9a Sep 28 09:41:06 devstack sudo[107475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:06 devstack sudo[107473]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b5e5df00-a00f-4aaa-9bdb-7c3c22df1da1 tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c9b0c11c-e13b-4e8b-9911-675f31019385.info" returned: 0 in 0.254s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:06 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-b5e5df00-a00f-4aaa-9bdb-7c3c22df1da1 tempest-ProjectMemberTests-186690331 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c9b0c11c-e13b-4e8b-9911-675f31019385.info is being set with open permissions: ugo+rw Sep 28 09:41:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b5e5df00-a00f-4aaa-9bdb-7c3c22df1da1 tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c9b0c11c-e13b-4e8b-9911-675f31019385.info {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:06 devstack sudo[107479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c9b0c11c-e13b-4e8b-9911-675f31019385.info Sep 28 09:41:06 devstack sudo[107479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:06 devstack sudo[107475]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-8380f3d4-4daf-4338-96b3-f857bfa9cc60 tempest-ProjectReaderTests-1337840947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c0c11ba1-6f5d-4795-9978-39248d8afe9a" returned: 0 in 0.253s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:06 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-8380f3d4-4daf-4338-96b3-f857bfa9cc60 tempest-ProjectReaderTests-1337840947 None] Lock "cinder-quobyte-c0c11ba1-6f5d-4795-9978-39248d8afe9a" released by "delete_volume" :: held 0.702s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:41:07 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-8380f3d4-4daf-4338-96b3-f857bfa9cc60 tempest-ProjectReaderTests-1337840947 None] Created reservations ['77f5c319-154c-4b77-9227-0a324d052822', 'eec5d747-4652-415a-9679-f8bf55558b52', 'c08b122b-7ebf-4bb9-b76a-99a481c3b272', '6632ff27-d626-4de1-b0d6-a53011c944cf'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:41:07 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-8380f3d4-4daf-4338-96b3-f857bfa9cc60 tempest-ProjectReaderTests-1337840947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:41:07 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-8380f3d4-4daf-4338-96b3-f857bfa9cc60 tempest-ProjectReaderTests-1337840947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:41:07 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-8380f3d4-4daf-4338-96b3-f857bfa9cc60 tempest-ProjectReaderTests-1337840947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:41:07 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-8380f3d4-4daf-4338-96b3-f857bfa9cc60 tempest-ProjectReaderTests-1337840947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:41:07 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-8380f3d4-4daf-4338-96b3-f857bfa9cc60 tempest-ProjectReaderTests-1337840947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:41:07 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-8380f3d4-4daf-4338-96b3-f857bfa9cc60 tempest-ProjectReaderTests-1337840947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:07 devstack sudo[107481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:41:07 devstack sudo[107481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:07 devstack sudo[107479]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:07 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b5e5df00-a00f-4aaa-9bdb-7c3c22df1da1 tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c9b0c11c-e13b-4e8b-9911-675f31019385.info" returned: 0 in 0.254s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:07 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-b5e5df00-a00f-4aaa-9bdb-7c3c22df1da1 tempest-ProjectMemberTests-186690331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.244s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:41:07 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-46a641a2-9377-47c9-9d3f-9cd1a4c67c2a tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.428s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:41:07 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-46a641a2-9377-47c9-9d3f-9cd1a4c67c2a tempest-CreateVolumesFromSourceVolumeTest-808023791 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:41:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1902161896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d75811e9-ba45-4ee3-a480-1e931bd988bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='835910649f2f4c438b6bfc6df82fc4bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:41:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:41:06Z,use_quota=True,user_id='4fccccf4a9d0435a92f4fae7d0ae6216',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:41:07 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-46a641a2-9377-47c9-9d3f-9cd1a4c67c2a tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Creating volume d75811e9-ba45-4ee3-a480-1e931bd988bb {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:41:07 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-46a641a2-9377-47c9-9d3f-9cd1a4c67c2a tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:41:07 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-46a641a2-9377-47c9-9d3f-9cd1a4c67c2a tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:41:07 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-46a641a2-9377-47c9-9d3f-9cd1a4c67c2a tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:41:07 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-46a641a2-9377-47c9-9d3f-9cd1a4c67c2a tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:41:07 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-46a641a2-9377-47c9-9d3f-9cd1a4c67c2a tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:41:07 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-46a641a2-9377-47c9-9d3f-9cd1a4c67c2a tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:41:07 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-46a641a2-9377-47c9-9d3f-9cd1a4c67c2a tempest-CreateVolumesFromSourceVolumeTest-808023791 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:41:07 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-46a641a2-9377-47c9-9d3f-9cd1a4c67c2a tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d75811e9-ba45-4ee3-a480-1e931bd988bb 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:07 devstack sudo[107484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d75811e9-ba45-4ee3-a480-1e931bd988bb 1073741824 Sep 28 09:41:07 devstack sudo[107484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:07 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-b5e5df00-a00f-4aaa-9bdb-7c3c22df1da1 tempest-ProjectMemberTests-186690331 None] Create snapshot completed successfully Sep 28 09:41:07 devstack sudo[107481]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:07 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-8380f3d4-4daf-4338-96b3-f857bfa9cc60 tempest-ProjectReaderTests-1337840947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.276s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:07 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-8380f3d4-4daf-4338-96b3-f857bfa9cc60 tempest-ProjectReaderTests-1337840947 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:41:07 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-8380f3d4-4daf-4338-96b3-f857bfa9cc60 tempest-ProjectReaderTests-1337840947 None] Deleted volume successfully. Sep 28 09:41:07 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-8380f3d4-4daf-4338-96b3-f857bfa9cc60 tempest-ProjectReaderTests-1337840947 None] Lock "cinder-c0c11ba1-6f5d-4795-9978-39248d8afe9a-delete_volume" released by "delete_volume" :: held 1.185s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:41:07 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-f50c8937-49b0-4d84-857f-88900cbb9708 tempest-ProjectMemberTests-186690331 None] Acquiring lock "cinder-b1dbc504-c408-4b89-b441-119457d4392f-delete_snapshot" by "delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:41:07 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-f50c8937-49b0-4d84-857f-88900cbb9708 tempest-ProjectMemberTests-186690331 None] Lock "cinder-b1dbc504-c408-4b89-b441-119457d4392f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:41:07 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-f50c8937-49b0-4d84-857f-88900cbb9708 tempest-ProjectMemberTests-186690331 None] Acquiring lock "cinder-quobyte-c9b0c11c-e13b-4e8b-9911-675f31019385" by "delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:41:07 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-f50c8937-49b0-4d84-857f-88900cbb9708 tempest-ProjectMemberTests-186690331 None] Lock "cinder-quobyte-c9b0c11c-e13b-4e8b-9911-675f31019385" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:41:07 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-f50c8937-49b0-4d84-857f-88900cbb9708 tempest-ProjectMemberTests-186690331 None] Acquiring lock "cinder-quobyte-b1dbc504-c408-4b89-b441-119457d4392f" by "_delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:41:07 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-f50c8937-49b0-4d84-857f-88900cbb9708 tempest-ProjectMemberTests-186690331 None] Lock "cinder-quobyte-b1dbc504-c408-4b89-b441-119457d4392f" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:41:07 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-f50c8937-49b0-4d84-857f-88900cbb9708 tempest-ProjectMemberTests-186690331 None] Deleting offline snapshot b1dbc504-c408-4b89-b441-119457d4392f of volume c9b0c11c-e13b-4e8b-9911-675f31019385 {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 09:41:07 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-f50c8937-49b0-4d84-857f-88900cbb9708 tempest-ProjectMemberTests-186690331 None] snapshot_file for this snap is: volume-c9b0c11c-e13b-4e8b-9911-675f31019385.b1dbc504-c408-4b89-b441-119457d4392f {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 09:41:07 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[c10ff39e-f0ec-4c34-a397-7f13a51f613b]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:41:07 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f50c8937-49b0-4d84-857f-88900cbb9708 tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c9b0c11c-e13b-4e8b-9911-675f31019385.b1dbc504-c408-4b89-b441-119457d4392f {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:07 devstack sudo[107484]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:07 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-46a641a2-9377-47c9-9d3f-9cd1a4c67c2a tempest-CreateVolumesFromSourceVolumeTest-808023791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d75811e9-ba45-4ee3-a480-1e931bd988bb 1073741824" returned: 0 in 0.587s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:07 devstack cinder-volume[86553]: DEBUG dbcounter [-] [86553] Writing DB stats cinder:SELECT=217,cinder:UPDATE=295,cinder:INSERT=73,cinder:DELETE=20 {{(pid=86553) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 09:41:07 devstack sudo[107491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c9b0c11c-e13b-4e8b-9911-675f31019385.b1dbc504-c408-4b89-b441-119457d4392f Sep 28 09:41:07 devstack sudo[107491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:07 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-46a641a2-9377-47c9-9d3f-9cd1a4c67c2a tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d75811e9-ba45-4ee3-a480-1e931bd988bb {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:07 devstack sudo[107493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d75811e9-ba45-4ee3-a480-1e931bd988bb Sep 28 09:41:07 devstack sudo[107493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:07 devstack cinder-volume[86553]: DEBUG dbcounter [-] [86553] Writing DB stats cinder:UPDATE=269,cinder:SELECT=219,cinder:DELETE=30,cinder:INSERT=84 {{(pid=86553) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 09:41:07 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-c451f51a-6eb2-4e28-903c-fb376285a900 tempest-ProjectReaderTests-1337840947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:41:08 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-c451f51a-6eb2-4e28-903c-fb376285a900 tempest-ProjectReaderTests-1337840947 None] Flow 'volume_create_manager' (325bb131-086a-4c0b-bc9c-88697049c918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:41:08 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-c451f51a-6eb2-4e28-903c-fb376285a900 tempest-ProjectReaderTests-1337840947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51f4f4fe-d198-42bf-afa9-14b38bcb4737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:08 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-c451f51a-6eb2-4e28-903c-fb376285a900 tempest-ProjectReaderTests-1337840947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51f4f4fe-d198-42bf-afa9-14b38bcb4737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:41:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1846975032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=939d1858-e327-4263-ae37-cea08c45af8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fae6883da88d4555ae0bbd24a1c9b251',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:41:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:41:08Z,use_quota=True,user_id='1daf865517454e75896cd4d9e1c08cc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:08 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-c451f51a-6eb2-4e28-903c-fb376285a900 tempest-ProjectReaderTests-1337840947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (142c40f7-62c2-4cfb-a0de-4a344085ae22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:08 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-c451f51a-6eb2-4e28-903c-fb376285a900 tempest-ProjectReaderTests-1337840947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (142c40f7-62c2-4cfb-a0de-4a344085ae22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:08 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-c451f51a-6eb2-4e28-903c-fb376285a900 tempest-ProjectReaderTests-1337840947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e8805a0-95de-4e8d-ac3f-f7011a6a0b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:08 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-c451f51a-6eb2-4e28-903c-fb376285a900 tempest-ProjectReaderTests-1337840947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e8805a0-95de-4e8d-ac3f-f7011a6a0b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '939d1858-e327-4263-ae37-cea08c45af8b', 'volume_name': 'volume-939d1858-e327-4263-ae37-cea08c45af8b', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:08 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-c451f51a-6eb2-4e28-903c-fb376285a900 tempest-ProjectReaderTests-1337840947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01228959-3410-43c6-9bbc-47b080848db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:08 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-c451f51a-6eb2-4e28-903c-fb376285a900 tempest-ProjectReaderTests-1337840947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01228959-3410-43c6-9bbc-47b080848db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:08 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-c451f51a-6eb2-4e28-903c-fb376285a900 tempest-ProjectReaderTests-1337840947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46c19477-66ef-4074-b208-88dd95e6b1aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:08 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-c451f51a-6eb2-4e28-903c-fb376285a900 tempest-ProjectReaderTests-1337840947 None] Volume 939d1858-e327-4263-ae37-cea08c45af8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-939d1858-e327-4263-ae37-cea08c45af8b', 'volume_size': 1} Sep 28 09:41:08 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-c451f51a-6eb2-4e28-903c-fb376285a900 tempest-ProjectReaderTests-1337840947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:41:08 devstack sudo[107493]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:08 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-46a641a2-9377-47c9-9d3f-9cd1a4c67c2a tempest-CreateVolumesFromSourceVolumeTest-808023791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d75811e9-ba45-4ee3-a480-1e931bd988bb" returned: 0 in 0.276s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:08 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-46a641a2-9377-47c9-9d3f-9cd1a4c67c2a tempest-CreateVolumesFromSourceVolumeTest-808023791 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:41:08 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-46a641a2-9377-47c9-9d3f-9cd1a4c67c2a tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:41:08 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-c451f51a-6eb2-4e28-903c-fb376285a900 tempest-ProjectReaderTests-1337840947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.042s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:41:08 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-c451f51a-6eb2-4e28-903c-fb376285a900 tempest-ProjectReaderTests-1337840947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:41:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1846975032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=939d1858-e327-4263-ae37-cea08c45af8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fae6883da88d4555ae0bbd24a1c9b251',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:41:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:41:08Z,use_quota=True,user_id='1daf865517454e75896cd4d9e1c08cc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:41:08 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-c451f51a-6eb2-4e28-903c-fb376285a900 tempest-ProjectReaderTests-1337840947 None] Creating volume 939d1858-e327-4263-ae37-cea08c45af8b {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:41:08 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-c451f51a-6eb2-4e28-903c-fb376285a900 tempest-ProjectReaderTests-1337840947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:41:08 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-c451f51a-6eb2-4e28-903c-fb376285a900 tempest-ProjectReaderTests-1337840947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:41:08 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-c451f51a-6eb2-4e28-903c-fb376285a900 tempest-ProjectReaderTests-1337840947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:41:08 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-c451f51a-6eb2-4e28-903c-fb376285a900 tempest-ProjectReaderTests-1337840947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:41:08 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-c451f51a-6eb2-4e28-903c-fb376285a900 tempest-ProjectReaderTests-1337840947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:41:08 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-c451f51a-6eb2-4e28-903c-fb376285a900 tempest-ProjectReaderTests-1337840947 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:41:08 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-c451f51a-6eb2-4e28-903c-fb376285a900 tempest-ProjectReaderTests-1337840947 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:41:08 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c451f51a-6eb2-4e28-903c-fb376285a900 tempest-ProjectReaderTests-1337840947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-939d1858-e327-4263-ae37-cea08c45af8b 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:08 devstack sudo[107491]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:08 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f50c8937-49b0-4d84-857f-88900cbb9708 tempest-ProjectMemberTests-186690331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c9b0c11c-e13b-4e8b-9911-675f31019385.b1dbc504-c408-4b89-b441-119457d4392f" returned: 0 in 0.443s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:08 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-f50c8937-49b0-4d84-857f-88900cbb9708 tempest-ProjectMemberTests-186690331 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c9b0c11c-e13b-4e8b-9911-675f31019385(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86553) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 09:41:08 devstack sudo[107500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-939d1858-e327-4263-ae37-cea08c45af8b 1073741824 Sep 28 09:41:08 devstack sudo[107500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:08 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-46a641a2-9377-47c9-9d3f-9cd1a4c67c2a tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20e2364e-3276-49ec-b3d5-6097b9c6cc5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d75811e9-ba45-4ee3-a480-1e931bd988bb', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:08 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-46a641a2-9377-47c9-9d3f-9cd1a4c67c2a tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e59a0944-102a-4fdc-957a-db314e1b7d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:08 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc2546c9-8c0b-4c01-ac87-0035948f76b2]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:41:08 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f50c8937-49b0-4d84-857f-88900cbb9708 tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c9b0c11c-e13b-4e8b-9911-675f31019385 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:08 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-46a641a2-9377-47c9-9d3f-9cd1a4c67c2a tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Volume volume-d75811e9-ba45-4ee3-a480-1e931bd988bb (d75811e9-ba45-4ee3-a480-1e931bd988bb): created successfully Sep 28 09:41:08 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-46a641a2-9377-47c9-9d3f-9cd1a4c67c2a tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e59a0944-102a-4fdc-957a-db314e1b7d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:08 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-46a641a2-9377-47c9-9d3f-9cd1a4c67c2a tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Flow 'volume_create_manager' (44c48ee8-53a1-4297-ada9-244bee3acaef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:41:08 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-46a641a2-9377-47c9-9d3f-9cd1a4c67c2a tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Created volume successfully. Sep 28 09:41:08 devstack sudo[107502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c9b0c11c-e13b-4e8b-9911-675f31019385 Sep 28 09:41:08 devstack sudo[107502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:08 devstack sudo[107500]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:08 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c451f51a-6eb2-4e28-903c-fb376285a900 tempest-ProjectReaderTests-1337840947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-939d1858-e327-4263-ae37-cea08c45af8b 1073741824" returned: 0 in 0.448s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:08 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c451f51a-6eb2-4e28-903c-fb376285a900 tempest-ProjectReaderTests-1337840947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-939d1858-e327-4263-ae37-cea08c45af8b {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:08 devstack sudo[107502]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:08 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f50c8937-49b0-4d84-857f-88900cbb9708 tempest-ProjectMemberTests-186690331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c9b0c11c-e13b-4e8b-9911-675f31019385" returned: 0 in 0.456s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:08 devstack sudo[107510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-939d1858-e327-4263-ae37-cea08c45af8b Sep 28 09:41:08 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f50c8937-49b0-4d84-857f-88900cbb9708 tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c9b0c11c-e13b-4e8b-9911-675f31019385.b1dbc504-c408-4b89-b441-119457d4392f {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:08 devstack sudo[107510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:08 devstack sudo[107512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c9b0c11c-e13b-4e8b-9911-675f31019385.b1dbc504-c408-4b89-b441-119457d4392f Sep 28 09:41:08 devstack sudo[107512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:08 devstack sudo[107510]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:08 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c451f51a-6eb2-4e28-903c-fb376285a900 tempest-ProjectReaderTests-1337840947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-939d1858-e327-4263-ae37-cea08c45af8b" returned: 0 in 0.291s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:08 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-c451f51a-6eb2-4e28-903c-fb376285a900 tempest-ProjectReaderTests-1337840947 None] <== create_volume: return (787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:41:08 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-c451f51a-6eb2-4e28-903c-fb376285a900 tempest-ProjectReaderTests-1337840947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:41:08 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-c451f51a-6eb2-4e28-903c-fb376285a900 tempest-ProjectReaderTests-1337840947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46c19477-66ef-4074-b208-88dd95e6b1aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-939d1858-e327-4263-ae37-cea08c45af8b', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:08 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-c451f51a-6eb2-4e28-903c-fb376285a900 tempest-ProjectReaderTests-1337840947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb756c1c-77ef-4267-a6f7-1fb78bfcd76b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:08 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-c451f51a-6eb2-4e28-903c-fb376285a900 tempest-ProjectReaderTests-1337840947 None] Volume volume-939d1858-e327-4263-ae37-cea08c45af8b (939d1858-e327-4263-ae37-cea08c45af8b): created successfully Sep 28 09:41:08 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-c451f51a-6eb2-4e28-903c-fb376285a900 tempest-ProjectReaderTests-1337840947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb756c1c-77ef-4267-a6f7-1fb78bfcd76b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:08 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-c451f51a-6eb2-4e28-903c-fb376285a900 tempest-ProjectReaderTests-1337840947 None] Flow 'volume_create_manager' (325bb131-086a-4c0b-bc9c-88697049c918) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:41:08 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-c451f51a-6eb2-4e28-903c-fb376285a900 tempest-ProjectReaderTests-1337840947 None] Created volume successfully. Sep 28 09:41:09 devstack sudo[107512]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f50c8937-49b0-4d84-857f-88900cbb9708 tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c9b0c11c-e13b-4e8b-9911-675f31019385.b1dbc504-c408-4b89-b441-119457d4392f" returned: 0 in 0.384s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f50c8937-49b0-4d84-857f-88900cbb9708 tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c9b0c11c-e13b-4e8b-9911-675f31019385.b1dbc504-c408-4b89-b441-119457d4392f {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:09 devstack sudo[107518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c9b0c11c-e13b-4e8b-9911-675f31019385.b1dbc504-c408-4b89-b441-119457d4392f Sep 28 09:41:09 devstack sudo[107518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:09 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-89b1d09f-dd03-4b1a-bbaf-9b12e16982a4 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:41:09 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-89b1d09f-dd03-4b1a-bbaf-9b12e16982a4 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Flow 'volume_create_manager' (a2a7f51e-226a-4da7-b891-cf2d4989ee56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:41:09 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-89b1d09f-dd03-4b1a-bbaf-9b12e16982a4 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecdad458-51aa-4c0a-9ec8-a3ed98351040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:09 devstack sudo[107518]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f50c8937-49b0-4d84-857f-88900cbb9708 tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c9b0c11c-e13b-4e8b-9911-675f31019385.b1dbc504-c408-4b89-b441-119457d4392f" returned: 0 in 0.302s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:09 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-89b1d09f-dd03-4b1a-bbaf-9b12e16982a4 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecdad458-51aa-4c0a-9ec8-a3ed98351040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:41:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2047396678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bee544f0-9235-432d-a1d3-385f9ce8d0d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='835910649f2f4c438b6bfc6df82fc4bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:41:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:41:09Z,use_quota=True,user_id='4fccccf4a9d0435a92f4fae7d0ae6216',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:09 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-89b1d09f-dd03-4b1a-bbaf-9b12e16982a4 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37d986cd-6354-4b6b-8aa5-4619c714540f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:09 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-89b1d09f-dd03-4b1a-bbaf-9b12e16982a4 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37d986cd-6354-4b6b-8aa5-4619c714540f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:09 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-89b1d09f-dd03-4b1a-bbaf-9b12e16982a4 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c32f1eed-0eff-4c22-88f7-a2347980dba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:09 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-89b1d09f-dd03-4b1a-bbaf-9b12e16982a4 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c32f1eed-0eff-4c22-88f7-a2347980dba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bee544f0-9235-432d-a1d3-385f9ce8d0d6', 'volume_name': 'volume-bee544f0-9235-432d-a1d3-385f9ce8d0d6', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:09 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-89b1d09f-dd03-4b1a-bbaf-9b12e16982a4 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ea7cfec-61b7-4b5d-8f82-18a4169dbdf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:09 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-89b1d09f-dd03-4b1a-bbaf-9b12e16982a4 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ea7cfec-61b7-4b5d-8f82-18a4169dbdf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:09 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-89b1d09f-dd03-4b1a-bbaf-9b12e16982a4 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44fc9385-2aa7-44cf-b37a-559161bbc224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:09 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-89b1d09f-dd03-4b1a-bbaf-9b12e16982a4 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Volume bee544f0-9235-432d-a1d3-385f9ce8d0d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bee544f0-9235-432d-a1d3-385f9ce8d0d6', 'volume_size': 1} Sep 28 09:41:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-89b1d09f-dd03-4b1a-bbaf-9b12e16982a4 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:41:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-89b1d09f-dd03-4b1a-bbaf-9b12e16982a4 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:41:09 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-89b1d09f-dd03-4b1a-bbaf-9b12e16982a4 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:41:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2047396678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bee544f0-9235-432d-a1d3-385f9ce8d0d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='835910649f2f4c438b6bfc6df82fc4bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:41:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:41:09Z,use_quota=True,user_id='4fccccf4a9d0435a92f4fae7d0ae6216',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:41:09 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-89b1d09f-dd03-4b1a-bbaf-9b12e16982a4 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Creating volume bee544f0-9235-432d-a1d3-385f9ce8d0d6 {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:41:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-89b1d09f-dd03-4b1a-bbaf-9b12e16982a4 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:41:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-89b1d09f-dd03-4b1a-bbaf-9b12e16982a4 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:41:09 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-89b1d09f-dd03-4b1a-bbaf-9b12e16982a4 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:41:09 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-89b1d09f-dd03-4b1a-bbaf-9b12e16982a4 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:41:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-89b1d09f-dd03-4b1a-bbaf-9b12e16982a4 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:41:09 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-89b1d09f-dd03-4b1a-bbaf-9b12e16982a4 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:41:09 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-89b1d09f-dd03-4b1a-bbaf-9b12e16982a4 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:41:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-89b1d09f-dd03-4b1a-bbaf-9b12e16982a4 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bee544f0-9235-432d-a1d3-385f9ce8d0d6 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:09 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-f50c8937-49b0-4d84-857f-88900cbb9708 tempest-ProjectMemberTests-186690331 None] Lock "cinder-quobyte-b1dbc504-c408-4b89-b441-119457d4392f" released by "_delete_snapshot" :: held 1.786s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:41:09 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-f50c8937-49b0-4d84-857f-88900cbb9708 tempest-ProjectMemberTests-186690331 None] Lock "cinder-quobyte-c9b0c11c-e13b-4e8b-9911-675f31019385" released by "delete_snapshot" :: held 1.820s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:41:09 devstack sudo[107521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bee544f0-9235-432d-a1d3-385f9ce8d0d6 1073741824 Sep 28 09:41:09 devstack sudo[107521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:09 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-f50c8937-49b0-4d84-857f-88900cbb9708 tempest-ProjectMemberTests-186690331 None] Created reservations ['113b645e-96f0-42c2-a10c-8bd8555fed16', '9ac1b683-afa6-4afa-84ae-8e2ac5b7694f', 'ad02de2c-18cf-4d68-9d54-224cf62ae26d', 'b547db9f-33b9-4cbb-b440-57e1a7275ac9'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:41:09 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-f50c8937-49b0-4d84-857f-88900cbb9708 tempest-ProjectMemberTests-186690331 None] Delete snapshot completed successfully. Sep 28 09:41:09 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-f50c8937-49b0-4d84-857f-88900cbb9708 tempest-ProjectMemberTests-186690331 None] Lock "cinder-b1dbc504-c408-4b89-b441-119457d4392f-delete_snapshot" released by "delete_snapshot" :: held 2.013s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:41:09 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4c1f213-6c47-4e79-803b-5d64183d4005 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:41:09 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-f4c1f213-6c47-4e79-803b-5d64183d4005 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Flow 'volume_create_manager' (049b91c1-dcd5-486f-b98f-490312112d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:41:09 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-f4c1f213-6c47-4e79-803b-5d64183d4005 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2b1859e-7d77-4d7c-b937-fd25117eff73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:09 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-f4c1f213-6c47-4e79-803b-5d64183d4005 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2b1859e-7d77-4d7c-b937-fd25117eff73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:41:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1810325134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c835f66a-713b-49cc-bc03-03add4577f14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='835910649f2f4c438b6bfc6df82fc4bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:41:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:41:10Z,use_quota=True,user_id='4fccccf4a9d0435a92f4fae7d0ae6216',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:09 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-f4c1f213-6c47-4e79-803b-5d64183d4005 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (252bc3a0-0f63-4fcb-bfe0-390e6d0ff0af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:09 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-f4c1f213-6c47-4e79-803b-5d64183d4005 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (252bc3a0-0f63-4fcb-bfe0-390e6d0ff0af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:09 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-f4c1f213-6c47-4e79-803b-5d64183d4005 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66860159-b5ed-4363-8d89-282fb6426af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:09 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-f4c1f213-6c47-4e79-803b-5d64183d4005 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66860159-b5ed-4363-8d89-282fb6426af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c835f66a-713b-49cc-bc03-03add4577f14', 'volume_name': 'volume-c835f66a-713b-49cc-bc03-03add4577f14', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:09 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-f4c1f213-6c47-4e79-803b-5d64183d4005 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83132fa5-334c-42c5-83ff-83ab8a41f1ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:09 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-f4c1f213-6c47-4e79-803b-5d64183d4005 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83132fa5-334c-42c5-83ff-83ab8a41f1ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:09 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-f4c1f213-6c47-4e79-803b-5d64183d4005 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7fa43e9-d907-4cec-a019-9dcd14b5be66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:09 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-f4c1f213-6c47-4e79-803b-5d64183d4005 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Volume c835f66a-713b-49cc-bc03-03add4577f14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c835f66a-713b-49cc-bc03-03add4577f14', 'volume_size': 1} Sep 28 09:41:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-f4c1f213-6c47-4e79-803b-5d64183d4005 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:41:09 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-ce9460da-7aec-4afc-88e7-c95467ea404d tempest-ProjectMemberTests-186690331 None] Acquiring lock "cinder-c9b0c11c-e13b-4e8b-9911-675f31019385-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:41:09 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-ce9460da-7aec-4afc-88e7-c95467ea404d tempest-ProjectMemberTests-186690331 None] Lock "cinder-c9b0c11c-e13b-4e8b-9911-675f31019385-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:41:09 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-ce9460da-7aec-4afc-88e7-c95467ea404d tempest-ProjectMemberTests-186690331 None] Acquiring lock "cinder-quobyte-c9b0c11c-e13b-4e8b-9911-675f31019385" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:41:09 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-ce9460da-7aec-4afc-88e7-c95467ea404d tempest-ProjectMemberTests-186690331 None] Lock "cinder-quobyte-c9b0c11c-e13b-4e8b-9911-675f31019385" acquired by "delete_volume" :: waited 0.016s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:41:09 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c15d986-01f4-426a-8d78-a652fdf55a2a]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:41:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ce9460da-7aec-4afc-88e7-c95467ea404d tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c9b0c11c-e13b-4e8b-9911-675f31019385 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:10 devstack sudo[107521]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-89b1d09f-dd03-4b1a-bbaf-9b12e16982a4 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bee544f0-9235-432d-a1d3-385f9ce8d0d6 1073741824" returned: 0 in 0.609s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-89b1d09f-dd03-4b1a-bbaf-9b12e16982a4 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bee544f0-9235-432d-a1d3-385f9ce8d0d6 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:10 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-5a9f27ea-7706-487b-9de3-0c5d419f59e2 tempest-ProjectReaderTests-1337840947 None] Acquiring lock "cinder-939d1858-e327-4263-ae37-cea08c45af8b-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:41:10 devstack sudo[107528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bee544f0-9235-432d-a1d3-385f9ce8d0d6 Sep 28 09:41:10 devstack sudo[107528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:10 devstack sudo[107527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c9b0c11c-e13b-4e8b-9911-675f31019385 Sep 28 09:41:10 devstack sudo[107527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:10 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-5a9f27ea-7706-487b-9de3-0c5d419f59e2 tempest-ProjectReaderTests-1337840947 None] Lock "cinder-939d1858-e327-4263-ae37-cea08c45af8b-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:41:10 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-537ee9a0-ea3c-423d-940b-39c2228ed038 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:41:10 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-537ee9a0-ea3c-423d-940b-39c2228ed038 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Flow 'volume_create_manager' (3fe2c05c-c508-427a-9486-b9705f20a043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:41:10 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-537ee9a0-ea3c-423d-940b-39c2228ed038 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e384e38-5f28-4926-823c-c86625b5929f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:10 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-537ee9a0-ea3c-423d-940b-39c2228ed038 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e384e38-5f28-4926-823c-c86625b5929f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:41:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-76042016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0822327c-a26b-4bed-ab97-095e1a05dd02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='835910649f2f4c438b6bfc6df82fc4bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:41:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:41:10Z,use_quota=True,user_id='4fccccf4a9d0435a92f4fae7d0ae6216',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:10 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-537ee9a0-ea3c-423d-940b-39c2228ed038 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9f823ac-7575-4010-8866-dc4533129f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:10 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-537ee9a0-ea3c-423d-940b-39c2228ed038 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9f823ac-7575-4010-8866-dc4533129f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:10 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-537ee9a0-ea3c-423d-940b-39c2228ed038 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (213c257d-d762-431e-af57-d9e5410ecee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:10 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-537ee9a0-ea3c-423d-940b-39c2228ed038 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (213c257d-d762-431e-af57-d9e5410ecee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0822327c-a26b-4bed-ab97-095e1a05dd02', 'volume_name': 'volume-0822327c-a26b-4bed-ab97-095e1a05dd02', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:10 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-537ee9a0-ea3c-423d-940b-39c2228ed038 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (050b3d3c-3a9b-4a99-9edc-35ce06f690af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:10 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-537ee9a0-ea3c-423d-940b-39c2228ed038 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (050b3d3c-3a9b-4a99-9edc-35ce06f690af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:10 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-537ee9a0-ea3c-423d-940b-39c2228ed038 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59307d2b-106f-400e-a3da-593264e523eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:10 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-537ee9a0-ea3c-423d-940b-39c2228ed038 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Volume 0822327c-a26b-4bed-ab97-095e1a05dd02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0822327c-a26b-4bed-ab97-095e1a05dd02', 'volume_size': 1} Sep 28 09:41:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-537ee9a0-ea3c-423d-940b-39c2228ed038 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:41:10 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-5a9f27ea-7706-487b-9de3-0c5d419f59e2 tempest-ProjectReaderTests-1337840947 None] Acquiring lock "cinder-quobyte-939d1858-e327-4263-ae37-cea08c45af8b" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:41:10 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-5a9f27ea-7706-487b-9de3-0c5d419f59e2 tempest-ProjectReaderTests-1337840947 None] Lock "cinder-quobyte-939d1858-e327-4263-ae37-cea08c45af8b" acquired by "delete_volume" :: waited 0.021s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:41:10 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e65951-b72f-40ea-bf9d-a0963fe43270]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:41:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-5a9f27ea-7706-487b-9de3-0c5d419f59e2 tempest-ProjectReaderTests-1337840947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-939d1858-e327-4263-ae37-cea08c45af8b {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:10 devstack sudo[107528]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-89b1d09f-dd03-4b1a-bbaf-9b12e16982a4 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bee544f0-9235-432d-a1d3-385f9ce8d0d6" returned: 0 in 0.408s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:10 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-89b1d09f-dd03-4b1a-bbaf-9b12e16982a4 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:41:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-89b1d09f-dd03-4b1a-bbaf-9b12e16982a4 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:41:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-f4c1f213-6c47-4e79-803b-5d64183d4005 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.695s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:41:10 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-f4c1f213-6c47-4e79-803b-5d64183d4005 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:41:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1810325134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c835f66a-713b-49cc-bc03-03add4577f14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='835910649f2f4c438b6bfc6df82fc4bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:41:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:41:10Z,use_quota=True,user_id='4fccccf4a9d0435a92f4fae7d0ae6216',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:41:10 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-f4c1f213-6c47-4e79-803b-5d64183d4005 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Creating volume c835f66a-713b-49cc-bc03-03add4577f14 {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:41:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-f4c1f213-6c47-4e79-803b-5d64183d4005 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:41:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-f4c1f213-6c47-4e79-803b-5d64183d4005 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:41:10 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-f4c1f213-6c47-4e79-803b-5d64183d4005 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:41:10 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-f4c1f213-6c47-4e79-803b-5d64183d4005 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:41:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-f4c1f213-6c47-4e79-803b-5d64183d4005 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:41:10 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-f4c1f213-6c47-4e79-803b-5d64183d4005 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:41:10 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-f4c1f213-6c47-4e79-803b-5d64183d4005 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:41:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f4c1f213-6c47-4e79-803b-5d64183d4005 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c835f66a-713b-49cc-bc03-03add4577f14 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:10 devstack sudo[107531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-939d1858-e327-4263-ae37-cea08c45af8b Sep 28 09:41:10 devstack sudo[107531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:10 devstack sudo[107527]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:10 devstack sudo[107536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c835f66a-713b-49cc-bc03-03add4577f14 1073741824 Sep 28 09:41:10 devstack sudo[107536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:10 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-89b1d09f-dd03-4b1a-bbaf-9b12e16982a4 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44fc9385-2aa7-44cf-b37a-559161bbc224) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bee544f0-9235-432d-a1d3-385f9ce8d0d6', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:10 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-89b1d09f-dd03-4b1a-bbaf-9b12e16982a4 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d2b880d-24ce-42fa-aac8-e5c7bb5e65bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ce9460da-7aec-4afc-88e7-c95467ea404d tempest-ProjectMemberTests-186690331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c9b0c11c-e13b-4e8b-9911-675f31019385" returned: 0 in 0.648s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ce9460da-7aec-4afc-88e7-c95467ea404d tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c9b0c11c-e13b-4e8b-9911-675f31019385 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:10 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-89b1d09f-dd03-4b1a-bbaf-9b12e16982a4 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Volume volume-bee544f0-9235-432d-a1d3-385f9ce8d0d6 (bee544f0-9235-432d-a1d3-385f9ce8d0d6): created successfully Sep 28 09:41:10 devstack sudo[107539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c9b0c11c-e13b-4e8b-9911-675f31019385 Sep 28 09:41:10 devstack sudo[107539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:10 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-89b1d09f-dd03-4b1a-bbaf-9b12e16982a4 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d2b880d-24ce-42fa-aac8-e5c7bb5e65bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:10 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-89b1d09f-dd03-4b1a-bbaf-9b12e16982a4 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Flow 'volume_create_manager' (a2a7f51e-226a-4da7-b891-cf2d4989ee56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:41:10 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-89b1d09f-dd03-4b1a-bbaf-9b12e16982a4 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Created volume successfully. Sep 28 09:41:10 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-a875d731-26b9-4a7a-a1dc-07f252b5d964 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:41:10 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-a875d731-26b9-4a7a-a1dc-07f252b5d964 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Flow 'volume_create_manager' (aa9b7b3b-d714-479a-83e6-3b29d3ab7a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:41:10 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-a875d731-26b9-4a7a-a1dc-07f252b5d964 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a154ff07-d8c6-4c70-9179-efa599c8ed87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:10 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-a875d731-26b9-4a7a-a1dc-07f252b5d964 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a154ff07-d8c6-4c70-9179-efa599c8ed87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:41:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1179928910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54b14caa-9a18-4cf3-9fea-a1a4d498ee7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='835910649f2f4c438b6bfc6df82fc4bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:41:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:41:11Z,use_quota=True,user_id='4fccccf4a9d0435a92f4fae7d0ae6216',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:10 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-a875d731-26b9-4a7a-a1dc-07f252b5d964 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ac456cd-26e3-4fd1-8e44-bb375c25e2a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:10 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-a875d731-26b9-4a7a-a1dc-07f252b5d964 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ac456cd-26e3-4fd1-8e44-bb375c25e2a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:10 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-a875d731-26b9-4a7a-a1dc-07f252b5d964 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f0d8fb9-0c66-4ebd-94b4-822e5894fd59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:10 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-a875d731-26b9-4a7a-a1dc-07f252b5d964 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f0d8fb9-0c66-4ebd-94b4-822e5894fd59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54b14caa-9a18-4cf3-9fea-a1a4d498ee7b', 'volume_name': 'volume-54b14caa-9a18-4cf3-9fea-a1a4d498ee7b', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:10 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-a875d731-26b9-4a7a-a1dc-07f252b5d964 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16feafa0-fe24-4754-bfb2-8446cc90594a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:10 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-a875d731-26b9-4a7a-a1dc-07f252b5d964 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16feafa0-fe24-4754-bfb2-8446cc90594a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:10 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-a875d731-26b9-4a7a-a1dc-07f252b5d964 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad2d1c50-8656-4586-999f-60e421acf49e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:10 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-a875d731-26b9-4a7a-a1dc-07f252b5d964 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Volume 54b14caa-9a18-4cf3-9fea-a1a4d498ee7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54b14caa-9a18-4cf3-9fea-a1a4d498ee7b', 'volume_size': 1} Sep 28 09:41:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-a875d731-26b9-4a7a-a1dc-07f252b5d964 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:41:10 devstack sudo[107531]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-5a9f27ea-7706-487b-9de3-0c5d419f59e2 tempest-ProjectReaderTests-1337840947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-939d1858-e327-4263-ae37-cea08c45af8b" returned: 0 in 0.542s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-5a9f27ea-7706-487b-9de3-0c5d419f59e2 tempest-ProjectReaderTests-1337840947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-939d1858-e327-4263-ae37-cea08c45af8b {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:10 devstack sudo[107539]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ce9460da-7aec-4afc-88e7-c95467ea404d tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c9b0c11c-e13b-4e8b-9911-675f31019385" returned: 0 in 0.377s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:10 devstack sudo[107548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-939d1858-e327-4263-ae37-cea08c45af8b Sep 28 09:41:11 devstack sudo[107548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:11 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-ce9460da-7aec-4afc-88e7-c95467ea404d tempest-ProjectMemberTests-186690331 None] Lock "cinder-quobyte-c9b0c11c-e13b-4e8b-9911-675f31019385" released by "delete_volume" :: held 1.115s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:41:11 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-ce9460da-7aec-4afc-88e7-c95467ea404d tempest-ProjectMemberTests-186690331 None] Created reservations ['8fcf7eb2-7c7b-4ac2-a74d-6fc01c1eba27', '38be65a8-1ec9-4a7f-9b2c-a91f0d6b2fd6', '79b24bdc-b24a-4a87-83f2-55f369f20162', 'f5e9dc8a-2542-4887-8a71-714f549a6a6f'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:41:11 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-85e3eeac-c921-407e-8255-39d195c553ab tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:41:11 devstack sudo[107536]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:11 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-85e3eeac-c921-407e-8255-39d195c553ab tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Flow 'volume_create_manager' (785f30a2-dec4-4591-bfc5-294d33e2aace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:41:11 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-85e3eeac-c921-407e-8255-39d195c553ab tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3afe5f61-27ab-4057-a31d-4295ea1a680f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:11 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f4c1f213-6c47-4e79-803b-5d64183d4005 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c835f66a-713b-49cc-bc03-03add4577f14 1073741824" returned: 0 in 0.714s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:11 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-85e3eeac-c921-407e-8255-39d195c553ab tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3afe5f61-27ab-4057-a31d-4295ea1a680f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:41:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-317886491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d78d7fb4-de51-40d8-8dd6-e4f1d3c97751,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='835910649f2f4c438b6bfc6df82fc4bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:41:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:41:11Z,use_quota=True,user_id='4fccccf4a9d0435a92f4fae7d0ae6216',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:11 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-85e3eeac-c921-407e-8255-39d195c553ab tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9628ca2f-7449-46c2-8960-f4d711643006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:11 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-85e3eeac-c921-407e-8255-39d195c553ab tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9628ca2f-7449-46c2-8960-f4d711643006) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:11 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-85e3eeac-c921-407e-8255-39d195c553ab tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d90a0288-ad7b-4fbd-9d58-9071de200dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:11 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-85e3eeac-c921-407e-8255-39d195c553ab tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d90a0288-ad7b-4fbd-9d58-9071de200dbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd78d7fb4-de51-40d8-8dd6-e4f1d3c97751', 'volume_name': 'volume-d78d7fb4-de51-40d8-8dd6-e4f1d3c97751', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:11 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-85e3eeac-c921-407e-8255-39d195c553ab tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be828939-25d4-457e-a23e-58310222cc06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:11 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-85e3eeac-c921-407e-8255-39d195c553ab tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be828939-25d4-457e-a23e-58310222cc06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:11 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-85e3eeac-c921-407e-8255-39d195c553ab tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7ecb84d-1d30-4f7e-8745-11fb1ca9b9c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:11 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-85e3eeac-c921-407e-8255-39d195c553ab tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Volume d78d7fb4-de51-40d8-8dd6-e4f1d3c97751: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d78d7fb4-de51-40d8-8dd6-e4f1d3c97751', 'volume_size': 1} Sep 28 09:41:11 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-85e3eeac-c921-407e-8255-39d195c553ab tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:41:11 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ce9460da-7aec-4afc-88e7-c95467ea404d tempest-ProjectMemberTests-186690331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:41:11 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ce9460da-7aec-4afc-88e7-c95467ea404d tempest-ProjectMemberTests-186690331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:41:11 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ce9460da-7aec-4afc-88e7-c95467ea404d tempest-ProjectMemberTests-186690331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:41:11 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ce9460da-7aec-4afc-88e7-c95467ea404d tempest-ProjectMemberTests-186690331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:41:11 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ce9460da-7aec-4afc-88e7-c95467ea404d tempest-ProjectMemberTests-186690331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:41:11 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ce9460da-7aec-4afc-88e7-c95467ea404d tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:11 devstack sudo[107548]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:11 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-5a9f27ea-7706-487b-9de3-0c5d419f59e2 tempest-ProjectReaderTests-1337840947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-939d1858-e327-4263-ae37-cea08c45af8b" returned: 0 in 0.373s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:11 devstack sudo[107552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:41:11 devstack sudo[107552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:11 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-5a9f27ea-7706-487b-9de3-0c5d419f59e2 tempest-ProjectReaderTests-1337840947 None] Lock "cinder-quobyte-939d1858-e327-4263-ae37-cea08c45af8b" released by "delete_volume" :: held 0.991s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:41:11 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f4c1f213-6c47-4e79-803b-5d64183d4005 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c835f66a-713b-49cc-bc03-03add4577f14 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:11 devstack sudo[107554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c835f66a-713b-49cc-bc03-03add4577f14 Sep 28 09:41:11 devstack sudo[107554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:11 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-5a9f27ea-7706-487b-9de3-0c5d419f59e2 tempest-ProjectReaderTests-1337840947 None] Created reservations ['32a48f72-5c46-4490-a5a4-3c1dfe752e52', '82e0cf0f-432f-4c36-9bc2-0e444c6b358d', 'f90e6b49-3733-48e6-9360-0213e45302a9', 'c43df63e-067a-46c8-b23c-8adfaa76924b'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:41:11 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-5a9f27ea-7706-487b-9de3-0c5d419f59e2 tempest-ProjectReaderTests-1337840947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:41:11 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-5a9f27ea-7706-487b-9de3-0c5d419f59e2 tempest-ProjectReaderTests-1337840947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:41:11 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-5a9f27ea-7706-487b-9de3-0c5d419f59e2 tempest-ProjectReaderTests-1337840947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:41:11 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-5a9f27ea-7706-487b-9de3-0c5d419f59e2 tempest-ProjectReaderTests-1337840947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:41:11 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-5a9f27ea-7706-487b-9de3-0c5d419f59e2 tempest-ProjectReaderTests-1337840947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:41:11 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-5a9f27ea-7706-487b-9de3-0c5d419f59e2 tempest-ProjectReaderTests-1337840947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:11 devstack sudo[107556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:41:11 devstack sudo[107556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:11 devstack sudo[107552]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:11 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ce9460da-7aec-4afc-88e7-c95467ea404d tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.268s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:11 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-ce9460da-7aec-4afc-88e7-c95467ea404d tempest-ProjectMemberTests-186690331 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:41:11 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-ce9460da-7aec-4afc-88e7-c95467ea404d tempest-ProjectMemberTests-186690331 None] Deleted volume successfully. Sep 28 09:41:11 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-ce9460da-7aec-4afc-88e7-c95467ea404d tempest-ProjectMemberTests-186690331 None] Lock "cinder-c9b0c11c-e13b-4e8b-9911-675f31019385-delete_volume" released by "delete_volume" :: held 1.766s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:41:11 devstack sudo[107554]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:11 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f4c1f213-6c47-4e79-803b-5d64183d4005 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c835f66a-713b-49cc-bc03-03add4577f14" returned: 0 in 0.274s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:11 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-f4c1f213-6c47-4e79-803b-5d64183d4005 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] <== create_volume: return (1116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:41:11 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-f4c1f213-6c47-4e79-803b-5d64183d4005 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.120s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:41:11 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-537ee9a0-ea3c-423d-940b-39c2228ed038 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.319s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:41:11 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-537ee9a0-ea3c-423d-940b-39c2228ed038 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:41:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-76042016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0822327c-a26b-4bed-ab97-095e1a05dd02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='835910649f2f4c438b6bfc6df82fc4bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:41:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:41:10Z,use_quota=True,user_id='4fccccf4a9d0435a92f4fae7d0ae6216',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:41:11 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-537ee9a0-ea3c-423d-940b-39c2228ed038 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Creating volume 0822327c-a26b-4bed-ab97-095e1a05dd02 {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:41:11 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-537ee9a0-ea3c-423d-940b-39c2228ed038 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:41:11 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-537ee9a0-ea3c-423d-940b-39c2228ed038 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:41:11 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-537ee9a0-ea3c-423d-940b-39c2228ed038 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:41:11 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-537ee9a0-ea3c-423d-940b-39c2228ed038 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:41:11 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-537ee9a0-ea3c-423d-940b-39c2228ed038 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:41:11 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-537ee9a0-ea3c-423d-940b-39c2228ed038 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:41:11 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-537ee9a0-ea3c-423d-940b-39c2228ed038 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:41:11 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-537ee9a0-ea3c-423d-940b-39c2228ed038 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-0822327c-a26b-4bed-ab97-095e1a05dd02 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:11 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-f4c1f213-6c47-4e79-803b-5d64183d4005 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7fa43e9-d907-4cec-a019-9dcd14b5be66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c835f66a-713b-49cc-bc03-03add4577f14', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:11 devstack sudo[107560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-0822327c-a26b-4bed-ab97-095e1a05dd02 1073741824 Sep 28 09:41:11 devstack sudo[107560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:11 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-f4c1f213-6c47-4e79-803b-5d64183d4005 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dfeb7e6-c30c-450d-a0d1-7874cfc7cf36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:11 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-f4c1f213-6c47-4e79-803b-5d64183d4005 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Volume volume-c835f66a-713b-49cc-bc03-03add4577f14 (c835f66a-713b-49cc-bc03-03add4577f14): created successfully Sep 28 09:41:11 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-f4c1f213-6c47-4e79-803b-5d64183d4005 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dfeb7e6-c30c-450d-a0d1-7874cfc7cf36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:11 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-f4c1f213-6c47-4e79-803b-5d64183d4005 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Flow 'volume_create_manager' (049b91c1-dcd5-486f-b98f-490312112d84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:41:11 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-f4c1f213-6c47-4e79-803b-5d64183d4005 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Created volume successfully. Sep 28 09:41:11 devstack sudo[107556]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:11 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-5a9f27ea-7706-487b-9de3-0c5d419f59e2 tempest-ProjectReaderTests-1337840947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.283s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:11 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-5a9f27ea-7706-487b-9de3-0c5d419f59e2 tempest-ProjectReaderTests-1337840947 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:41:11 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-5a9f27ea-7706-487b-9de3-0c5d419f59e2 tempest-ProjectReaderTests-1337840947 None] Deleted volume successfully. Sep 28 09:41:11 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-5a9f27ea-7706-487b-9de3-0c5d419f59e2 tempest-ProjectReaderTests-1337840947 None] Lock "cinder-939d1858-e327-4263-ae37-cea08c45af8b-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:41:12 devstack sudo[107560]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:12 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-537ee9a0-ea3c-423d-940b-39c2228ed038 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-0822327c-a26b-4bed-ab97-095e1a05dd02 1073741824" returned: 0 in 0.453s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:12 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-537ee9a0-ea3c-423d-940b-39c2228ed038 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-0822327c-a26b-4bed-ab97-095e1a05dd02 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:12 devstack sudo[107567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-0822327c-a26b-4bed-ab97-095e1a05dd02 Sep 28 09:41:12 devstack sudo[107567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:12 devstack sudo[107567]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:12 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-537ee9a0-ea3c-423d-940b-39c2228ed038 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-0822327c-a26b-4bed-ab97-095e1a05dd02" returned: 0 in 0.306s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:12 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-537ee9a0-ea3c-423d-940b-39c2228ed038 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] <== create_volume: return (801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:41:12 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-537ee9a0-ea3c-423d-940b-39c2228ed038 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:41:12 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-a875d731-26b9-4a7a-a1dc-07f252b5d964 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.562s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:41:12 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-a875d731-26b9-4a7a-a1dc-07f252b5d964 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:41:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1179928910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54b14caa-9a18-4cf3-9fea-a1a4d498ee7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='835910649f2f4c438b6bfc6df82fc4bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:41:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:41:11Z,use_quota=True,user_id='4fccccf4a9d0435a92f4fae7d0ae6216',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:41:12 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-a875d731-26b9-4a7a-a1dc-07f252b5d964 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Creating volume 54b14caa-9a18-4cf3-9fea-a1a4d498ee7b {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:41:12 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-a875d731-26b9-4a7a-a1dc-07f252b5d964 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:41:12 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-a875d731-26b9-4a7a-a1dc-07f252b5d964 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:41:12 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-a875d731-26b9-4a7a-a1dc-07f252b5d964 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:41:12 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-a875d731-26b9-4a7a-a1dc-07f252b5d964 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:41:12 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-a875d731-26b9-4a7a-a1dc-07f252b5d964 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:41:12 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-a875d731-26b9-4a7a-a1dc-07f252b5d964 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:41:12 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-a875d731-26b9-4a7a-a1dc-07f252b5d964 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:41:12 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a875d731-26b9-4a7a-a1dc-07f252b5d964 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-54b14caa-9a18-4cf3-9fea-a1a4d498ee7b 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:12 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-537ee9a0-ea3c-423d-940b-39c2228ed038 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59307d2b-106f-400e-a3da-593264e523eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0822327c-a26b-4bed-ab97-095e1a05dd02', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:12 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-537ee9a0-ea3c-423d-940b-39c2228ed038 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (817245b4-094d-402b-bd0d-521e3a463f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:12 devstack sudo[107570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-54b14caa-9a18-4cf3-9fea-a1a4d498ee7b 1073741824 Sep 28 09:41:12 devstack sudo[107570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:12 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-537ee9a0-ea3c-423d-940b-39c2228ed038 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Volume volume-0822327c-a26b-4bed-ab97-095e1a05dd02 (0822327c-a26b-4bed-ab97-095e1a05dd02): created successfully Sep 28 09:41:12 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-537ee9a0-ea3c-423d-940b-39c2228ed038 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (817245b4-094d-402b-bd0d-521e3a463f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:12 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-537ee9a0-ea3c-423d-940b-39c2228ed038 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Flow 'volume_create_manager' (3fe2c05c-c508-427a-9486-b9705f20a043) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:41:12 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-537ee9a0-ea3c-423d-940b-39c2228ed038 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Created volume successfully. Sep 28 09:41:12 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-33da7a5c-7f30-4e5c-b35b-8de1991bc79c tempest-ProjectMemberTests-186690331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:41:12 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-33da7a5c-7f30-4e5c-b35b-8de1991bc79c tempest-ProjectMemberTests-186690331 None] Flow 'volume_create_manager' (fadcf696-003f-4b58-ad8e-49b4995fa564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:41:12 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-33da7a5c-7f30-4e5c-b35b-8de1991bc79c tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1051b989-1556-4258-bd71-d8227e901b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:12 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-33da7a5c-7f30-4e5c-b35b-8de1991bc79c tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1051b989-1556-4258-bd71-d8227e901b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:41:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1749197694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6076e6a8-0953-4a76-96ff-60f96020192d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50c5ebfa35e84e1fa822f83efd2739e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:41:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:41:13Z,use_quota=True,user_id='029e33208bca4e258a762ad19e5ed78e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:12 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-33da7a5c-7f30-4e5c-b35b-8de1991bc79c tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0154598f-801e-421c-abd9-5621f4ec1674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:12 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-33da7a5c-7f30-4e5c-b35b-8de1991bc79c tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0154598f-801e-421c-abd9-5621f4ec1674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:12 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-33da7a5c-7f30-4e5c-b35b-8de1991bc79c tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b08d9f43-f777-4d10-80b9-9985008698eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:12 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-33da7a5c-7f30-4e5c-b35b-8de1991bc79c tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b08d9f43-f777-4d10-80b9-9985008698eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6076e6a8-0953-4a76-96ff-60f96020192d', 'volume_name': 'volume-6076e6a8-0953-4a76-96ff-60f96020192d', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:12 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-33da7a5c-7f30-4e5c-b35b-8de1991bc79c tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (206e875c-fbae-4afe-b886-df0119b0919e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:12 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-33da7a5c-7f30-4e5c-b35b-8de1991bc79c tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (206e875c-fbae-4afe-b886-df0119b0919e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:12 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-33da7a5c-7f30-4e5c-b35b-8de1991bc79c tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e00203ed-ed19-4a45-803b-033fc44b9dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:12 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-33da7a5c-7f30-4e5c-b35b-8de1991bc79c tempest-ProjectMemberTests-186690331 None] Volume 6076e6a8-0953-4a76-96ff-60f96020192d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6076e6a8-0953-4a76-96ff-60f96020192d', 'volume_size': 1} Sep 28 09:41:12 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-33da7a5c-7f30-4e5c-b35b-8de1991bc79c tempest-ProjectMemberTests-186690331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:41:12 devstack sudo[107570]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:12 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a875d731-26b9-4a7a-a1dc-07f252b5d964 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-54b14caa-9a18-4cf3-9fea-a1a4d498ee7b 1073741824" returned: 0 in 0.465s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:12 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a875d731-26b9-4a7a-a1dc-07f252b5d964 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-54b14caa-9a18-4cf3-9fea-a1a4d498ee7b {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:12 devstack sudo[107576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-54b14caa-9a18-4cf3-9fea-a1a4d498ee7b Sep 28 09:41:12 devstack sudo[107576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:13 devstack sudo[107576]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:13 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a875d731-26b9-4a7a-a1dc-07f252b5d964 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-54b14caa-9a18-4cf3-9fea-a1a4d498ee7b" returned: 0 in 0.264s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:13 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-a875d731-26b9-4a7a-a1dc-07f252b5d964 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:41:13 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-a875d731-26b9-4a7a-a1dc-07f252b5d964 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:41:13 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-85e3eeac-c921-407e-8255-39d195c553ab tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.937s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:41:13 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-85e3eeac-c921-407e-8255-39d195c553ab tempest-CreateVolumesFromSourceVolumeTest-808023791 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:41:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-317886491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d78d7fb4-de51-40d8-8dd6-e4f1d3c97751,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='835910649f2f4c438b6bfc6df82fc4bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:41:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:41:11Z,use_quota=True,user_id='4fccccf4a9d0435a92f4fae7d0ae6216',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:41:13 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-85e3eeac-c921-407e-8255-39d195c553ab tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Creating volume d78d7fb4-de51-40d8-8dd6-e4f1d3c97751 {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:41:13 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-85e3eeac-c921-407e-8255-39d195c553ab tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:41:13 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-85e3eeac-c921-407e-8255-39d195c553ab tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:41:13 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-85e3eeac-c921-407e-8255-39d195c553ab tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:41:13 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-85e3eeac-c921-407e-8255-39d195c553ab tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:41:13 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-85e3eeac-c921-407e-8255-39d195c553ab tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:41:13 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-85e3eeac-c921-407e-8255-39d195c553ab tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:41:13 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-85e3eeac-c921-407e-8255-39d195c553ab tempest-CreateVolumesFromSourceVolumeTest-808023791 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:41:13 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-85e3eeac-c921-407e-8255-39d195c553ab tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d78d7fb4-de51-40d8-8dd6-e4f1d3c97751 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:13 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-a875d731-26b9-4a7a-a1dc-07f252b5d964 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad2d1c50-8656-4586-999f-60e421acf49e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54b14caa-9a18-4cf3-9fea-a1a4d498ee7b', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:13 devstack sudo[107579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d78d7fb4-de51-40d8-8dd6-e4f1d3c97751 1073741824 Sep 28 09:41:13 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-a875d731-26b9-4a7a-a1dc-07f252b5d964 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62a80d5c-2fb5-4a68-bfdf-005ed23c031a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:13 devstack sudo[107579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:13 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-a875d731-26b9-4a7a-a1dc-07f252b5d964 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Volume volume-54b14caa-9a18-4cf3-9fea-a1a4d498ee7b (54b14caa-9a18-4cf3-9fea-a1a4d498ee7b): created successfully Sep 28 09:41:13 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-a875d731-26b9-4a7a-a1dc-07f252b5d964 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62a80d5c-2fb5-4a68-bfdf-005ed23c031a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:13 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-a875d731-26b9-4a7a-a1dc-07f252b5d964 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Flow 'volume_create_manager' (aa9b7b3b-d714-479a-83e6-3b29d3ab7a82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:41:13 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-a875d731-26b9-4a7a-a1dc-07f252b5d964 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Created volume successfully. Sep 28 09:41:13 devstack sudo[107579]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:13 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-85e3eeac-c921-407e-8255-39d195c553ab tempest-CreateVolumesFromSourceVolumeTest-808023791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d78d7fb4-de51-40d8-8dd6-e4f1d3c97751 1073741824" returned: 0 in 0.571s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:13 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-85e3eeac-c921-407e-8255-39d195c553ab tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d78d7fb4-de51-40d8-8dd6-e4f1d3c97751 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:13 devstack sudo[107585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d78d7fb4-de51-40d8-8dd6-e4f1d3c97751 Sep 28 09:41:13 devstack sudo[107585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:14 devstack sudo[107585]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:14 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-85e3eeac-c921-407e-8255-39d195c553ab tempest-CreateVolumesFromSourceVolumeTest-808023791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d78d7fb4-de51-40d8-8dd6-e4f1d3c97751" returned: 0 in 0.292s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:14 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-85e3eeac-c921-407e-8255-39d195c553ab tempest-CreateVolumesFromSourceVolumeTest-808023791 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:41:14 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-85e3eeac-c921-407e-8255-39d195c553ab tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:41:14 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-33da7a5c-7f30-4e5c-b35b-8de1991bc79c tempest-ProjectMemberTests-186690331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.482s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:41:14 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-33da7a5c-7f30-4e5c-b35b-8de1991bc79c tempest-ProjectMemberTests-186690331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:41:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1749197694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6076e6a8-0953-4a76-96ff-60f96020192d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50c5ebfa35e84e1fa822f83efd2739e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:41:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:41:13Z,use_quota=True,user_id='029e33208bca4e258a762ad19e5ed78e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:41:14 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-33da7a5c-7f30-4e5c-b35b-8de1991bc79c tempest-ProjectMemberTests-186690331 None] Creating volume 6076e6a8-0953-4a76-96ff-60f96020192d {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:41:14 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-33da7a5c-7f30-4e5c-b35b-8de1991bc79c tempest-ProjectMemberTests-186690331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:41:14 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-33da7a5c-7f30-4e5c-b35b-8de1991bc79c tempest-ProjectMemberTests-186690331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:41:14 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-33da7a5c-7f30-4e5c-b35b-8de1991bc79c tempest-ProjectMemberTests-186690331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:41:14 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-33da7a5c-7f30-4e5c-b35b-8de1991bc79c tempest-ProjectMemberTests-186690331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:41:14 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-33da7a5c-7f30-4e5c-b35b-8de1991bc79c tempest-ProjectMemberTests-186690331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:41:14 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-33da7a5c-7f30-4e5c-b35b-8de1991bc79c tempest-ProjectMemberTests-186690331 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:41:14 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-33da7a5c-7f30-4e5c-b35b-8de1991bc79c tempest-ProjectMemberTests-186690331 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:41:14 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-33da7a5c-7f30-4e5c-b35b-8de1991bc79c tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6076e6a8-0953-4a76-96ff-60f96020192d 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:14 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-85e3eeac-c921-407e-8255-39d195c553ab tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7ecb84d-1d30-4f7e-8745-11fb1ca9b9c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d78d7fb4-de51-40d8-8dd6-e4f1d3c97751', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:14 devstack sudo[107589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6076e6a8-0953-4a76-96ff-60f96020192d 1073741824 Sep 28 09:41:14 devstack sudo[107589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:14 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-85e3eeac-c921-407e-8255-39d195c553ab tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1c7912b-479f-473e-bfdd-e88bb8f07519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:14 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-85e3eeac-c921-407e-8255-39d195c553ab tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Volume volume-d78d7fb4-de51-40d8-8dd6-e4f1d3c97751 (d78d7fb4-de51-40d8-8dd6-e4f1d3c97751): created successfully Sep 28 09:41:14 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-85e3eeac-c921-407e-8255-39d195c553ab tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1c7912b-479f-473e-bfdd-e88bb8f07519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:14 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-85e3eeac-c921-407e-8255-39d195c553ab tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Flow 'volume_create_manager' (785f30a2-dec4-4591-bfc5-294d33e2aace) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:41:14 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-85e3eeac-c921-407e-8255-39d195c553ab tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Created volume successfully. Sep 28 09:41:14 devstack sudo[107589]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:14 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-33da7a5c-7f30-4e5c-b35b-8de1991bc79c tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6076e6a8-0953-4a76-96ff-60f96020192d 1073741824" returned: 0 in 0.413s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:14 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-33da7a5c-7f30-4e5c-b35b-8de1991bc79c tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6076e6a8-0953-4a76-96ff-60f96020192d {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:14 devstack sudo[107594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6076e6a8-0953-4a76-96ff-60f96020192d Sep 28 09:41:14 devstack sudo[107594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:14 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-9a0c3cb4-b995-4ef3-8f1f-759bfc4afa1b tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Acquiring lock "cinder-d78d7fb4-de51-40d8-8dd6-e4f1d3c97751-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:41:14 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-9a0c3cb4-b995-4ef3-8f1f-759bfc4afa1b tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Lock "cinder-d78d7fb4-de51-40d8-8dd6-e4f1d3c97751-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:41:14 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-9a0c3cb4-b995-4ef3-8f1f-759bfc4afa1b tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Acquiring lock "cinder-quobyte-d78d7fb4-de51-40d8-8dd6-e4f1d3c97751" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:41:14 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-9a0c3cb4-b995-4ef3-8f1f-759bfc4afa1b tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Lock "cinder-quobyte-d78d7fb4-de51-40d8-8dd6-e4f1d3c97751" acquired by "delete_volume" :: waited 0.017s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:41:14 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a3bed73-39b1-4427-ab7c-03fcec157bb0]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:41:14 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-9a0c3cb4-b995-4ef3-8f1f-759bfc4afa1b tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d78d7fb4-de51-40d8-8dd6-e4f1d3c97751 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:14 devstack sudo[107594]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:14 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-33da7a5c-7f30-4e5c-b35b-8de1991bc79c tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6076e6a8-0953-4a76-96ff-60f96020192d" returned: 0 in 0.264s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:14 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-33da7a5c-7f30-4e5c-b35b-8de1991bc79c tempest-ProjectMemberTests-186690331 None] <== create_volume: return (742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:41:14 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-33da7a5c-7f30-4e5c-b35b-8de1991bc79c tempest-ProjectMemberTests-186690331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:41:14 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-33da7a5c-7f30-4e5c-b35b-8de1991bc79c tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e00203ed-ed19-4a45-803b-033fc44b9dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6076e6a8-0953-4a76-96ff-60f96020192d', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:14 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-33da7a5c-7f30-4e5c-b35b-8de1991bc79c tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19023d0c-c57c-4608-a175-6d4ebfb1c1cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:14 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-33da7a5c-7f30-4e5c-b35b-8de1991bc79c tempest-ProjectMemberTests-186690331 None] Volume volume-6076e6a8-0953-4a76-96ff-60f96020192d (6076e6a8-0953-4a76-96ff-60f96020192d): created successfully Sep 28 09:41:14 devstack sudo[107596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d78d7fb4-de51-40d8-8dd6-e4f1d3c97751 Sep 28 09:41:14 devstack sudo[107596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:14 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-33da7a5c-7f30-4e5c-b35b-8de1991bc79c tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19023d0c-c57c-4608-a175-6d4ebfb1c1cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:14 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-33da7a5c-7f30-4e5c-b35b-8de1991bc79c tempest-ProjectMemberTests-186690331 None] Flow 'volume_create_manager' (fadcf696-003f-4b58-ad8e-49b4995fa564) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:41:14 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-33da7a5c-7f30-4e5c-b35b-8de1991bc79c tempest-ProjectMemberTests-186690331 None] Created volume successfully. Sep 28 09:41:15 devstack sudo[107596]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:15 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-9a0c3cb4-b995-4ef3-8f1f-759bfc4afa1b tempest-CreateVolumesFromSourceVolumeTest-808023791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d78d7fb4-de51-40d8-8dd6-e4f1d3c97751" returned: 0 in 0.364s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:15 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-9a0c3cb4-b995-4ef3-8f1f-759bfc4afa1b tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d78d7fb4-de51-40d8-8dd6-e4f1d3c97751 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:15 devstack sudo[107602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d78d7fb4-de51-40d8-8dd6-e4f1d3c97751 Sep 28 09:41:15 devstack sudo[107602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:15 devstack sudo[107602]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:15 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-9a0c3cb4-b995-4ef3-8f1f-759bfc4afa1b tempest-CreateVolumesFromSourceVolumeTest-808023791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d78d7fb4-de51-40d8-8dd6-e4f1d3c97751" returned: 0 in 0.248s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:15 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-9a0c3cb4-b995-4ef3-8f1f-759bfc4afa1b tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Lock "cinder-quobyte-d78d7fb4-de51-40d8-8dd6-e4f1d3c97751" released by "delete_volume" :: held 0.651s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:41:15 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-9a0c3cb4-b995-4ef3-8f1f-759bfc4afa1b tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Created reservations ['491313f1-76b6-458d-9eaa-3e9a44986d11', '051f8e47-f1ba-43ae-a491-db3941d22c05', '9e4d6f57-1eaf-43a0-b8c0-6d64b5a53f8b', 'c7987a95-98a3-446a-982c-6db04987c043'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:41:15 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-9a0c3cb4-b995-4ef3-8f1f-759bfc4afa1b tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:41:15 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-9a0c3cb4-b995-4ef3-8f1f-759bfc4afa1b tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:41:15 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-9a0c3cb4-b995-4ef3-8f1f-759bfc4afa1b tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:41:15 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-9a0c3cb4-b995-4ef3-8f1f-759bfc4afa1b tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:41:15 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-9a0c3cb4-b995-4ef3-8f1f-759bfc4afa1b tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:41:15 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-9a0c3cb4-b995-4ef3-8f1f-759bfc4afa1b tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:15 devstack sudo[107605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:41:15 devstack sudo[107605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:15 devstack sudo[107605]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:15 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-9a0c3cb4-b995-4ef3-8f1f-759bfc4afa1b tempest-CreateVolumesFromSourceVolumeTest-808023791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.252s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:15 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-9a0c3cb4-b995-4ef3-8f1f-759bfc4afa1b tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:41:15 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-9a0c3cb4-b995-4ef3-8f1f-759bfc4afa1b tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Deleted volume successfully. Sep 28 09:41:15 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-9a0c3cb4-b995-4ef3-8f1f-759bfc4afa1b tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Lock "cinder-d78d7fb4-de51-40d8-8dd6-e4f1d3c97751-delete_volume" released by "delete_volume" :: held 1.107s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:41:15 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-290be90f-ca2f-431c-8aa4-e95787ab8bcb tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Acquiring lock "cinder-54b14caa-9a18-4cf3-9fea-a1a4d498ee7b-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:41:15 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-290be90f-ca2f-431c-8aa4-e95787ab8bcb tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Lock "cinder-54b14caa-9a18-4cf3-9fea-a1a4d498ee7b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:41:15 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-57eabd4d-ea3e-4c0e-b6d5-f845d40bdafb tempest-ProjectMemberTests-186690331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:41:15 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-57eabd4d-ea3e-4c0e-b6d5-f845d40bdafb tempest-ProjectMemberTests-186690331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:41:15 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-290be90f-ca2f-431c-8aa4-e95787ab8bcb tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Acquiring lock "cinder-quobyte-54b14caa-9a18-4cf3-9fea-a1a4d498ee7b" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:41:15 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-57eabd4d-ea3e-4c0e-b6d5-f845d40bdafb tempest-ProjectMemberTests-186690331 None] Creating offline snapshot 1ccc1b7f-c654-43c1-9cf5-12f871590476 of volume 6076e6a8-0953-4a76-96ff-60f96020192d {{(pid=86553) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 09:41:15 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-290be90f-ca2f-431c-8aa4-e95787ab8bcb tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Lock "cinder-quobyte-54b14caa-9a18-4cf3-9fea-a1a4d498ee7b" acquired by "delete_volume" :: waited 0.022s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:41:16 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a13c77-eb12-4e5b-bdeb-9f6f14d50bf0]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:41:16 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-57eabd4d-ea3e-4c0e-b6d5-f845d40bdafb tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6076e6a8-0953-4a76-96ff-60f96020192d {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:16 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd908d46-ffab-4b1c-a6b5-2ed3cabbc743]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:41:16 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-290be90f-ca2f-431c-8aa4-e95787ab8bcb tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-54b14caa-9a18-4cf3-9fea-a1a4d498ee7b {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:16 devstack sudo[107608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6076e6a8-0953-4a76-96ff-60f96020192d Sep 28 09:41:16 devstack sudo[107608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:16 devstack sudo[107609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-54b14caa-9a18-4cf3-9fea-a1a4d498ee7b Sep 28 09:41:16 devstack sudo[107609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:16 devstack sudo[107608]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:16 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-57eabd4d-ea3e-4c0e-b6d5-f845d40bdafb tempest-ProjectMemberTests-186690331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6076e6a8-0953-4a76-96ff-60f96020192d" returned: 0 in 0.377s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:16 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-57eabd4d-ea3e-4c0e-b6d5-f845d40bdafb tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6076e6a8-0953-4a76-96ff-60f96020192d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6076e6a8-0953-4a76-96ff-60f96020192d.1ccc1b7f-c654-43c1-9cf5-12f871590476 1G {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:16 devstack sudo[107609]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:16 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-290be90f-ca2f-431c-8aa4-e95787ab8bcb tempest-CreateVolumesFromSourceVolumeTest-808023791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-54b14caa-9a18-4cf3-9fea-a1a4d498ee7b" returned: 0 in 0.379s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:16 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-290be90f-ca2f-431c-8aa4-e95787ab8bcb tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-54b14caa-9a18-4cf3-9fea-a1a4d498ee7b {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:16 devstack sudo[107619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6076e6a8-0953-4a76-96ff-60f96020192d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6076e6a8-0953-4a76-96ff-60f96020192d.1ccc1b7f-c654-43c1-9cf5-12f871590476 1G Sep 28 09:41:16 devstack sudo[107619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:16 devstack sudo[107620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-54b14caa-9a18-4cf3-9fea-a1a4d498ee7b Sep 28 09:41:16 devstack sudo[107620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:16 devstack sudo[107620]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:16 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-290be90f-ca2f-431c-8aa4-e95787ab8bcb tempest-CreateVolumesFromSourceVolumeTest-808023791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-54b14caa-9a18-4cf3-9fea-a1a4d498ee7b" returned: 0 in 0.263s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:16 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-290be90f-ca2f-431c-8aa4-e95787ab8bcb tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Lock "cinder-quobyte-54b14caa-9a18-4cf3-9fea-a1a4d498ee7b" released by "delete_volume" :: held 0.685s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:41:16 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-290be90f-ca2f-431c-8aa4-e95787ab8bcb tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Created reservations ['49b7c09c-f9ea-4c0b-8143-e0cb6e68d2f5', '0d6033e3-353f-4311-838d-b16c9f3a6e15', 'fbc6f4ef-3278-4604-b3d8-1bbc8843402a', 'ba67275e-7a4c-4ada-898c-1eccbbebcb93'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:41:16 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-290be90f-ca2f-431c-8aa4-e95787ab8bcb tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:41:16 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-290be90f-ca2f-431c-8aa4-e95787ab8bcb tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:41:16 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-290be90f-ca2f-431c-8aa4-e95787ab8bcb tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:41:16 devstack sudo[107619]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:16 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-290be90f-ca2f-431c-8aa4-e95787ab8bcb tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:41:16 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-290be90f-ca2f-431c-8aa4-e95787ab8bcb tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:41:16 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-290be90f-ca2f-431c-8aa4-e95787ab8bcb tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:16 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-57eabd4d-ea3e-4c0e-b6d5-f845d40bdafb tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6076e6a8-0953-4a76-96ff-60f96020192d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6076e6a8-0953-4a76-96ff-60f96020192d.1ccc1b7f-c654-43c1-9cf5-12f871590476 1G" returned: 0 in 0.425s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:16 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-57eabd4d-ea3e-4c0e-b6d5-f845d40bdafb tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6076e6a8-0953-4a76-96ff-60f96020192d -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6076e6a8-0953-4a76-96ff-60f96020192d.1ccc1b7f-c654-43c1-9cf5-12f871590476 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:16 devstack sudo[107628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:41:16 devstack sudo[107628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:16 devstack sudo[107629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6076e6a8-0953-4a76-96ff-60f96020192d -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6076e6a8-0953-4a76-96ff-60f96020192d.1ccc1b7f-c654-43c1-9cf5-12f871590476 Sep 28 09:41:16 devstack sudo[107629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:17 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-c1331b46-07ee-4776-a5bc-ee01d1bbd5f1 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Acquiring lock "cinder-0822327c-a26b-4bed-ab97-095e1a05dd02-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:41:17 devstack sudo[107628]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:17 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-290be90f-ca2f-431c-8aa4-e95787ab8bcb tempest-CreateVolumesFromSourceVolumeTest-808023791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.278s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:17 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-290be90f-ca2f-431c-8aa4-e95787ab8bcb tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:41:17 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-290be90f-ca2f-431c-8aa4-e95787ab8bcb tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Deleted volume successfully. Sep 28 09:41:17 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-c1331b46-07ee-4776-a5bc-ee01d1bbd5f1 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Lock "cinder-0822327c-a26b-4bed-ab97-095e1a05dd02-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:41:17 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-290be90f-ca2f-431c-8aa4-e95787ab8bcb tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Lock "cinder-54b14caa-9a18-4cf3-9fea-a1a4d498ee7b-delete_volume" released by "delete_volume" :: held 1.214s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:41:17 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-c1331b46-07ee-4776-a5bc-ee01d1bbd5f1 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Acquiring lock "cinder-quobyte-0822327c-a26b-4bed-ab97-095e1a05dd02" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:41:17 devstack sudo[107629]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:17 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-57eabd4d-ea3e-4c0e-b6d5-f845d40bdafb tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6076e6a8-0953-4a76-96ff-60f96020192d -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6076e6a8-0953-4a76-96ff-60f96020192d.1ccc1b7f-c654-43c1-9cf5-12f871590476" returned: 0 in 0.339s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:17 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-57eabd4d-ea3e-4c0e-b6d5-f845d40bdafb tempest-ProjectMemberTests-186690331 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6076e6a8-0953-4a76-96ff-60f96020192d.1ccc1b7f-c654-43c1-9cf5-12f871590476 is being set with open permissions: ugo+rw Sep 28 09:41:17 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-57eabd4d-ea3e-4c0e-b6d5-f845d40bdafb tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6076e6a8-0953-4a76-96ff-60f96020192d.1ccc1b7f-c654-43c1-9cf5-12f871590476 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:17 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-c1331b46-07ee-4776-a5bc-ee01d1bbd5f1 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Lock "cinder-quobyte-0822327c-a26b-4bed-ab97-095e1a05dd02" acquired by "delete_volume" :: waited 0.031s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:41:17 devstack sudo[107636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6076e6a8-0953-4a76-96ff-60f96020192d.1ccc1b7f-c654-43c1-9cf5-12f871590476 Sep 28 09:41:17 devstack sudo[107636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:17 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[167fd37a-52e5-4549-8b3d-6aa58f3572b2]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:41:17 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c1331b46-07ee-4776-a5bc-ee01d1bbd5f1 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-0822327c-a26b-4bed-ab97-095e1a05dd02 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:17 devstack sudo[107638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-0822327c-a26b-4bed-ab97-095e1a05dd02 Sep 28 09:41:17 devstack sudo[107638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:17 devstack sudo[107636]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:17 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-57eabd4d-ea3e-4c0e-b6d5-f845d40bdafb tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6076e6a8-0953-4a76-96ff-60f96020192d.1ccc1b7f-c654-43c1-9cf5-12f871590476" returned: 0 in 0.262s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:17 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-57eabd4d-ea3e-4c0e-b6d5-f845d40bdafb tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6076e6a8-0953-4a76-96ff-60f96020192d.info {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:17 devstack sudo[107641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6076e6a8-0953-4a76-96ff-60f96020192d.info Sep 28 09:41:17 devstack sudo[107641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:17 devstack sudo[107638]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:17 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c1331b46-07ee-4776-a5bc-ee01d1bbd5f1 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-0822327c-a26b-4bed-ab97-095e1a05dd02" returned: 0 in 0.377s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:17 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c1331b46-07ee-4776-a5bc-ee01d1bbd5f1 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-0822327c-a26b-4bed-ab97-095e1a05dd02 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:17 devstack sudo[107646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-0822327c-a26b-4bed-ab97-095e1a05dd02 Sep 28 09:41:17 devstack sudo[107646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:17 devstack sudo[107641]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:17 devstack sudo[107651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6076e6a8-0953-4a76-96ff-60f96020192d.info Sep 28 09:41:17 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-57eabd4d-ea3e-4c0e-b6d5-f845d40bdafb tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6076e6a8-0953-4a76-96ff-60f96020192d.info" returned: 0 in 0.258s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:17 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-57eabd4d-ea3e-4c0e-b6d5-f845d40bdafb tempest-ProjectMemberTests-186690331 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6076e6a8-0953-4a76-96ff-60f96020192d.info is being set with open permissions: ugo+rw Sep 28 09:41:17 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-57eabd4d-ea3e-4c0e-b6d5-f845d40bdafb tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6076e6a8-0953-4a76-96ff-60f96020192d.info {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:17 devstack sudo[107651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:17 devstack sudo[107646]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:17 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c1331b46-07ee-4776-a5bc-ee01d1bbd5f1 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-0822327c-a26b-4bed-ab97-095e1a05dd02" returned: 0 in 0.271s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:17 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-c1331b46-07ee-4776-a5bc-ee01d1bbd5f1 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Lock "cinder-quobyte-0822327c-a26b-4bed-ab97-095e1a05dd02" released by "delete_volume" :: held 0.699s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:41:17 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-c1331b46-07ee-4776-a5bc-ee01d1bbd5f1 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Created reservations ['9e595a8d-4d5a-4002-bdb3-0b30ba640d36', '1ebd3a23-b789-4f03-b526-0970055b1f0f', 'b77b66a2-8e2a-49fc-abd9-8d2556166224', 'f6623cdd-d1b5-4931-958f-fce94d972ba9'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:41:17 devstack sudo[107651]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:17 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-57eabd4d-ea3e-4c0e-b6d5-f845d40bdafb tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6076e6a8-0953-4a76-96ff-60f96020192d.info" returned: 0 in 0.260s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:17 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-57eabd4d-ea3e-4c0e-b6d5-f845d40bdafb tempest-ProjectMemberTests-186690331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.022s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:41:18 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-57eabd4d-ea3e-4c0e-b6d5-f845d40bdafb tempest-ProjectMemberTests-186690331 None] Create snapshot completed successfully Sep 28 09:41:18 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-c1331b46-07ee-4776-a5bc-ee01d1bbd5f1 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:41:18 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-c1331b46-07ee-4776-a5bc-ee01d1bbd5f1 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:41:18 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-c1331b46-07ee-4776-a5bc-ee01d1bbd5f1 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:41:18 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-c1331b46-07ee-4776-a5bc-ee01d1bbd5f1 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:41:18 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-c1331b46-07ee-4776-a5bc-ee01d1bbd5f1 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:41:18 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c1331b46-07ee-4776-a5bc-ee01d1bbd5f1 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:18 devstack sudo[107655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:41:18 devstack sudo[107655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:18 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-d6b5419c-8e38-45c6-be5e-0fc584d7f86e tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Acquiring lock "cinder-c835f66a-713b-49cc-bc03-03add4577f14-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:41:18 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-d6b5419c-8e38-45c6-be5e-0fc584d7f86e tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Lock "cinder-c835f66a-713b-49cc-bc03-03add4577f14-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:41:18 devstack sudo[107655]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:18 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c1331b46-07ee-4776-a5bc-ee01d1bbd5f1 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.271s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:18 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-c1331b46-07ee-4776-a5bc-ee01d1bbd5f1 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:41:18 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-d6b5419c-8e38-45c6-be5e-0fc584d7f86e tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Acquiring lock "cinder-quobyte-c835f66a-713b-49cc-bc03-03add4577f14" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:41:18 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-c1331b46-07ee-4776-a5bc-ee01d1bbd5f1 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Deleted volume successfully. Sep 28 09:41:18 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-d6b5419c-8e38-45c6-be5e-0fc584d7f86e tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Lock "cinder-quobyte-c835f66a-713b-49cc-bc03-03add4577f14" acquired by "delete_volume" :: waited 0.021s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:41:18 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-c1331b46-07ee-4776-a5bc-ee01d1bbd5f1 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Lock "cinder-0822327c-a26b-4bed-ab97-095e1a05dd02-delete_volume" released by "delete_volume" :: held 1.239s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:41:18 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[934a0131-8b0f-47ec-92d5-75f8170ee069]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:41:18 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-d6b5419c-8e38-45c6-be5e-0fc584d7f86e tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c835f66a-713b-49cc-bc03-03add4577f14 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:18 devstack sudo[107659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c835f66a-713b-49cc-bc03-03add4577f14 Sep 28 09:41:18 devstack sudo[107659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:18 devstack sudo[107659]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:18 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-d6b5419c-8e38-45c6-be5e-0fc584d7f86e tempest-CreateVolumesFromSourceVolumeTest-808023791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c835f66a-713b-49cc-bc03-03add4577f14" returned: 0 in 0.361s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:18 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-d6b5419c-8e38-45c6-be5e-0fc584d7f86e tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c835f66a-713b-49cc-bc03-03add4577f14 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:18 devstack sudo[107664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c835f66a-713b-49cc-bc03-03add4577f14 Sep 28 09:41:18 devstack sudo[107664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:18 devstack sudo[107664]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:18 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-d6b5419c-8e38-45c6-be5e-0fc584d7f86e tempest-CreateVolumesFromSourceVolumeTest-808023791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c835f66a-713b-49cc-bc03-03add4577f14" returned: 0 in 0.241s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:18 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-d6b5419c-8e38-45c6-be5e-0fc584d7f86e tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Lock "cinder-quobyte-c835f66a-713b-49cc-bc03-03add4577f14" released by "delete_volume" :: held 0.646s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:41:19 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-d6b5419c-8e38-45c6-be5e-0fc584d7f86e tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Created reservations ['f3d3183e-1027-48ae-8313-47b892652409', '094564cc-9a40-4684-8df8-3c70d0a592ce', '365ea724-f498-4821-a7ee-54f143ac2b93', 'f7485432-021e-4109-b55a-8c256cfd8809'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:41:19 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-d6b5419c-8e38-45c6-be5e-0fc584d7f86e tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:41:19 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-d6b5419c-8e38-45c6-be5e-0fc584d7f86e tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:41:19 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-d6b5419c-8e38-45c6-be5e-0fc584d7f86e tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:41:19 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-d6b5419c-8e38-45c6-be5e-0fc584d7f86e tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:41:19 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-d6b5419c-8e38-45c6-be5e-0fc584d7f86e tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:41:19 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-d6b5419c-8e38-45c6-be5e-0fc584d7f86e tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:19 devstack sudo[107667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:41:19 devstack sudo[107667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:19 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-30c41c0f-8d00-43e5-8bd5-a402056c986e tempest-ProjectMemberTests-186690331 None] Acquiring lock "cinder-1ccc1b7f-c654-43c1-9cf5-12f871590476-delete_snapshot" by "delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:41:19 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-30c41c0f-8d00-43e5-8bd5-a402056c986e tempest-ProjectMemberTests-186690331 None] Lock "cinder-1ccc1b7f-c654-43c1-9cf5-12f871590476-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:41:19 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-30c41c0f-8d00-43e5-8bd5-a402056c986e tempest-ProjectMemberTests-186690331 None] Acquiring lock "cinder-quobyte-6076e6a8-0953-4a76-96ff-60f96020192d" by "delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:41:19 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-30c41c0f-8d00-43e5-8bd5-a402056c986e tempest-ProjectMemberTests-186690331 None] Lock "cinder-quobyte-6076e6a8-0953-4a76-96ff-60f96020192d" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:41:19 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-30c41c0f-8d00-43e5-8bd5-a402056c986e tempest-ProjectMemberTests-186690331 None] Acquiring lock "cinder-quobyte-1ccc1b7f-c654-43c1-9cf5-12f871590476" by "_delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:41:19 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-30c41c0f-8d00-43e5-8bd5-a402056c986e tempest-ProjectMemberTests-186690331 None] Lock "cinder-quobyte-1ccc1b7f-c654-43c1-9cf5-12f871590476" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:41:19 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-30c41c0f-8d00-43e5-8bd5-a402056c986e tempest-ProjectMemberTests-186690331 None] Deleting offline snapshot 1ccc1b7f-c654-43c1-9cf5-12f871590476 of volume 6076e6a8-0953-4a76-96ff-60f96020192d {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 09:41:19 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-30c41c0f-8d00-43e5-8bd5-a402056c986e tempest-ProjectMemberTests-186690331 None] snapshot_file for this snap is: volume-6076e6a8-0953-4a76-96ff-60f96020192d.1ccc1b7f-c654-43c1-9cf5-12f871590476 {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 09:41:19 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8dcf392-f70b-403a-9089-d6ef33635d40]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:41:19 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-30c41c0f-8d00-43e5-8bd5-a402056c986e tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6076e6a8-0953-4a76-96ff-60f96020192d.1ccc1b7f-c654-43c1-9cf5-12f871590476 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:19 devstack sudo[107669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6076e6a8-0953-4a76-96ff-60f96020192d.1ccc1b7f-c654-43c1-9cf5-12f871590476 Sep 28 09:41:19 devstack sudo[107669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:19 devstack sudo[107667]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:19 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-d6b5419c-8e38-45c6-be5e-0fc584d7f86e tempest-CreateVolumesFromSourceVolumeTest-808023791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.292s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:19 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-d6b5419c-8e38-45c6-be5e-0fc584d7f86e tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:41:19 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-d6b5419c-8e38-45c6-be5e-0fc584d7f86e tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Deleted volume successfully. Sep 28 09:41:19 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-d6b5419c-8e38-45c6-be5e-0fc584d7f86e tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Lock "cinder-c835f66a-713b-49cc-bc03-03add4577f14-delete_volume" released by "delete_volume" :: held 1.169s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:41:19 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-dddb28c7-55ca-48c5-a952-0be75b1c0844 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Acquiring lock "cinder-bee544f0-9235-432d-a1d3-385f9ce8d0d6-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:41:19 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-dddb28c7-55ca-48c5-a952-0be75b1c0844 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Lock "cinder-bee544f0-9235-432d-a1d3-385f9ce8d0d6-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:41:19 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-dddb28c7-55ca-48c5-a952-0be75b1c0844 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Acquiring lock "cinder-quobyte-bee544f0-9235-432d-a1d3-385f9ce8d0d6" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:41:19 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-dddb28c7-55ca-48c5-a952-0be75b1c0844 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Lock "cinder-quobyte-bee544f0-9235-432d-a1d3-385f9ce8d0d6" acquired by "delete_volume" :: waited 0.016s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:41:19 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa6c06f-83ea-4f44-baa0-072934f328d4]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:41:19 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-dddb28c7-55ca-48c5-a952-0be75b1c0844 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bee544f0-9235-432d-a1d3-385f9ce8d0d6 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:19 devstack sudo[107669]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:19 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-30c41c0f-8d00-43e5-8bd5-a402056c986e tempest-ProjectMemberTests-186690331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6076e6a8-0953-4a76-96ff-60f96020192d.1ccc1b7f-c654-43c1-9cf5-12f871590476" returned: 0 in 0.398s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:19 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-30c41c0f-8d00-43e5-8bd5-a402056c986e tempest-ProjectMemberTests-186690331 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6076e6a8-0953-4a76-96ff-60f96020192d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86553) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 09:41:19 devstack sudo[107672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bee544f0-9235-432d-a1d3-385f9ce8d0d6 Sep 28 09:41:19 devstack sudo[107672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:19 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d1de490-fda3-4b01-b0e1-7bd30f91e775]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:41:19 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-30c41c0f-8d00-43e5-8bd5-a402056c986e tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6076e6a8-0953-4a76-96ff-60f96020192d {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:19 devstack sudo[107677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6076e6a8-0953-4a76-96ff-60f96020192d Sep 28 09:41:19 devstack sudo[107677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:19 devstack sudo[107672]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:19 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-dddb28c7-55ca-48c5-a952-0be75b1c0844 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bee544f0-9235-432d-a1d3-385f9ce8d0d6" returned: 0 in 0.375s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:19 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-dddb28c7-55ca-48c5-a952-0be75b1c0844 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bee544f0-9235-432d-a1d3-385f9ce8d0d6 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:19 devstack sudo[107682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bee544f0-9235-432d-a1d3-385f9ce8d0d6 Sep 28 09:41:19 devstack sudo[107682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:20 devstack sudo[107677]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-30c41c0f-8d00-43e5-8bd5-a402056c986e tempest-ProjectMemberTests-186690331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6076e6a8-0953-4a76-96ff-60f96020192d" returned: 0 in 0.359s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-30c41c0f-8d00-43e5-8bd5-a402056c986e tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6076e6a8-0953-4a76-96ff-60f96020192d.1ccc1b7f-c654-43c1-9cf5-12f871590476 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:20 devstack sudo[107687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6076e6a8-0953-4a76-96ff-60f96020192d.1ccc1b7f-c654-43c1-9cf5-12f871590476 Sep 28 09:41:20 devstack sudo[107687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:20 devstack sudo[107682]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-dddb28c7-55ca-48c5-a952-0be75b1c0844 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-bee544f0-9235-432d-a1d3-385f9ce8d0d6" returned: 0 in 0.261s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:20 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-dddb28c7-55ca-48c5-a952-0be75b1c0844 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Lock "cinder-quobyte-bee544f0-9235-432d-a1d3-385f9ce8d0d6" released by "delete_volume" :: held 0.688s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:41:20 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-dddb28c7-55ca-48c5-a952-0be75b1c0844 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Created reservations ['d90a5e17-f1e8-412c-a2a7-fba3290dc51e', 'e9d9b24f-3cad-40df-9d39-62719ff9cce2', '0c5b528c-0caa-4503-8f32-9c65c138e7b9', '5cebc4c0-8951-4a94-aac1-826fc502bd26'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:41:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-dddb28c7-55ca-48c5-a952-0be75b1c0844 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:41:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-dddb28c7-55ca-48c5-a952-0be75b1c0844 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:41:20 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-dddb28c7-55ca-48c5-a952-0be75b1c0844 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:41:20 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-dddb28c7-55ca-48c5-a952-0be75b1c0844 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:41:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-dddb28c7-55ca-48c5-a952-0be75b1c0844 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:41:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-dddb28c7-55ca-48c5-a952-0be75b1c0844 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:20 devstack sudo[107693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:41:20 devstack sudo[107693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:20 devstack sudo[107687]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-30c41c0f-8d00-43e5-8bd5-a402056c986e tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6076e6a8-0953-4a76-96ff-60f96020192d.1ccc1b7f-c654-43c1-9cf5-12f871590476" returned: 0 in 0.363s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-30c41c0f-8d00-43e5-8bd5-a402056c986e tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6076e6a8-0953-4a76-96ff-60f96020192d.1ccc1b7f-c654-43c1-9cf5-12f871590476 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:20 devstack sudo[107695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6076e6a8-0953-4a76-96ff-60f96020192d.1ccc1b7f-c654-43c1-9cf5-12f871590476 Sep 28 09:41:20 devstack sudo[107695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:20 devstack sudo[107693]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-dddb28c7-55ca-48c5-a952-0be75b1c0844 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.273s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:20 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-dddb28c7-55ca-48c5-a952-0be75b1c0844 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:41:20 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-dddb28c7-55ca-48c5-a952-0be75b1c0844 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Deleted volume successfully. Sep 28 09:41:20 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-9d3bd950-6c94-4856-9f9b-a58bcf3dcd7b tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Acquiring lock "cinder-d75811e9-ba45-4ee3-a480-1e931bd988bb-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:41:20 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-dddb28c7-55ca-48c5-a952-0be75b1c0844 tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Lock "cinder-bee544f0-9235-432d-a1d3-385f9ce8d0d6-delete_volume" released by "delete_volume" :: held 1.189s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:41:20 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-9d3bd950-6c94-4856-9f9b-a58bcf3dcd7b tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Lock "cinder-d75811e9-ba45-4ee3-a480-1e931bd988bb-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:41:20 devstack sudo[107695]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-30c41c0f-8d00-43e5-8bd5-a402056c986e tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6076e6a8-0953-4a76-96ff-60f96020192d.1ccc1b7f-c654-43c1-9cf5-12f871590476" returned: 0 in 0.268s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:20 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-30c41c0f-8d00-43e5-8bd5-a402056c986e tempest-ProjectMemberTests-186690331 None] Lock "cinder-quobyte-1ccc1b7f-c654-43c1-9cf5-12f871590476" released by "_delete_snapshot" :: held 1.507s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:41:20 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-30c41c0f-8d00-43e5-8bd5-a402056c986e tempest-ProjectMemberTests-186690331 None] Lock "cinder-quobyte-6076e6a8-0953-4a76-96ff-60f96020192d" released by "delete_snapshot" :: held 1.540s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:41:20 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-9d3bd950-6c94-4856-9f9b-a58bcf3dcd7b tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Acquiring lock "cinder-quobyte-d75811e9-ba45-4ee3-a480-1e931bd988bb" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:41:20 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-9d3bd950-6c94-4856-9f9b-a58bcf3dcd7b tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Lock "cinder-quobyte-d75811e9-ba45-4ee3-a480-1e931bd988bb" acquired by "delete_volume" :: waited 0.016s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:41:20 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[4929f958-cb78-44ef-9e6b-06c8c878b68d]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:41:20 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-9d3bd950-6c94-4856-9f9b-a58bcf3dcd7b tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d75811e9-ba45-4ee3-a480-1e931bd988bb {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:20 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-30c41c0f-8d00-43e5-8bd5-a402056c986e tempest-ProjectMemberTests-186690331 None] Created reservations ['2028a6e9-ed5b-488a-b76c-546971d3c232', '3ae4629c-9c3d-40e7-aade-9c4762ce1b42', 'c5a0c6c4-bdc2-4f40-91bb-bc94bd8c09d1', '1e45f28d-8a49-45ec-b4e9-44cbee528164'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:41:20 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-30c41c0f-8d00-43e5-8bd5-a402056c986e tempest-ProjectMemberTests-186690331 None] Delete snapshot completed successfully. Sep 28 09:41:20 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-30c41c0f-8d00-43e5-8bd5-a402056c986e tempest-ProjectMemberTests-186690331 None] Lock "cinder-1ccc1b7f-c654-43c1-9cf5-12f871590476-delete_snapshot" released by "delete_snapshot" :: held 1.716s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:41:20 devstack sudo[107699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d75811e9-ba45-4ee3-a480-1e931bd988bb Sep 28 09:41:20 devstack sudo[107699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:21 devstack sudo[107699]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-9d3bd950-6c94-4856-9f9b-a58bcf3dcd7b tempest-CreateVolumesFromSourceVolumeTest-808023791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d75811e9-ba45-4ee3-a480-1e931bd988bb" returned: 0 in 0.358s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-9d3bd950-6c94-4856-9f9b-a58bcf3dcd7b tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d75811e9-ba45-4ee3-a480-1e931bd988bb {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:21 devstack sudo[107704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d75811e9-ba45-4ee3-a480-1e931bd988bb Sep 28 09:41:21 devstack sudo[107704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:21 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-c2ba6339-350d-4c1e-a5c6-3ec231c916a5 tempest-ProjectMemberTests-186690331 None] Acquiring lock "cinder-6076e6a8-0953-4a76-96ff-60f96020192d-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:41:21 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-c2ba6339-350d-4c1e-a5c6-3ec231c916a5 tempest-ProjectMemberTests-186690331 None] Lock "cinder-6076e6a8-0953-4a76-96ff-60f96020192d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:41:21 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-c2ba6339-350d-4c1e-a5c6-3ec231c916a5 tempest-ProjectMemberTests-186690331 None] Acquiring lock "cinder-quobyte-6076e6a8-0953-4a76-96ff-60f96020192d" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:41:21 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-c2ba6339-350d-4c1e-a5c6-3ec231c916a5 tempest-ProjectMemberTests-186690331 None] Lock "cinder-quobyte-6076e6a8-0953-4a76-96ff-60f96020192d" acquired by "delete_volume" :: waited 0.017s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:41:21 devstack sudo[107704]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-9d3bd950-6c94-4856-9f9b-a58bcf3dcd7b tempest-CreateVolumesFromSourceVolumeTest-808023791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-d75811e9-ba45-4ee3-a480-1e931bd988bb" returned: 0 in 0.267s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:21 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-9d3bd950-6c94-4856-9f9b-a58bcf3dcd7b tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Lock "cinder-quobyte-d75811e9-ba45-4ee3-a480-1e931bd988bb" released by "delete_volume" :: held 0.667s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:41:21 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a2a6cd6-e063-41ab-b33a-372ea32d8dc8]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:41:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c2ba6339-350d-4c1e-a5c6-3ec231c916a5 tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6076e6a8-0953-4a76-96ff-60f96020192d {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:21 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-9d3bd950-6c94-4856-9f9b-a58bcf3dcd7b tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Created reservations ['e429689e-4ab2-4f3e-9b9c-ce0379a26848', '21913190-e0df-4c67-868d-46629efa46e8', '09e5af18-9f8e-466a-9cce-1197eedb6dc8', '631a055e-91ca-44a4-87f3-61e485d3b299'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:41:21 devstack sudo[107707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6076e6a8-0953-4a76-96ff-60f96020192d Sep 28 09:41:21 devstack sudo[107707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-9d3bd950-6c94-4856-9f9b-a58bcf3dcd7b tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:41:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-9d3bd950-6c94-4856-9f9b-a58bcf3dcd7b tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:41:21 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-9d3bd950-6c94-4856-9f9b-a58bcf3dcd7b tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:41:21 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-9d3bd950-6c94-4856-9f9b-a58bcf3dcd7b tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:41:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-9d3bd950-6c94-4856-9f9b-a58bcf3dcd7b tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:41:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-9d3bd950-6c94-4856-9f9b-a58bcf3dcd7b tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:21 devstack cinder-volume[86553]: DEBUG oslo_service.periodic_task [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86553) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 09:41:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:41:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:41:21 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:41:21 devstack sudo[107709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:41:21 devstack sudo[107709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:21 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:41:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:41:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:21 devstack sudo[107711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:41:21 devstack sudo[107711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:21 devstack sudo[107709]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-9d3bd950-6c94-4856-9f9b-a58bcf3dcd7b tempest-CreateVolumesFromSourceVolumeTest-808023791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.267s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:21 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-9d3bd950-6c94-4856-9f9b-a58bcf3dcd7b tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:41:21 devstack sudo[107707]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c2ba6339-350d-4c1e-a5c6-3ec231c916a5 tempest-ProjectMemberTests-186690331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6076e6a8-0953-4a76-96ff-60f96020192d" returned: 0 in 0.398s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c2ba6339-350d-4c1e-a5c6-3ec231c916a5 tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6076e6a8-0953-4a76-96ff-60f96020192d {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:21 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-9d3bd950-6c94-4856-9f9b-a58bcf3dcd7b tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Deleted volume successfully. Sep 28 09:41:21 devstack sudo[107719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6076e6a8-0953-4a76-96ff-60f96020192d Sep 28 09:41:21 devstack sudo[107719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:21 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-9d3bd950-6c94-4856-9f9b-a58bcf3dcd7b tempest-CreateVolumesFromSourceVolumeTest-808023791 None] Lock "cinder-d75811e9-ba45-4ee3-a480-1e931bd988bb-delete_volume" released by "delete_volume" :: held 1.216s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:41:21 devstack sudo[107711]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.308s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:21 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:41:21 devstack cinder-volume[86553]: DEBUG oslo_service.periodic_task [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Running periodic task VolumeManager._thread_info {{(pid=86553) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 09:41:21 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] thread count: 28 {{(pid=86553) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 09:41:21 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] thread info: [<_MainThread(MainThread, started 134684877779072)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86553) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 09:41:22 devstack sudo[107719]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:22 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c2ba6339-350d-4c1e-a5c6-3ec231c916a5 tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-6076e6a8-0953-4a76-96ff-60f96020192d" returned: 0 in 0.269s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:22 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-c2ba6339-350d-4c1e-a5c6-3ec231c916a5 tempest-ProjectMemberTests-186690331 None] Lock "cinder-quobyte-6076e6a8-0953-4a76-96ff-60f96020192d" released by "delete_volume" :: held 0.738s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:41:22 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-c2ba6339-350d-4c1e-a5c6-3ec231c916a5 tempest-ProjectMemberTests-186690331 None] Created reservations ['e2ee6672-f224-48c1-8a87-c9563e9e9a5f', '4deae45d-701e-47dc-a88a-065ce97dbbfc', '9400b103-cc84-4608-bb85-24ad07402ad8', 'cfeed701-9bff-4e39-96b0-cbbac002d788'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:41:22 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-c2ba6339-350d-4c1e-a5c6-3ec231c916a5 tempest-ProjectMemberTests-186690331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:41:22 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-c2ba6339-350d-4c1e-a5c6-3ec231c916a5 tempest-ProjectMemberTests-186690331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:41:22 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-c2ba6339-350d-4c1e-a5c6-3ec231c916a5 tempest-ProjectMemberTests-186690331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:41:22 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-c2ba6339-350d-4c1e-a5c6-3ec231c916a5 tempest-ProjectMemberTests-186690331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:41:22 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-c2ba6339-350d-4c1e-a5c6-3ec231c916a5 tempest-ProjectMemberTests-186690331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:41:22 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c2ba6339-350d-4c1e-a5c6-3ec231c916a5 tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:22 devstack sudo[107722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:41:22 devstack sudo[107722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:22 devstack sudo[107722]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:22 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c2ba6339-350d-4c1e-a5c6-3ec231c916a5 tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.278s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:22 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-c2ba6339-350d-4c1e-a5c6-3ec231c916a5 tempest-ProjectMemberTests-186690331 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:41:22 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-c2ba6339-350d-4c1e-a5c6-3ec231c916a5 tempest-ProjectMemberTests-186690331 None] Deleted volume successfully. Sep 28 09:41:22 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-c2ba6339-350d-4c1e-a5c6-3ec231c916a5 tempest-ProjectMemberTests-186690331 None] Lock "cinder-6076e6a8-0953-4a76-96ff-60f96020192d-delete_volume" released by "delete_volume" :: held 1.227s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:41:22 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-376cbbf4-6732-4dbb-94ae-fb8f1aa0717f tempest-ProjectMemberTests-186690331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:41:22 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-376cbbf4-6732-4dbb-94ae-fb8f1aa0717f tempest-ProjectMemberTests-186690331 None] Flow 'volume_create_manager' (210cf8fd-e58b-4fa7-858d-b76aa8f940ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:41:22 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-376cbbf4-6732-4dbb-94ae-fb8f1aa0717f tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26b7b7e5-1d42-4751-ab43-5e8a723579c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:23 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-376cbbf4-6732-4dbb-94ae-fb8f1aa0717f tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26b7b7e5-1d42-4751-ab43-5e8a723579c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:41:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1273279426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21567f8c-3d4b-4feb-a1c3-8847c151b309,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50c5ebfa35e84e1fa822f83efd2739e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:41:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:41:23Z,use_quota=True,user_id='029e33208bca4e258a762ad19e5ed78e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:23 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-376cbbf4-6732-4dbb-94ae-fb8f1aa0717f tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (623d2e02-fbbf-4e8d-859f-28961646af25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:23 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-376cbbf4-6732-4dbb-94ae-fb8f1aa0717f tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (623d2e02-fbbf-4e8d-859f-28961646af25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:23 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-376cbbf4-6732-4dbb-94ae-fb8f1aa0717f tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cef7932-767a-4500-a51f-6d328d9af92b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:23 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-376cbbf4-6732-4dbb-94ae-fb8f1aa0717f tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cef7932-767a-4500-a51f-6d328d9af92b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21567f8c-3d4b-4feb-a1c3-8847c151b309', 'volume_name': 'volume-21567f8c-3d4b-4feb-a1c3-8847c151b309', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:23 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-376cbbf4-6732-4dbb-94ae-fb8f1aa0717f tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a5c1536-b1d0-4067-a3e6-81a22edea346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:23 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-376cbbf4-6732-4dbb-94ae-fb8f1aa0717f tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a5c1536-b1d0-4067-a3e6-81a22edea346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:23 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-376cbbf4-6732-4dbb-94ae-fb8f1aa0717f tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (871f9e49-c8e9-4360-a273-ec3690ac5ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:23 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-376cbbf4-6732-4dbb-94ae-fb8f1aa0717f tempest-ProjectMemberTests-186690331 None] Volume 21567f8c-3d4b-4feb-a1c3-8847c151b309: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21567f8c-3d4b-4feb-a1c3-8847c151b309', 'volume_size': 1} Sep 28 09:41:23 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-376cbbf4-6732-4dbb-94ae-fb8f1aa0717f tempest-ProjectMemberTests-186690331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:41:23 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-376cbbf4-6732-4dbb-94ae-fb8f1aa0717f tempest-ProjectMemberTests-186690331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:41:23 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-376cbbf4-6732-4dbb-94ae-fb8f1aa0717f tempest-ProjectMemberTests-186690331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:41:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1273279426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21567f8c-3d4b-4feb-a1c3-8847c151b309,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50c5ebfa35e84e1fa822f83efd2739e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:41:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:41:23Z,use_quota=True,user_id='029e33208bca4e258a762ad19e5ed78e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:41:23 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-376cbbf4-6732-4dbb-94ae-fb8f1aa0717f tempest-ProjectMemberTests-186690331 None] Creating volume 21567f8c-3d4b-4feb-a1c3-8847c151b309 {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:41:23 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-376cbbf4-6732-4dbb-94ae-fb8f1aa0717f tempest-ProjectMemberTests-186690331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:41:23 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-376cbbf4-6732-4dbb-94ae-fb8f1aa0717f tempest-ProjectMemberTests-186690331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:41:23 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-376cbbf4-6732-4dbb-94ae-fb8f1aa0717f tempest-ProjectMemberTests-186690331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:41:23 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-376cbbf4-6732-4dbb-94ae-fb8f1aa0717f tempest-ProjectMemberTests-186690331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:41:23 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-376cbbf4-6732-4dbb-94ae-fb8f1aa0717f tempest-ProjectMemberTests-186690331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:41:23 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-376cbbf4-6732-4dbb-94ae-fb8f1aa0717f tempest-ProjectMemberTests-186690331 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:41:23 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-376cbbf4-6732-4dbb-94ae-fb8f1aa0717f tempest-ProjectMemberTests-186690331 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:41:23 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-376cbbf4-6732-4dbb-94ae-fb8f1aa0717f tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-21567f8c-3d4b-4feb-a1c3-8847c151b309 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:23 devstack sudo[107725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-21567f8c-3d4b-4feb-a1c3-8847c151b309 1073741824 Sep 28 09:41:23 devstack sudo[107725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:23 devstack sudo[107725]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:23 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-376cbbf4-6732-4dbb-94ae-fb8f1aa0717f tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-21567f8c-3d4b-4feb-a1c3-8847c151b309 1073741824" returned: 0 in 0.448s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:23 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-376cbbf4-6732-4dbb-94ae-fb8f1aa0717f tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-21567f8c-3d4b-4feb-a1c3-8847c151b309 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:23 devstack sudo[107731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-21567f8c-3d4b-4feb-a1c3-8847c151b309 Sep 28 09:41:23 devstack sudo[107731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:23 devstack sudo[107731]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:23 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-376cbbf4-6732-4dbb-94ae-fb8f1aa0717f tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-21567f8c-3d4b-4feb-a1c3-8847c151b309" returned: 0 in 0.264s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:23 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-376cbbf4-6732-4dbb-94ae-fb8f1aa0717f tempest-ProjectMemberTests-186690331 None] <== create_volume: return (761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:41:23 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-376cbbf4-6732-4dbb-94ae-fb8f1aa0717f tempest-ProjectMemberTests-186690331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.763s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:41:23 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-376cbbf4-6732-4dbb-94ae-fb8f1aa0717f tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (871f9e49-c8e9-4360-a273-ec3690ac5ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21567f8c-3d4b-4feb-a1c3-8847c151b309', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:23 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-376cbbf4-6732-4dbb-94ae-fb8f1aa0717f tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (731c5f96-5215-4f1d-86bb-31e9cbbdd644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:23 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-376cbbf4-6732-4dbb-94ae-fb8f1aa0717f tempest-ProjectMemberTests-186690331 None] Volume volume-21567f8c-3d4b-4feb-a1c3-8847c151b309 (21567f8c-3d4b-4feb-a1c3-8847c151b309): created successfully Sep 28 09:41:23 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-376cbbf4-6732-4dbb-94ae-fb8f1aa0717f tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (731c5f96-5215-4f1d-86bb-31e9cbbdd644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:23 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-376cbbf4-6732-4dbb-94ae-fb8f1aa0717f tempest-ProjectMemberTests-186690331 None] Flow 'volume_create_manager' (210cf8fd-e58b-4fa7-858d-b76aa8f940ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:41:23 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-376cbbf4-6732-4dbb-94ae-fb8f1aa0717f tempest-ProjectMemberTests-186690331 None] Created volume successfully. Sep 28 09:41:24 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-3f9d335c-4934-4c28-a8e8-91a91a253609 tempest-ProjectMemberTests-186690331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:41:24 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-3f9d335c-4934-4c28-a8e8-91a91a253609 tempest-ProjectMemberTests-186690331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:41:24 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-3f9d335c-4934-4c28-a8e8-91a91a253609 tempest-ProjectMemberTests-186690331 None] Creating offline snapshot 46a0cd24-c492-427e-952d-9cde1b578780 of volume 21567f8c-3d4b-4feb-a1c3-8847c151b309 {{(pid=86553) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 09:41:24 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[99385dd9-7304-4cae-94ce-a2fbead7b295]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:41:24 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3f9d335c-4934-4c28-a8e8-91a91a253609 tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-21567f8c-3d4b-4feb-a1c3-8847c151b309 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:24 devstack sudo[107734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-21567f8c-3d4b-4feb-a1c3-8847c151b309 Sep 28 09:41:24 devstack sudo[107734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:24 devstack sudo[107734]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:24 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3f9d335c-4934-4c28-a8e8-91a91a253609 tempest-ProjectMemberTests-186690331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-21567f8c-3d4b-4feb-a1c3-8847c151b309" returned: 0 in 0.394s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:24 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3f9d335c-4934-4c28-a8e8-91a91a253609 tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-21567f8c-3d4b-4feb-a1c3-8847c151b309,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-21567f8c-3d4b-4feb-a1c3-8847c151b309.46a0cd24-c492-427e-952d-9cde1b578780 1G {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:24 devstack sudo[107740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-21567f8c-3d4b-4feb-a1c3-8847c151b309,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-21567f8c-3d4b-4feb-a1c3-8847c151b309.46a0cd24-c492-427e-952d-9cde1b578780 1G Sep 28 09:41:24 devstack sudo[107740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:25 devstack sudo[107740]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:25 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3f9d335c-4934-4c28-a8e8-91a91a253609 tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-21567f8c-3d4b-4feb-a1c3-8847c151b309,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-21567f8c-3d4b-4feb-a1c3-8847c151b309.46a0cd24-c492-427e-952d-9cde1b578780 1G" returned: 0 in 0.458s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:25 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3f9d335c-4934-4c28-a8e8-91a91a253609 tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21567f8c-3d4b-4feb-a1c3-8847c151b309 -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-21567f8c-3d4b-4feb-a1c3-8847c151b309.46a0cd24-c492-427e-952d-9cde1b578780 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:25 devstack sudo[107746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21567f8c-3d4b-4feb-a1c3-8847c151b309 -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-21567f8c-3d4b-4feb-a1c3-8847c151b309.46a0cd24-c492-427e-952d-9cde1b578780 Sep 28 09:41:25 devstack sudo[107746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:25 devstack sudo[107746]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:25 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3f9d335c-4934-4c28-a8e8-91a91a253609 tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21567f8c-3d4b-4feb-a1c3-8847c151b309 -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-21567f8c-3d4b-4feb-a1c3-8847c151b309.46a0cd24-c492-427e-952d-9cde1b578780" returned: 0 in 0.325s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:25 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-3f9d335c-4934-4c28-a8e8-91a91a253609 tempest-ProjectMemberTests-186690331 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-21567f8c-3d4b-4feb-a1c3-8847c151b309.46a0cd24-c492-427e-952d-9cde1b578780 is being set with open permissions: ugo+rw Sep 28 09:41:25 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3f9d335c-4934-4c28-a8e8-91a91a253609 tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-21567f8c-3d4b-4feb-a1c3-8847c151b309.46a0cd24-c492-427e-952d-9cde1b578780 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:25 devstack sudo[107751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-21567f8c-3d4b-4feb-a1c3-8847c151b309.46a0cd24-c492-427e-952d-9cde1b578780 Sep 28 09:41:25 devstack sudo[107751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:25 devstack sudo[107751]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:25 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3f9d335c-4934-4c28-a8e8-91a91a253609 tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-21567f8c-3d4b-4feb-a1c3-8847c151b309.46a0cd24-c492-427e-952d-9cde1b578780" returned: 0 in 0.281s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:25 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3f9d335c-4934-4c28-a8e8-91a91a253609 tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-21567f8c-3d4b-4feb-a1c3-8847c151b309.info {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:25 devstack sudo[107754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-21567f8c-3d4b-4feb-a1c3-8847c151b309.info Sep 28 09:41:25 devstack sudo[107754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:25 devstack sudo[107754]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:25 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3f9d335c-4934-4c28-a8e8-91a91a253609 tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-21567f8c-3d4b-4feb-a1c3-8847c151b309.info" returned: 0 in 0.257s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:25 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-3f9d335c-4934-4c28-a8e8-91a91a253609 tempest-ProjectMemberTests-186690331 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-21567f8c-3d4b-4feb-a1c3-8847c151b309.info is being set with open permissions: ugo+rw Sep 28 09:41:25 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3f9d335c-4934-4c28-a8e8-91a91a253609 tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-21567f8c-3d4b-4feb-a1c3-8847c151b309.info {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:25 devstack sudo[107757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-21567f8c-3d4b-4feb-a1c3-8847c151b309.info Sep 28 09:41:25 devstack sudo[107757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:26 devstack sudo[107757]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:26 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3f9d335c-4934-4c28-a8e8-91a91a253609 tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-21567f8c-3d4b-4feb-a1c3-8847c151b309.info" returned: 0 in 0.257s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:26 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-3f9d335c-4934-4c28-a8e8-91a91a253609 tempest-ProjectMemberTests-186690331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.070s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:41:26 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-3f9d335c-4934-4c28-a8e8-91a91a253609 tempest-ProjectMemberTests-186690331 None] Create snapshot completed successfully Sep 28 09:41:27 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-44fd02e4-c911-41d5-aaf2-a7a2d24465d9 tempest-ProjectMemberTests-186690331 None] Acquiring lock "cinder-46a0cd24-c492-427e-952d-9cde1b578780-delete_snapshot" by "delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:41:27 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-44fd02e4-c911-41d5-aaf2-a7a2d24465d9 tempest-ProjectMemberTests-186690331 None] Lock "cinder-46a0cd24-c492-427e-952d-9cde1b578780-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:41:27 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-44fd02e4-c911-41d5-aaf2-a7a2d24465d9 tempest-ProjectMemberTests-186690331 None] Acquiring lock "cinder-quobyte-21567f8c-3d4b-4feb-a1c3-8847c151b309" by "delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:41:27 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-44fd02e4-c911-41d5-aaf2-a7a2d24465d9 tempest-ProjectMemberTests-186690331 None] Lock "cinder-quobyte-21567f8c-3d4b-4feb-a1c3-8847c151b309" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:41:27 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-44fd02e4-c911-41d5-aaf2-a7a2d24465d9 tempest-ProjectMemberTests-186690331 None] Acquiring lock "cinder-quobyte-46a0cd24-c492-427e-952d-9cde1b578780" by "_delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:41:27 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-44fd02e4-c911-41d5-aaf2-a7a2d24465d9 tempest-ProjectMemberTests-186690331 None] Lock "cinder-quobyte-46a0cd24-c492-427e-952d-9cde1b578780" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:41:27 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-44fd02e4-c911-41d5-aaf2-a7a2d24465d9 tempest-ProjectMemberTests-186690331 None] Deleting offline snapshot 46a0cd24-c492-427e-952d-9cde1b578780 of volume 21567f8c-3d4b-4feb-a1c3-8847c151b309 {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 09:41:27 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-44fd02e4-c911-41d5-aaf2-a7a2d24465d9 tempest-ProjectMemberTests-186690331 None] snapshot_file for this snap is: volume-21567f8c-3d4b-4feb-a1c3-8847c151b309.46a0cd24-c492-427e-952d-9cde1b578780 {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 09:41:27 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d7a476-81c5-4f24-a9dc-8133a5a3b75d]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:41:27 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-44fd02e4-c911-41d5-aaf2-a7a2d24465d9 tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-21567f8c-3d4b-4feb-a1c3-8847c151b309.46a0cd24-c492-427e-952d-9cde1b578780 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:27 devstack sudo[107796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-21567f8c-3d4b-4feb-a1c3-8847c151b309.46a0cd24-c492-427e-952d-9cde1b578780 Sep 28 09:41:27 devstack sudo[107796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:27 devstack sudo[107796]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:27 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-44fd02e4-c911-41d5-aaf2-a7a2d24465d9 tempest-ProjectMemberTests-186690331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-21567f8c-3d4b-4feb-a1c3-8847c151b309.46a0cd24-c492-427e-952d-9cde1b578780" returned: 0 in 0.373s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:27 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-44fd02e4-c911-41d5-aaf2-a7a2d24465d9 tempest-ProjectMemberTests-186690331 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21567f8c-3d4b-4feb-a1c3-8847c151b309(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86553) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 09:41:27 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[07632eae-6deb-441f-ad86-3fbd7134e83e]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:41:27 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-44fd02e4-c911-41d5-aaf2-a7a2d24465d9 tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-21567f8c-3d4b-4feb-a1c3-8847c151b309 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:27 devstack sudo[107801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-21567f8c-3d4b-4feb-a1c3-8847c151b309 Sep 28 09:41:27 devstack sudo[107801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:28 devstack sudo[107801]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:28 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-44fd02e4-c911-41d5-aaf2-a7a2d24465d9 tempest-ProjectMemberTests-186690331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-21567f8c-3d4b-4feb-a1c3-8847c151b309" returned: 0 in 0.373s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:28 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-44fd02e4-c911-41d5-aaf2-a7a2d24465d9 tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-21567f8c-3d4b-4feb-a1c3-8847c151b309.46a0cd24-c492-427e-952d-9cde1b578780 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:28 devstack sudo[107807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-21567f8c-3d4b-4feb-a1c3-8847c151b309.46a0cd24-c492-427e-952d-9cde1b578780 Sep 28 09:41:28 devstack sudo[107807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:28 devstack sudo[107807]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:28 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-44fd02e4-c911-41d5-aaf2-a7a2d24465d9 tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-21567f8c-3d4b-4feb-a1c3-8847c151b309.46a0cd24-c492-427e-952d-9cde1b578780" returned: 0 in 0.355s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:28 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-44fd02e4-c911-41d5-aaf2-a7a2d24465d9 tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-21567f8c-3d4b-4feb-a1c3-8847c151b309.46a0cd24-c492-427e-952d-9cde1b578780 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:28 devstack sudo[107812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-21567f8c-3d4b-4feb-a1c3-8847c151b309.46a0cd24-c492-427e-952d-9cde1b578780 Sep 28 09:41:28 devstack sudo[107812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:28 devstack sudo[107812]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:28 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-44fd02e4-c911-41d5-aaf2-a7a2d24465d9 tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-21567f8c-3d4b-4feb-a1c3-8847c151b309.46a0cd24-c492-427e-952d-9cde1b578780" returned: 0 in 0.265s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:28 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-44fd02e4-c911-41d5-aaf2-a7a2d24465d9 tempest-ProjectMemberTests-186690331 None] Lock "cinder-quobyte-46a0cd24-c492-427e-952d-9cde1b578780" released by "_delete_snapshot" :: held 1.484s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:41:28 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-44fd02e4-c911-41d5-aaf2-a7a2d24465d9 tempest-ProjectMemberTests-186690331 None] Lock "cinder-quobyte-21567f8c-3d4b-4feb-a1c3-8847c151b309" released by "delete_snapshot" :: held 1.510s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:41:28 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-44fd02e4-c911-41d5-aaf2-a7a2d24465d9 tempest-ProjectMemberTests-186690331 None] Created reservations ['35e876c9-cac4-4360-b230-9edc0fc478bf', 'd37b075a-e3a4-4c79-97e7-a595033018a8', '7395d3dd-9df0-45c6-a264-6c5906dccd3c', '1d724fd8-c602-4f30-bfe7-2ff88b01f47c'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:41:29 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-44fd02e4-c911-41d5-aaf2-a7a2d24465d9 tempest-ProjectMemberTests-186690331 None] Delete snapshot completed successfully. Sep 28 09:41:29 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-44fd02e4-c911-41d5-aaf2-a7a2d24465d9 tempest-ProjectMemberTests-186690331 None] Lock "cinder-46a0cd24-c492-427e-952d-9cde1b578780-delete_snapshot" released by "delete_snapshot" :: held 1.648s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:41:29 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-a6717a7f-0f64-4128-8e08-f614d331ddda tempest-ProjectMemberTests-186690331 None] Acquiring lock "cinder-21567f8c-3d4b-4feb-a1c3-8847c151b309-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:41:29 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-a6717a7f-0f64-4128-8e08-f614d331ddda tempest-ProjectMemberTests-186690331 None] Lock "cinder-21567f8c-3d4b-4feb-a1c3-8847c151b309-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:41:29 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-a6717a7f-0f64-4128-8e08-f614d331ddda tempest-ProjectMemberTests-186690331 None] Acquiring lock "cinder-quobyte-21567f8c-3d4b-4feb-a1c3-8847c151b309" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:41:29 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-a6717a7f-0f64-4128-8e08-f614d331ddda tempest-ProjectMemberTests-186690331 None] Lock "cinder-quobyte-21567f8c-3d4b-4feb-a1c3-8847c151b309" acquired by "delete_volume" :: waited 0.020s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:41:29 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bc41462-8e3f-4f53-a3b8-1f22b4d67d76 tempest-ProjectReaderTests-1128818246 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:41:29 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-3bc41462-8e3f-4f53-a3b8-1f22b4d67d76 tempest-ProjectReaderTests-1128818246 None] Flow 'volume_create_manager' (b57eb2fd-9a6c-49f7-a2ca-d3f0e8875ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:41:29 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-3bc41462-8e3f-4f53-a3b8-1f22b4d67d76 tempest-ProjectReaderTests-1128818246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0c161f1-c8ea-4d50-99ed-eaab35d13821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:29 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[3be10a61-38cd-43d6-b9ae-ec4f9604611b]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:41:29 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a6717a7f-0f64-4128-8e08-f614d331ddda tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-21567f8c-3d4b-4feb-a1c3-8847c151b309 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:29 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-3bc41462-8e3f-4f53-a3b8-1f22b4d67d76 tempest-ProjectReaderTests-1128818246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0c161f1-c8ea-4d50-99ed-eaab35d13821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:41:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-76324858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8a2fff9-2fac-4987-b6e7-6380bdd024c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0dcf5b1b00845ed9eabf4d8b49498f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:41:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:41:30Z,use_quota=True,user_id='289f96a422b64fc99acbae7951190a7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:29 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-3bc41462-8e3f-4f53-a3b8-1f22b4d67d76 tempest-ProjectReaderTests-1128818246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4cce359-184b-4772-8382-ba6435d3737f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:29 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-3bc41462-8e3f-4f53-a3b8-1f22b4d67d76 tempest-ProjectReaderTests-1128818246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4cce359-184b-4772-8382-ba6435d3737f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:29 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-3bc41462-8e3f-4f53-a3b8-1f22b4d67d76 tempest-ProjectReaderTests-1128818246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a733841-39da-43c4-b2de-c4a4d8225145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:29 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-3bc41462-8e3f-4f53-a3b8-1f22b4d67d76 tempest-ProjectReaderTests-1128818246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a733841-39da-43c4-b2de-c4a4d8225145) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8a2fff9-2fac-4987-b6e7-6380bdd024c8', 'volume_name': 'volume-a8a2fff9-2fac-4987-b6e7-6380bdd024c8', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:29 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-3bc41462-8e3f-4f53-a3b8-1f22b4d67d76 tempest-ProjectReaderTests-1128818246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d64d29f0-1617-49de-81ea-c39f2064f325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:29 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-3bc41462-8e3f-4f53-a3b8-1f22b4d67d76 tempest-ProjectReaderTests-1128818246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d64d29f0-1617-49de-81ea-c39f2064f325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:29 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-3bc41462-8e3f-4f53-a3b8-1f22b4d67d76 tempest-ProjectReaderTests-1128818246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dd950d3-7e26-4180-b862-d1ba113c3551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:29 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-3bc41462-8e3f-4f53-a3b8-1f22b4d67d76 tempest-ProjectReaderTests-1128818246 None] Volume a8a2fff9-2fac-4987-b6e7-6380bdd024c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8a2fff9-2fac-4987-b6e7-6380bdd024c8', 'volume_size': 1} Sep 28 09:41:29 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-3bc41462-8e3f-4f53-a3b8-1f22b4d67d76 tempest-ProjectReaderTests-1128818246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:41:29 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-3bc41462-8e3f-4f53-a3b8-1f22b4d67d76 tempest-ProjectReaderTests-1128818246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:41:29 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-3bc41462-8e3f-4f53-a3b8-1f22b4d67d76 tempest-ProjectReaderTests-1128818246 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:41:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-76324858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8a2fff9-2fac-4987-b6e7-6380bdd024c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0dcf5b1b00845ed9eabf4d8b49498f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:41:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:41:30Z,use_quota=True,user_id='289f96a422b64fc99acbae7951190a7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:41:29 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-3bc41462-8e3f-4f53-a3b8-1f22b4d67d76 tempest-ProjectReaderTests-1128818246 None] Creating volume a8a2fff9-2fac-4987-b6e7-6380bdd024c8 {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:41:29 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-3bc41462-8e3f-4f53-a3b8-1f22b4d67d76 tempest-ProjectReaderTests-1128818246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:41:29 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-3bc41462-8e3f-4f53-a3b8-1f22b4d67d76 tempest-ProjectReaderTests-1128818246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:41:29 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-3bc41462-8e3f-4f53-a3b8-1f22b4d67d76 tempest-ProjectReaderTests-1128818246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:41:29 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-3bc41462-8e3f-4f53-a3b8-1f22b4d67d76 tempest-ProjectReaderTests-1128818246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:41:29 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-3bc41462-8e3f-4f53-a3b8-1f22b4d67d76 tempest-ProjectReaderTests-1128818246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:41:29 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-3bc41462-8e3f-4f53-a3b8-1f22b4d67d76 tempest-ProjectReaderTests-1128818246 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:41:29 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-3bc41462-8e3f-4f53-a3b8-1f22b4d67d76 tempest-ProjectReaderTests-1128818246 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:41:29 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3bc41462-8e3f-4f53-a3b8-1f22b4d67d76 tempest-ProjectReaderTests-1128818246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a8a2fff9-2fac-4987-b6e7-6380bdd024c8 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:29 devstack sudo[107816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a8a2fff9-2fac-4987-b6e7-6380bdd024c8 1073741824 Sep 28 09:41:29 devstack sudo[107816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:29 devstack sudo[107815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-21567f8c-3d4b-4feb-a1c3-8847c151b309 Sep 28 09:41:29 devstack sudo[107815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:30 devstack sudo[107815]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a6717a7f-0f64-4128-8e08-f614d331ddda tempest-ProjectMemberTests-186690331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-21567f8c-3d4b-4feb-a1c3-8847c151b309" returned: 0 in 0.372s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a6717a7f-0f64-4128-8e08-f614d331ddda tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-21567f8c-3d4b-4feb-a1c3-8847c151b309 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:30 devstack sudo[107825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-21567f8c-3d4b-4feb-a1c3-8847c151b309 Sep 28 09:41:30 devstack sudo[107825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:30 devstack sudo[107816]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3bc41462-8e3f-4f53-a3b8-1f22b4d67d76 tempest-ProjectReaderTests-1128818246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a8a2fff9-2fac-4987-b6e7-6380bdd024c8 1073741824" returned: 0 in 0.442s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3bc41462-8e3f-4f53-a3b8-1f22b4d67d76 tempest-ProjectReaderTests-1128818246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a8a2fff9-2fac-4987-b6e7-6380bdd024c8 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:30 devstack sudo[107828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a8a2fff9-2fac-4987-b6e7-6380bdd024c8 Sep 28 09:41:30 devstack sudo[107828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:30 devstack sudo[107825]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a6717a7f-0f64-4128-8e08-f614d331ddda tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-21567f8c-3d4b-4feb-a1c3-8847c151b309" returned: 0 in 0.260s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:30 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-a6717a7f-0f64-4128-8e08-f614d331ddda tempest-ProjectMemberTests-186690331 None] Lock "cinder-quobyte-21567f8c-3d4b-4feb-a1c3-8847c151b309" released by "delete_volume" :: held 0.716s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:41:30 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-a6717a7f-0f64-4128-8e08-f614d331ddda tempest-ProjectMemberTests-186690331 None] Created reservations ['9cb51cd1-863b-4d1a-b3ea-17fd5bab3d5e', '3c8c7fbc-2a0e-4985-8f69-dddf5a5b2dac', '5b7ccbb2-03f2-4a84-b173-0607579a9c1b', 'c6de1f9b-61c5-4040-99ad-7f87db9c381a'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:41:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-a6717a7f-0f64-4128-8e08-f614d331ddda tempest-ProjectMemberTests-186690331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:41:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-a6717a7f-0f64-4128-8e08-f614d331ddda tempest-ProjectMemberTests-186690331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:41:30 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-a6717a7f-0f64-4128-8e08-f614d331ddda tempest-ProjectMemberTests-186690331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:41:30 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-a6717a7f-0f64-4128-8e08-f614d331ddda tempest-ProjectMemberTests-186690331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:41:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-a6717a7f-0f64-4128-8e08-f614d331ddda tempest-ProjectMemberTests-186690331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:41:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a6717a7f-0f64-4128-8e08-f614d331ddda tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:30 devstack sudo[107828]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:30 devstack sudo[107832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:41:30 devstack sudo[107832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3bc41462-8e3f-4f53-a3b8-1f22b4d67d76 tempest-ProjectReaderTests-1128818246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a8a2fff9-2fac-4987-b6e7-6380bdd024c8" returned: 0 in 0.264s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:30 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-3bc41462-8e3f-4f53-a3b8-1f22b4d67d76 tempest-ProjectReaderTests-1128818246 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:41:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-3bc41462-8e3f-4f53-a3b8-1f22b4d67d76 tempest-ProjectReaderTests-1128818246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:41:30 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-3bc41462-8e3f-4f53-a3b8-1f22b4d67d76 tempest-ProjectReaderTests-1128818246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dd950d3-7e26-4180-b862-d1ba113c3551) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8a2fff9-2fac-4987-b6e7-6380bdd024c8', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:30 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-3bc41462-8e3f-4f53-a3b8-1f22b4d67d76 tempest-ProjectReaderTests-1128818246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d514cb42-71f7-4605-a03e-235bf03784ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:30 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-3bc41462-8e3f-4f53-a3b8-1f22b4d67d76 tempest-ProjectReaderTests-1128818246 None] Volume volume-a8a2fff9-2fac-4987-b6e7-6380bdd024c8 (a8a2fff9-2fac-4987-b6e7-6380bdd024c8): created successfully Sep 28 09:41:30 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-3bc41462-8e3f-4f53-a3b8-1f22b4d67d76 tempest-ProjectReaderTests-1128818246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d514cb42-71f7-4605-a03e-235bf03784ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:30 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-3bc41462-8e3f-4f53-a3b8-1f22b4d67d76 tempest-ProjectReaderTests-1128818246 None] Flow 'volume_create_manager' (b57eb2fd-9a6c-49f7-a2ca-d3f0e8875ff4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:41:30 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-3bc41462-8e3f-4f53-a3b8-1f22b4d67d76 tempest-ProjectReaderTests-1128818246 None] Created volume successfully. Sep 28 09:41:30 devstack sudo[107832]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a6717a7f-0f64-4128-8e08-f614d331ddda tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.261s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:30 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-a6717a7f-0f64-4128-8e08-f614d331ddda tempest-ProjectMemberTests-186690331 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:41:30 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-a6717a7f-0f64-4128-8e08-f614d331ddda tempest-ProjectMemberTests-186690331 None] Deleted volume successfully. Sep 28 09:41:30 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-a6717a7f-0f64-4128-8e08-f614d331ddda tempest-ProjectMemberTests-186690331 None] Lock "cinder-21567f8c-3d4b-4feb-a1c3-8847c151b309-delete_volume" released by "delete_volume" :: held 1.193s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:41:31 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8214f0a-d069-437d-acf7-e05af81695df tempest-ProjectMemberTests-186690331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:41:31 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e8214f0a-d069-437d-acf7-e05af81695df tempest-ProjectMemberTests-186690331 None] Flow 'volume_create_manager' (00f0d3df-c2fd-49a8-8d38-475944d03614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:41:31 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e8214f0a-d069-437d-acf7-e05af81695df tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ec2f976-a9db-47d3-8725-c84ca2a89f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:31 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e8214f0a-d069-437d-acf7-e05af81695df tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ec2f976-a9db-47d3-8725-c84ca2a89f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:41:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-65736701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a35ec1c-3f39-4e71-829f-04cf543de405,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50c5ebfa35e84e1fa822f83efd2739e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:41:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:41:31Z,use_quota=True,user_id='029e33208bca4e258a762ad19e5ed78e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:31 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e8214f0a-d069-437d-acf7-e05af81695df tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68a8572d-1abf-49ea-a4fd-1404935abc9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:31 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e8214f0a-d069-437d-acf7-e05af81695df tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68a8572d-1abf-49ea-a4fd-1404935abc9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:31 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e8214f0a-d069-437d-acf7-e05af81695df tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb22634f-d4a5-4656-8767-ec1919120b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:31 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e8214f0a-d069-437d-acf7-e05af81695df tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb22634f-d4a5-4656-8767-ec1919120b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a35ec1c-3f39-4e71-829f-04cf543de405', 'volume_name': 'volume-1a35ec1c-3f39-4e71-829f-04cf543de405', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:31 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e8214f0a-d069-437d-acf7-e05af81695df tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ba890b2-9e32-4848-aefc-5522fb616206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:31 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e8214f0a-d069-437d-acf7-e05af81695df tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ba890b2-9e32-4848-aefc-5522fb616206) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:31 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e8214f0a-d069-437d-acf7-e05af81695df tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de911de6-eec8-47c6-88fb-82ad1d816522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:31 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-e8214f0a-d069-437d-acf7-e05af81695df tempest-ProjectMemberTests-186690331 None] Volume 1a35ec1c-3f39-4e71-829f-04cf543de405: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a35ec1c-3f39-4e71-829f-04cf543de405', 'volume_size': 1} Sep 28 09:41:31 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-e8214f0a-d069-437d-acf7-e05af81695df tempest-ProjectMemberTests-186690331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:41:31 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-e8214f0a-d069-437d-acf7-e05af81695df tempest-ProjectMemberTests-186690331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:41:31 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-e8214f0a-d069-437d-acf7-e05af81695df tempest-ProjectMemberTests-186690331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:41:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-65736701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a35ec1c-3f39-4e71-829f-04cf543de405,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50c5ebfa35e84e1fa822f83efd2739e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:41:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:41:31Z,use_quota=True,user_id='029e33208bca4e258a762ad19e5ed78e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:41:31 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-e8214f0a-d069-437d-acf7-e05af81695df tempest-ProjectMemberTests-186690331 None] Creating volume 1a35ec1c-3f39-4e71-829f-04cf543de405 {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:41:31 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-e8214f0a-d069-437d-acf7-e05af81695df tempest-ProjectMemberTests-186690331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:41:31 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-e8214f0a-d069-437d-acf7-e05af81695df tempest-ProjectMemberTests-186690331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:41:31 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-e8214f0a-d069-437d-acf7-e05af81695df tempest-ProjectMemberTests-186690331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:41:31 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-e8214f0a-d069-437d-acf7-e05af81695df tempest-ProjectMemberTests-186690331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:41:31 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-e8214f0a-d069-437d-acf7-e05af81695df tempest-ProjectMemberTests-186690331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:41:31 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-e8214f0a-d069-437d-acf7-e05af81695df tempest-ProjectMemberTests-186690331 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:41:31 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-e8214f0a-d069-437d-acf7-e05af81695df tempest-ProjectMemberTests-186690331 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:41:31 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e8214f0a-d069-437d-acf7-e05af81695df tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1a35ec1c-3f39-4e71-829f-04cf543de405 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:31 devstack sudo[107835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1a35ec1c-3f39-4e71-829f-04cf543de405 1073741824 Sep 28 09:41:31 devstack sudo[107835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:31 devstack sudo[107835]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:31 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e8214f0a-d069-437d-acf7-e05af81695df tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1a35ec1c-3f39-4e71-829f-04cf543de405 1073741824" returned: 0 in 0.455s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:31 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e8214f0a-d069-437d-acf7-e05af81695df tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1a35ec1c-3f39-4e71-829f-04cf543de405 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:31 devstack sudo[107847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1a35ec1c-3f39-4e71-829f-04cf543de405 Sep 28 09:41:31 devstack sudo[107847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:31 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-6660df34-95a1-4a7d-9952-d518c1982205 tempest-ProjectReaderTests-1128818246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:41:31 devstack sudo[107847]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:31 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e8214f0a-d069-437d-acf7-e05af81695df tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1a35ec1c-3f39-4e71-829f-04cf543de405" returned: 0 in 0.256s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:31 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-e8214f0a-d069-437d-acf7-e05af81695df tempest-ProjectMemberTests-186690331 None] <== create_volume: return (754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:41:31 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-e8214f0a-d069-437d-acf7-e05af81695df tempest-ProjectMemberTests-186690331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:41:31 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-6660df34-95a1-4a7d-9952-d518c1982205 tempest-ProjectReaderTests-1128818246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.087s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:41:31 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e8214f0a-d069-437d-acf7-e05af81695df tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de911de6-eec8-47c6-88fb-82ad1d816522) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a35ec1c-3f39-4e71-829f-04cf543de405', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:31 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e8214f0a-d069-437d-acf7-e05af81695df tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c5a858f-a2bf-4078-bfc2-4aa1a5e5752e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:31 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-6660df34-95a1-4a7d-9952-d518c1982205 tempest-ProjectReaderTests-1128818246 None] Creating offline snapshot bf9853c6-88eb-4549-b2d4-e814167db816 of volume a8a2fff9-2fac-4987-b6e7-6380bdd024c8 {{(pid=86553) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 09:41:31 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-e8214f0a-d069-437d-acf7-e05af81695df tempest-ProjectMemberTests-186690331 None] Volume volume-1a35ec1c-3f39-4e71-829f-04cf543de405 (1a35ec1c-3f39-4e71-829f-04cf543de405): created successfully Sep 28 09:41:31 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e8214f0a-d069-437d-acf7-e05af81695df tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c5a858f-a2bf-4078-bfc2-4aa1a5e5752e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:31 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e8214f0a-d069-437d-acf7-e05af81695df tempest-ProjectMemberTests-186690331 None] Flow 'volume_create_manager' (00f0d3df-c2fd-49a8-8d38-475944d03614) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:41:31 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b8c649-7f58-49e0-9a3e-9c847593f765]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:41:31 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-6660df34-95a1-4a7d-9952-d518c1982205 tempest-ProjectReaderTests-1128818246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a8a2fff9-2fac-4987-b6e7-6380bdd024c8 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:32 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-e8214f0a-d069-437d-acf7-e05af81695df tempest-ProjectMemberTests-186690331 None] Created volume successfully. Sep 28 09:41:32 devstack sudo[107850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a8a2fff9-2fac-4987-b6e7-6380bdd024c8 Sep 28 09:41:32 devstack sudo[107850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-43849d3a-e7cc-4504-8807-f54bbabfd0a7 tempest-ProjectMemberTests-186690331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:41:32 devstack sudo[107850]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-6660df34-95a1-4a7d-9952-d518c1982205 tempest-ProjectReaderTests-1128818246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a8a2fff9-2fac-4987-b6e7-6380bdd024c8" returned: 0 in 0.370s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-6660df34-95a1-4a7d-9952-d518c1982205 tempest-ProjectReaderTests-1128818246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a8a2fff9-2fac-4987-b6e7-6380bdd024c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a8a2fff9-2fac-4987-b6e7-6380bdd024c8.bf9853c6-88eb-4549-b2d4-e814167db816 1G {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:32 devstack sudo[107855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a8a2fff9-2fac-4987-b6e7-6380bdd024c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a8a2fff9-2fac-4987-b6e7-6380bdd024c8.bf9853c6-88eb-4549-b2d4-e814167db816 1G Sep 28 09:41:32 devstack sudo[107855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:32 devstack sudo[107855]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-6660df34-95a1-4a7d-9952-d518c1982205 tempest-ProjectReaderTests-1128818246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a8a2fff9-2fac-4987-b6e7-6380bdd024c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a8a2fff9-2fac-4987-b6e7-6380bdd024c8.bf9853c6-88eb-4549-b2d4-e814167db816 1G" returned: 0 in 0.390s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-6660df34-95a1-4a7d-9952-d518c1982205 tempest-ProjectReaderTests-1128818246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8a2fff9-2fac-4987-b6e7-6380bdd024c8 -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a8a2fff9-2fac-4987-b6e7-6380bdd024c8.bf9853c6-88eb-4549-b2d4-e814167db816 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:32 devstack sudo[107860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8a2fff9-2fac-4987-b6e7-6380bdd024c8 -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a8a2fff9-2fac-4987-b6e7-6380bdd024c8.bf9853c6-88eb-4549-b2d4-e814167db816 Sep 28 09:41:32 devstack sudo[107860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:33 devstack sudo[107860]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:33 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-6660df34-95a1-4a7d-9952-d518c1982205 tempest-ProjectReaderTests-1128818246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8a2fff9-2fac-4987-b6e7-6380bdd024c8 -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a8a2fff9-2fac-4987-b6e7-6380bdd024c8.bf9853c6-88eb-4549-b2d4-e814167db816" returned: 0 in 0.290s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:33 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-6660df34-95a1-4a7d-9952-d518c1982205 tempest-ProjectReaderTests-1128818246 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a8a2fff9-2fac-4987-b6e7-6380bdd024c8.bf9853c6-88eb-4549-b2d4-e814167db816 is being set with open permissions: ugo+rw Sep 28 09:41:33 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-6660df34-95a1-4a7d-9952-d518c1982205 tempest-ProjectReaderTests-1128818246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a8a2fff9-2fac-4987-b6e7-6380bdd024c8.bf9853c6-88eb-4549-b2d4-e814167db816 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:33 devstack sudo[107865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a8a2fff9-2fac-4987-b6e7-6380bdd024c8.bf9853c6-88eb-4549-b2d4-e814167db816 Sep 28 09:41:33 devstack sudo[107865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:33 devstack sudo[107865]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:33 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-6660df34-95a1-4a7d-9952-d518c1982205 tempest-ProjectReaderTests-1128818246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a8a2fff9-2fac-4987-b6e7-6380bdd024c8.bf9853c6-88eb-4549-b2d4-e814167db816" returned: 0 in 0.255s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:33 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-6660df34-95a1-4a7d-9952-d518c1982205 tempest-ProjectReaderTests-1128818246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a8a2fff9-2fac-4987-b6e7-6380bdd024c8.info {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:33 devstack sudo[107868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a8a2fff9-2fac-4987-b6e7-6380bdd024c8.info Sep 28 09:41:33 devstack sudo[107868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:33 devstack sudo[107868]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:33 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-6660df34-95a1-4a7d-9952-d518c1982205 tempest-ProjectReaderTests-1128818246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a8a2fff9-2fac-4987-b6e7-6380bdd024c8.info" returned: 0 in 0.260s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:33 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-6660df34-95a1-4a7d-9952-d518c1982205 tempest-ProjectReaderTests-1128818246 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a8a2fff9-2fac-4987-b6e7-6380bdd024c8.info is being set with open permissions: ugo+rw Sep 28 09:41:33 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-6660df34-95a1-4a7d-9952-d518c1982205 tempest-ProjectReaderTests-1128818246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a8a2fff9-2fac-4987-b6e7-6380bdd024c8.info {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:33 devstack sudo[107871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a8a2fff9-2fac-4987-b6e7-6380bdd024c8.info Sep 28 09:41:33 devstack sudo[107871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:33 devstack sudo[107871]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:33 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-6660df34-95a1-4a7d-9952-d518c1982205 tempest-ProjectReaderTests-1128818246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a8a2fff9-2fac-4987-b6e7-6380bdd024c8.info" returned: 0 in 0.246s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:33 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-6660df34-95a1-4a7d-9952-d518c1982205 tempest-ProjectReaderTests-1128818246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.926s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:41:33 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-43849d3a-e7cc-4504-8807-f54bbabfd0a7 tempest-ProjectMemberTests-186690331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.582s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:41:33 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-43849d3a-e7cc-4504-8807-f54bbabfd0a7 tempest-ProjectMemberTests-186690331 None] Creating offline snapshot 9eaed60a-99bb-486e-ab70-a1ee2bb7df9d of volume 1a35ec1c-3f39-4e71-829f-04cf543de405 {{(pid=86553) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 09:41:33 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-6660df34-95a1-4a7d-9952-d518c1982205 tempest-ProjectReaderTests-1128818246 None] Create snapshot completed successfully Sep 28 09:41:33 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaa00697-7887-454e-b37e-dfd9690253bd]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:41:33 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-43849d3a-e7cc-4504-8807-f54bbabfd0a7 tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1a35ec1c-3f39-4e71-829f-04cf543de405 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:34 devstack sudo[107874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1a35ec1c-3f39-4e71-829f-04cf543de405 Sep 28 09:41:34 devstack sudo[107874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:34 devstack sudo[107874]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:34 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-43849d3a-e7cc-4504-8807-f54bbabfd0a7 tempest-ProjectMemberTests-186690331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1a35ec1c-3f39-4e71-829f-04cf543de405" returned: 0 in 0.359s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:34 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-43849d3a-e7cc-4504-8807-f54bbabfd0a7 tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1a35ec1c-3f39-4e71-829f-04cf543de405,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1a35ec1c-3f39-4e71-829f-04cf543de405.9eaed60a-99bb-486e-ab70-a1ee2bb7df9d 1G {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:34 devstack sudo[107879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1a35ec1c-3f39-4e71-829f-04cf543de405,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1a35ec1c-3f39-4e71-829f-04cf543de405.9eaed60a-99bb-486e-ab70-a1ee2bb7df9d 1G Sep 28 09:41:34 devstack sudo[107879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:34 devstack sudo[107879]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:34 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-43849d3a-e7cc-4504-8807-f54bbabfd0a7 tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1a35ec1c-3f39-4e71-829f-04cf543de405,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1a35ec1c-3f39-4e71-829f-04cf543de405.9eaed60a-99bb-486e-ab70-a1ee2bb7df9d 1G" returned: 0 in 0.393s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:34 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-43849d3a-e7cc-4504-8807-f54bbabfd0a7 tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a35ec1c-3f39-4e71-829f-04cf543de405 -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1a35ec1c-3f39-4e71-829f-04cf543de405.9eaed60a-99bb-486e-ab70-a1ee2bb7df9d {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:34 devstack sudo[107884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a35ec1c-3f39-4e71-829f-04cf543de405 -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1a35ec1c-3f39-4e71-829f-04cf543de405.9eaed60a-99bb-486e-ab70-a1ee2bb7df9d Sep 28 09:41:34 devstack sudo[107884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:34 devstack sudo[107884]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:34 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-43849d3a-e7cc-4504-8807-f54bbabfd0a7 tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a35ec1c-3f39-4e71-829f-04cf543de405 -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1a35ec1c-3f39-4e71-829f-04cf543de405.9eaed60a-99bb-486e-ab70-a1ee2bb7df9d" returned: 0 in 0.296s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:34 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-43849d3a-e7cc-4504-8807-f54bbabfd0a7 tempest-ProjectMemberTests-186690331 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1a35ec1c-3f39-4e71-829f-04cf543de405.9eaed60a-99bb-486e-ab70-a1ee2bb7df9d is being set with open permissions: ugo+rw Sep 28 09:41:34 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-43849d3a-e7cc-4504-8807-f54bbabfd0a7 tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1a35ec1c-3f39-4e71-829f-04cf543de405.9eaed60a-99bb-486e-ab70-a1ee2bb7df9d {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:34 devstack sudo[107889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1a35ec1c-3f39-4e71-829f-04cf543de405.9eaed60a-99bb-486e-ab70-a1ee2bb7df9d Sep 28 09:41:34 devstack sudo[107889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:35 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-73bf3d56-d0ed-4da6-8eda-d23df10c2799 tempest-ProjectReaderTests-1128818246 None] Acquiring lock "cinder-bf9853c6-88eb-4549-b2d4-e814167db816-delete_snapshot" by "delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:41:35 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-73bf3d56-d0ed-4da6-8eda-d23df10c2799 tempest-ProjectReaderTests-1128818246 None] Lock "cinder-bf9853c6-88eb-4549-b2d4-e814167db816-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:41:35 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-73bf3d56-d0ed-4da6-8eda-d23df10c2799 tempest-ProjectReaderTests-1128818246 None] Acquiring lock "cinder-quobyte-a8a2fff9-2fac-4987-b6e7-6380bdd024c8" by "delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:41:35 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-73bf3d56-d0ed-4da6-8eda-d23df10c2799 tempest-ProjectReaderTests-1128818246 None] Lock "cinder-quobyte-a8a2fff9-2fac-4987-b6e7-6380bdd024c8" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:41:35 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-73bf3d56-d0ed-4da6-8eda-d23df10c2799 tempest-ProjectReaderTests-1128818246 None] Acquiring lock "cinder-quobyte-bf9853c6-88eb-4549-b2d4-e814167db816" by "_delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:41:35 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-73bf3d56-d0ed-4da6-8eda-d23df10c2799 tempest-ProjectReaderTests-1128818246 None] Lock "cinder-quobyte-bf9853c6-88eb-4549-b2d4-e814167db816" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:41:35 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-73bf3d56-d0ed-4da6-8eda-d23df10c2799 tempest-ProjectReaderTests-1128818246 None] Deleting offline snapshot bf9853c6-88eb-4549-b2d4-e814167db816 of volume a8a2fff9-2fac-4987-b6e7-6380bdd024c8 {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 09:41:35 devstack sudo[107889]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:35 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-73bf3d56-d0ed-4da6-8eda-d23df10c2799 tempest-ProjectReaderTests-1128818246 None] snapshot_file for this snap is: volume-a8a2fff9-2fac-4987-b6e7-6380bdd024c8.bf9853c6-88eb-4549-b2d4-e814167db816 {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 09:41:35 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-43849d3a-e7cc-4504-8807-f54bbabfd0a7 tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1a35ec1c-3f39-4e71-829f-04cf543de405.9eaed60a-99bb-486e-ab70-a1ee2bb7df9d" returned: 0 in 0.268s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:35 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[a08ce29d-7dec-4c1e-8683-96370412cda2]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:41:35 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-73bf3d56-d0ed-4da6-8eda-d23df10c2799 tempest-ProjectReaderTests-1128818246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a8a2fff9-2fac-4987-b6e7-6380bdd024c8.bf9853c6-88eb-4549-b2d4-e814167db816 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:35 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-43849d3a-e7cc-4504-8807-f54bbabfd0a7 tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1a35ec1c-3f39-4e71-829f-04cf543de405.info {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:35 devstack sudo[107893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1a35ec1c-3f39-4e71-829f-04cf543de405.info Sep 28 09:41:35 devstack sudo[107893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:35 devstack sudo[107892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a8a2fff9-2fac-4987-b6e7-6380bdd024c8.bf9853c6-88eb-4549-b2d4-e814167db816 Sep 28 09:41:35 devstack sudo[107892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:35 devstack sudo[107893]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:35 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-43849d3a-e7cc-4504-8807-f54bbabfd0a7 tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1a35ec1c-3f39-4e71-829f-04cf543de405.info" returned: 0 in 0.272s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:35 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-43849d3a-e7cc-4504-8807-f54bbabfd0a7 tempest-ProjectMemberTests-186690331 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1a35ec1c-3f39-4e71-829f-04cf543de405.info is being set with open permissions: ugo+rw Sep 28 09:41:35 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-43849d3a-e7cc-4504-8807-f54bbabfd0a7 tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1a35ec1c-3f39-4e71-829f-04cf543de405.info {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:35 devstack sudo[107899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1a35ec1c-3f39-4e71-829f-04cf543de405.info Sep 28 09:41:35 devstack sudo[107899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:35 devstack sudo[107892]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:35 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-73bf3d56-d0ed-4da6-8eda-d23df10c2799 tempest-ProjectReaderTests-1128818246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a8a2fff9-2fac-4987-b6e7-6380bdd024c8.bf9853c6-88eb-4549-b2d4-e814167db816" returned: 0 in 0.376s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:35 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-73bf3d56-d0ed-4da6-8eda-d23df10c2799 tempest-ProjectReaderTests-1128818246 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a8a2fff9-2fac-4987-b6e7-6380bdd024c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86553) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 09:41:35 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7535c13-c5c3-4c7a-adf7-5a9cb898dec5]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:41:35 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-73bf3d56-d0ed-4da6-8eda-d23df10c2799 tempest-ProjectReaderTests-1128818246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a8a2fff9-2fac-4987-b6e7-6380bdd024c8 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:35 devstack sudo[107902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a8a2fff9-2fac-4987-b6e7-6380bdd024c8 Sep 28 09:41:35 devstack sudo[107902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:35 devstack sudo[107899]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:35 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-43849d3a-e7cc-4504-8807-f54bbabfd0a7 tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1a35ec1c-3f39-4e71-829f-04cf543de405.info" returned: 0 in 0.259s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:35 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-43849d3a-e7cc-4504-8807-f54bbabfd0a7 tempest-ProjectMemberTests-186690331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.955s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:41:35 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-43849d3a-e7cc-4504-8807-f54bbabfd0a7 tempest-ProjectMemberTests-186690331 None] Create snapshot completed successfully Sep 28 09:41:36 devstack sudo[107902]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:36 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-73bf3d56-d0ed-4da6-8eda-d23df10c2799 tempest-ProjectReaderTests-1128818246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a8a2fff9-2fac-4987-b6e7-6380bdd024c8" returned: 0 in 0.355s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:36 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-73bf3d56-d0ed-4da6-8eda-d23df10c2799 tempest-ProjectReaderTests-1128818246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a8a2fff9-2fac-4987-b6e7-6380bdd024c8.bf9853c6-88eb-4549-b2d4-e814167db816 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:36 devstack sudo[107908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a8a2fff9-2fac-4987-b6e7-6380bdd024c8.bf9853c6-88eb-4549-b2d4-e814167db816 Sep 28 09:41:36 devstack sudo[107908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:36 devstack sudo[107908]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:36 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-73bf3d56-d0ed-4da6-8eda-d23df10c2799 tempest-ProjectReaderTests-1128818246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a8a2fff9-2fac-4987-b6e7-6380bdd024c8.bf9853c6-88eb-4549-b2d4-e814167db816" returned: 0 in 0.328s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:36 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-73bf3d56-d0ed-4da6-8eda-d23df10c2799 tempest-ProjectReaderTests-1128818246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a8a2fff9-2fac-4987-b6e7-6380bdd024c8.bf9853c6-88eb-4549-b2d4-e814167db816 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:36 devstack sudo[107914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a8a2fff9-2fac-4987-b6e7-6380bdd024c8.bf9853c6-88eb-4549-b2d4-e814167db816 Sep 28 09:41:36 devstack sudo[107914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:36 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-7c263562-d0d9-4d66-959b-47f116fe9e9a tempest-ProjectMemberTests-186690331 None] Acquiring lock "cinder-9eaed60a-99bb-486e-ab70-a1ee2bb7df9d-delete_snapshot" by "delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:41:36 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-7c263562-d0d9-4d66-959b-47f116fe9e9a tempest-ProjectMemberTests-186690331 None] Lock "cinder-9eaed60a-99bb-486e-ab70-a1ee2bb7df9d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:41:36 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-7c263562-d0d9-4d66-959b-47f116fe9e9a tempest-ProjectMemberTests-186690331 None] Acquiring lock "cinder-quobyte-1a35ec1c-3f39-4e71-829f-04cf543de405" by "delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:41:36 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-7c263562-d0d9-4d66-959b-47f116fe9e9a tempest-ProjectMemberTests-186690331 None] Lock "cinder-quobyte-1a35ec1c-3f39-4e71-829f-04cf543de405" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:41:36 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-7c263562-d0d9-4d66-959b-47f116fe9e9a tempest-ProjectMemberTests-186690331 None] Acquiring lock "cinder-quobyte-9eaed60a-99bb-486e-ab70-a1ee2bb7df9d" by "_delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:41:36 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-7c263562-d0d9-4d66-959b-47f116fe9e9a tempest-ProjectMemberTests-186690331 None] Lock "cinder-quobyte-9eaed60a-99bb-486e-ab70-a1ee2bb7df9d" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:41:36 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-7c263562-d0d9-4d66-959b-47f116fe9e9a tempest-ProjectMemberTests-186690331 None] Deleting offline snapshot 9eaed60a-99bb-486e-ab70-a1ee2bb7df9d of volume 1a35ec1c-3f39-4e71-829f-04cf543de405 {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 09:41:36 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-7c263562-d0d9-4d66-959b-47f116fe9e9a tempest-ProjectMemberTests-186690331 None] snapshot_file for this snap is: volume-1a35ec1c-3f39-4e71-829f-04cf543de405.9eaed60a-99bb-486e-ab70-a1ee2bb7df9d {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 09:41:36 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa32c87-7035-4b5a-b402-00e434a7c34d]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:41:36 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-7c263562-d0d9-4d66-959b-47f116fe9e9a tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1a35ec1c-3f39-4e71-829f-04cf543de405.9eaed60a-99bb-486e-ab70-a1ee2bb7df9d {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:36 devstack sudo[107914]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:36 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-73bf3d56-d0ed-4da6-8eda-d23df10c2799 tempest-ProjectReaderTests-1128818246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a8a2fff9-2fac-4987-b6e7-6380bdd024c8.bf9853c6-88eb-4549-b2d4-e814167db816" returned: 0 in 0.271s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:36 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-73bf3d56-d0ed-4da6-8eda-d23df10c2799 tempest-ProjectReaderTests-1128818246 None] Lock "cinder-quobyte-bf9853c6-88eb-4549-b2d4-e814167db816" released by "_delete_snapshot" :: held 1.451s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:41:36 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-73bf3d56-d0ed-4da6-8eda-d23df10c2799 tempest-ProjectReaderTests-1128818246 None] Lock "cinder-quobyte-a8a2fff9-2fac-4987-b6e7-6380bdd024c8" released by "delete_snapshot" :: held 1.470s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:41:36 devstack sudo[107917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1a35ec1c-3f39-4e71-829f-04cf543de405.9eaed60a-99bb-486e-ab70-a1ee2bb7df9d Sep 28 09:41:36 devstack sudo[107917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:36 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-73bf3d56-d0ed-4da6-8eda-d23df10c2799 tempest-ProjectReaderTests-1128818246 None] Created reservations ['ff8ebfdf-74b6-4dbd-bb22-aef5c2be8802', '4681cf64-86d3-4207-8a26-b190e0cef3a1', 'e6474270-ca9d-486f-b13a-d11e24d4b08d', '8f408f63-21d7-4061-8d95-0b21af8c850a'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:41:36 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-73bf3d56-d0ed-4da6-8eda-d23df10c2799 tempest-ProjectReaderTests-1128818246 None] Delete snapshot completed successfully. Sep 28 09:41:36 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-73bf3d56-d0ed-4da6-8eda-d23df10c2799 tempest-ProjectReaderTests-1128818246 None] Lock "cinder-bf9853c6-88eb-4549-b2d4-e814167db816-delete_snapshot" released by "delete_snapshot" :: held 1.618s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:41:36 devstack sudo[107917]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:36 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-7c263562-d0d9-4d66-959b-47f116fe9e9a tempest-ProjectMemberTests-186690331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1a35ec1c-3f39-4e71-829f-04cf543de405.9eaed60a-99bb-486e-ab70-a1ee2bb7df9d" returned: 0 in 0.377s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:36 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-7c263562-d0d9-4d66-959b-47f116fe9e9a tempest-ProjectMemberTests-186690331 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a35ec1c-3f39-4e71-829f-04cf543de405(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86553) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 09:41:36 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc30a330-8166-488b-b1eb-61e1806ef3e5]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:41:36 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-7c263562-d0d9-4d66-959b-47f116fe9e9a tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1a35ec1c-3f39-4e71-829f-04cf543de405 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:37 devstack sudo[107922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1a35ec1c-3f39-4e71-829f-04cf543de405 Sep 28 09:41:37 devstack sudo[107922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:37 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-68212a71-98b5-4fb7-a047-c973e5fd416d tempest-ProjectReaderTests-1128818246 None] Acquiring lock "cinder-a8a2fff9-2fac-4987-b6e7-6380bdd024c8-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:41:37 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-68212a71-98b5-4fb7-a047-c973e5fd416d tempest-ProjectReaderTests-1128818246 None] Lock "cinder-a8a2fff9-2fac-4987-b6e7-6380bdd024c8-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:41:37 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-68212a71-98b5-4fb7-a047-c973e5fd416d tempest-ProjectReaderTests-1128818246 None] Acquiring lock "cinder-quobyte-a8a2fff9-2fac-4987-b6e7-6380bdd024c8" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:41:37 devstack sudo[107922]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:37 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-7c263562-d0d9-4d66-959b-47f116fe9e9a tempest-ProjectMemberTests-186690331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1a35ec1c-3f39-4e71-829f-04cf543de405" returned: 0 in 0.399s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:37 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-7c263562-d0d9-4d66-959b-47f116fe9e9a tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1a35ec1c-3f39-4e71-829f-04cf543de405.9eaed60a-99bb-486e-ab70-a1ee2bb7df9d {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:37 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-68212a71-98b5-4fb7-a047-c973e5fd416d tempest-ProjectReaderTests-1128818246 None] Lock "cinder-quobyte-a8a2fff9-2fac-4987-b6e7-6380bdd024c8" acquired by "delete_volume" :: waited 0.025s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:41:37 devstack sudo[107928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1a35ec1c-3f39-4e71-829f-04cf543de405.9eaed60a-99bb-486e-ab70-a1ee2bb7df9d Sep 28 09:41:37 devstack sudo[107928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:37 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a07e16-a584-4067-b525-07dc19fd45d9]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:41:37 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-68212a71-98b5-4fb7-a047-c973e5fd416d tempest-ProjectReaderTests-1128818246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a8a2fff9-2fac-4987-b6e7-6380bdd024c8 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:37 devstack sudo[107930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a8a2fff9-2fac-4987-b6e7-6380bdd024c8 Sep 28 09:41:37 devstack sudo[107930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:37 devstack sudo[107928]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:37 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-7c263562-d0d9-4d66-959b-47f116fe9e9a tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1a35ec1c-3f39-4e71-829f-04cf543de405.9eaed60a-99bb-486e-ab70-a1ee2bb7df9d" returned: 0 in 0.327s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:37 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-7c263562-d0d9-4d66-959b-47f116fe9e9a tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1a35ec1c-3f39-4e71-829f-04cf543de405.9eaed60a-99bb-486e-ab70-a1ee2bb7df9d {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:37 devstack sudo[107935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1a35ec1c-3f39-4e71-829f-04cf543de405.9eaed60a-99bb-486e-ab70-a1ee2bb7df9d Sep 28 09:41:37 devstack sudo[107935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:37 devstack sudo[107930]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:37 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-68212a71-98b5-4fb7-a047-c973e5fd416d tempest-ProjectReaderTests-1128818246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a8a2fff9-2fac-4987-b6e7-6380bdd024c8" returned: 0 in 0.369s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:37 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-68212a71-98b5-4fb7-a047-c973e5fd416d tempest-ProjectReaderTests-1128818246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a8a2fff9-2fac-4987-b6e7-6380bdd024c8 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:37 devstack sudo[107940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a8a2fff9-2fac-4987-b6e7-6380bdd024c8 Sep 28 09:41:37 devstack sudo[107940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:37 devstack sudo[107935]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:37 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-7c263562-d0d9-4d66-959b-47f116fe9e9a tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1a35ec1c-3f39-4e71-829f-04cf543de405.9eaed60a-99bb-486e-ab70-a1ee2bb7df9d" returned: 0 in 0.256s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:37 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-7c263562-d0d9-4d66-959b-47f116fe9e9a tempest-ProjectMemberTests-186690331 None] Lock "cinder-quobyte-9eaed60a-99bb-486e-ab70-a1ee2bb7df9d" released by "_delete_snapshot" :: held 1.465s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:41:37 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-7c263562-d0d9-4d66-959b-47f116fe9e9a tempest-ProjectMemberTests-186690331 None] Lock "cinder-quobyte-1a35ec1c-3f39-4e71-829f-04cf543de405" released by "delete_snapshot" :: held 1.489s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:41:38 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-7c263562-d0d9-4d66-959b-47f116fe9e9a tempest-ProjectMemberTests-186690331 None] Created reservations ['4d23087f-6a46-42e2-8f41-fe11b79095c4', 'f8dae059-5d1a-499d-8189-96c29f4db07e', 'f506783a-740d-4191-ba8a-8470cf6b60a8', '40b3ea68-c64b-4076-bebd-63320b0b2c4d'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:41:38 devstack sudo[107940]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:38 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-68212a71-98b5-4fb7-a047-c973e5fd416d tempest-ProjectReaderTests-1128818246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-a8a2fff9-2fac-4987-b6e7-6380bdd024c8" returned: 0 in 0.259s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:38 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-68212a71-98b5-4fb7-a047-c973e5fd416d tempest-ProjectReaderTests-1128818246 None] Lock "cinder-quobyte-a8a2fff9-2fac-4987-b6e7-6380bdd024c8" released by "delete_volume" :: held 0.693s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:41:38 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-7c263562-d0d9-4d66-959b-47f116fe9e9a tempest-ProjectMemberTests-186690331 None] Delete snapshot completed successfully. Sep 28 09:41:38 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-7c263562-d0d9-4d66-959b-47f116fe9e9a tempest-ProjectMemberTests-186690331 None] Lock "cinder-9eaed60a-99bb-486e-ab70-a1ee2bb7df9d-delete_snapshot" released by "delete_snapshot" :: held 1.652s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:41:38 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-68212a71-98b5-4fb7-a047-c973e5fd416d tempest-ProjectReaderTests-1128818246 None] Created reservations ['e79259ff-1969-490c-92d3-315b6b9f77f7', '8dc6bd07-1226-4ef7-a3ee-619233934942', '58e69034-9202-4726-a734-c6e3b82ca832', 'ea0a19a4-44ba-4be2-b440-130a089db5c8'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:41:38 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-68212a71-98b5-4fb7-a047-c973e5fd416d tempest-ProjectReaderTests-1128818246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:41:38 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-68212a71-98b5-4fb7-a047-c973e5fd416d tempest-ProjectReaderTests-1128818246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:41:38 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-68212a71-98b5-4fb7-a047-c973e5fd416d tempest-ProjectReaderTests-1128818246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:41:38 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-68212a71-98b5-4fb7-a047-c973e5fd416d tempest-ProjectReaderTests-1128818246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:41:38 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-68212a71-98b5-4fb7-a047-c973e5fd416d tempest-ProjectReaderTests-1128818246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:41:38 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-68212a71-98b5-4fb7-a047-c973e5fd416d tempest-ProjectReaderTests-1128818246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:38 devstack sudo[107945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:41:38 devstack sudo[107945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:38 devstack sudo[107945]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:38 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-68212a71-98b5-4fb7-a047-c973e5fd416d tempest-ProjectReaderTests-1128818246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.249s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:38 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-68212a71-98b5-4fb7-a047-c973e5fd416d tempest-ProjectReaderTests-1128818246 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:41:38 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-68212a71-98b5-4fb7-a047-c973e5fd416d tempest-ProjectReaderTests-1128818246 None] Deleted volume successfully. Sep 28 09:41:38 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-68212a71-98b5-4fb7-a047-c973e5fd416d tempest-ProjectReaderTests-1128818246 None] Lock "cinder-a8a2fff9-2fac-4987-b6e7-6380bdd024c8-delete_volume" released by "delete_volume" :: held 1.173s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:41:38 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-aceaa2a3-129d-4fff-88fd-a8cb26c5970b tempest-ProjectMemberTests-186690331 None] Acquiring lock "cinder-1a35ec1c-3f39-4e71-829f-04cf543de405-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:41:38 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-aceaa2a3-129d-4fff-88fd-a8cb26c5970b tempest-ProjectMemberTests-186690331 None] Lock "cinder-1a35ec1c-3f39-4e71-829f-04cf543de405-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:41:38 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-aceaa2a3-129d-4fff-88fd-a8cb26c5970b tempest-ProjectMemberTests-186690331 None] Acquiring lock "cinder-quobyte-1a35ec1c-3f39-4e71-829f-04cf543de405" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:41:38 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-aceaa2a3-129d-4fff-88fd-a8cb26c5970b tempest-ProjectMemberTests-186690331 None] Lock "cinder-quobyte-1a35ec1c-3f39-4e71-829f-04cf543de405" acquired by "delete_volume" :: waited 0.018s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:41:38 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[3395c5eb-b1c3-4a44-8855-32ca24ab9af4]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:41:38 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-aceaa2a3-129d-4fff-88fd-a8cb26c5970b tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1a35ec1c-3f39-4e71-829f-04cf543de405 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:38 devstack sudo[107948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1a35ec1c-3f39-4e71-829f-04cf543de405 Sep 28 09:41:38 devstack sudo[107948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:38 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d45712e-cbf7-4221-8c83-eac46235f408 tempest-ProjectReaderTests-1128818246 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:41:38 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-4d45712e-cbf7-4221-8c83-eac46235f408 tempest-ProjectReaderTests-1128818246 None] Flow 'volume_create_manager' (a0132cb8-1030-425c-adef-10ee838bb748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:41:38 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-4d45712e-cbf7-4221-8c83-eac46235f408 tempest-ProjectReaderTests-1128818246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c26db7b5-e15c-45ec-a711-e003a04e71cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:38 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-4d45712e-cbf7-4221-8c83-eac46235f408 tempest-ProjectReaderTests-1128818246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c26db7b5-e15c-45ec-a711-e003a04e71cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:41:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1625762870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5e0892b-a14f-4bbb-ae4f-78f92f92fa58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0dcf5b1b00845ed9eabf4d8b49498f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:41:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:41:39Z,use_quota=True,user_id='289f96a422b64fc99acbae7951190a7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:38 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-4d45712e-cbf7-4221-8c83-eac46235f408 tempest-ProjectReaderTests-1128818246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (756bcbc2-3fc0-477a-a212-a1cb530a42d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:38 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-4d45712e-cbf7-4221-8c83-eac46235f408 tempest-ProjectReaderTests-1128818246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (756bcbc2-3fc0-477a-a212-a1cb530a42d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:39 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-4d45712e-cbf7-4221-8c83-eac46235f408 tempest-ProjectReaderTests-1128818246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9afa0784-1a37-4c95-9736-8e83c50a8fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:39 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-4d45712e-cbf7-4221-8c83-eac46235f408 tempest-ProjectReaderTests-1128818246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9afa0784-1a37-4c95-9736-8e83c50a8fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5e0892b-a14f-4bbb-ae4f-78f92f92fa58', 'volume_name': 'volume-c5e0892b-a14f-4bbb-ae4f-78f92f92fa58', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:39 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-4d45712e-cbf7-4221-8c83-eac46235f408 tempest-ProjectReaderTests-1128818246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de4b7e04-4730-4dd4-956e-75b0bcec1e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:39 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-4d45712e-cbf7-4221-8c83-eac46235f408 tempest-ProjectReaderTests-1128818246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de4b7e04-4730-4dd4-956e-75b0bcec1e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:39 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-4d45712e-cbf7-4221-8c83-eac46235f408 tempest-ProjectReaderTests-1128818246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef2ae5cb-b683-4804-8cb8-5b56f37132e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:39 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-4d45712e-cbf7-4221-8c83-eac46235f408 tempest-ProjectReaderTests-1128818246 None] Volume c5e0892b-a14f-4bbb-ae4f-78f92f92fa58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5e0892b-a14f-4bbb-ae4f-78f92f92fa58', 'volume_size': 1} Sep 28 09:41:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-4d45712e-cbf7-4221-8c83-eac46235f408 tempest-ProjectReaderTests-1128818246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:41:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-4d45712e-cbf7-4221-8c83-eac46235f408 tempest-ProjectReaderTests-1128818246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:41:39 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-4d45712e-cbf7-4221-8c83-eac46235f408 tempest-ProjectReaderTests-1128818246 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:41:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1625762870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5e0892b-a14f-4bbb-ae4f-78f92f92fa58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0dcf5b1b00845ed9eabf4d8b49498f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:41:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:41:39Z,use_quota=True,user_id='289f96a422b64fc99acbae7951190a7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:41:39 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-4d45712e-cbf7-4221-8c83-eac46235f408 tempest-ProjectReaderTests-1128818246 None] Creating volume c5e0892b-a14f-4bbb-ae4f-78f92f92fa58 {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:41:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-4d45712e-cbf7-4221-8c83-eac46235f408 tempest-ProjectReaderTests-1128818246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:41:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-4d45712e-cbf7-4221-8c83-eac46235f408 tempest-ProjectReaderTests-1128818246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:41:39 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-4d45712e-cbf7-4221-8c83-eac46235f408 tempest-ProjectReaderTests-1128818246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:41:39 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-4d45712e-cbf7-4221-8c83-eac46235f408 tempest-ProjectReaderTests-1128818246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:41:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-4d45712e-cbf7-4221-8c83-eac46235f408 tempest-ProjectReaderTests-1128818246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:41:39 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-4d45712e-cbf7-4221-8c83-eac46235f408 tempest-ProjectReaderTests-1128818246 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:41:39 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-4d45712e-cbf7-4221-8c83-eac46235f408 tempest-ProjectReaderTests-1128818246 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:41:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-4d45712e-cbf7-4221-8c83-eac46235f408 tempest-ProjectReaderTests-1128818246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c5e0892b-a14f-4bbb-ae4f-78f92f92fa58 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:39 devstack sudo[107950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c5e0892b-a14f-4bbb-ae4f-78f92f92fa58 1073741824 Sep 28 09:41:39 devstack sudo[107950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:39 devstack sudo[107948]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-aceaa2a3-129d-4fff-88fd-a8cb26c5970b tempest-ProjectMemberTests-186690331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1a35ec1c-3f39-4e71-829f-04cf543de405" returned: 0 in 0.379s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-aceaa2a3-129d-4fff-88fd-a8cb26c5970b tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1a35ec1c-3f39-4e71-829f-04cf543de405 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:39 devstack sudo[107955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1a35ec1c-3f39-4e71-829f-04cf543de405 Sep 28 09:41:39 devstack sudo[107955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:39 devstack sudo[107955]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-aceaa2a3-129d-4fff-88fd-a8cb26c5970b tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1a35ec1c-3f39-4e71-829f-04cf543de405" returned: 0 in 0.256s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:39 devstack sudo[107950]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-4d45712e-cbf7-4221-8c83-eac46235f408 tempest-ProjectReaderTests-1128818246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c5e0892b-a14f-4bbb-ae4f-78f92f92fa58 1073741824" returned: 0 in 0.420s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:39 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-aceaa2a3-129d-4fff-88fd-a8cb26c5970b tempest-ProjectMemberTests-186690331 None] Lock "cinder-quobyte-1a35ec1c-3f39-4e71-829f-04cf543de405" released by "delete_volume" :: held 0.720s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:41:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-4d45712e-cbf7-4221-8c83-eac46235f408 tempest-ProjectReaderTests-1128818246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c5e0892b-a14f-4bbb-ae4f-78f92f92fa58 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:39 devstack sudo[107961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c5e0892b-a14f-4bbb-ae4f-78f92f92fa58 Sep 28 09:41:39 devstack sudo[107961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:39 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-aceaa2a3-129d-4fff-88fd-a8cb26c5970b tempest-ProjectMemberTests-186690331 None] Created reservations ['ca5be17f-4906-44d7-ad3f-45236a0e1e13', '5da3ffdf-94f3-4266-8533-b3f52cd94bf6', 'a5142fcb-3c2c-435e-8ae2-aef160071dc5', 'fe63e251-ab13-4fa9-99a7-7caa4285e7ff'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:41:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-aceaa2a3-129d-4fff-88fd-a8cb26c5970b tempest-ProjectMemberTests-186690331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:41:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-aceaa2a3-129d-4fff-88fd-a8cb26c5970b tempest-ProjectMemberTests-186690331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:41:39 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-aceaa2a3-129d-4fff-88fd-a8cb26c5970b tempest-ProjectMemberTests-186690331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:41:39 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-aceaa2a3-129d-4fff-88fd-a8cb26c5970b tempest-ProjectMemberTests-186690331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:41:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-aceaa2a3-129d-4fff-88fd-a8cb26c5970b tempest-ProjectMemberTests-186690331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:41:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-aceaa2a3-129d-4fff-88fd-a8cb26c5970b tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:39 devstack sudo[107963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:41:39 devstack sudo[107963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:39 devstack sudo[107961]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-4d45712e-cbf7-4221-8c83-eac46235f408 tempest-ProjectReaderTests-1128818246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c5e0892b-a14f-4bbb-ae4f-78f92f92fa58" returned: 0 in 0.280s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:39 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-4d45712e-cbf7-4221-8c83-eac46235f408 tempest-ProjectReaderTests-1128818246 None] <== create_volume: return (755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:41:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-4d45712e-cbf7-4221-8c83-eac46235f408 tempest-ProjectReaderTests-1128818246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:41:39 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-4d45712e-cbf7-4221-8c83-eac46235f408 tempest-ProjectReaderTests-1128818246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef2ae5cb-b683-4804-8cb8-5b56f37132e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5e0892b-a14f-4bbb-ae4f-78f92f92fa58', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:39 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-4d45712e-cbf7-4221-8c83-eac46235f408 tempest-ProjectReaderTests-1128818246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b9096a5-7e1e-40b2-bc5c-d9d4eebb6c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:39 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-4d45712e-cbf7-4221-8c83-eac46235f408 tempest-ProjectReaderTests-1128818246 None] Volume volume-c5e0892b-a14f-4bbb-ae4f-78f92f92fa58 (c5e0892b-a14f-4bbb-ae4f-78f92f92fa58): created successfully Sep 28 09:41:39 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-4d45712e-cbf7-4221-8c83-eac46235f408 tempest-ProjectReaderTests-1128818246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b9096a5-7e1e-40b2-bc5c-d9d4eebb6c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:39 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-4d45712e-cbf7-4221-8c83-eac46235f408 tempest-ProjectReaderTests-1128818246 None] Flow 'volume_create_manager' (a0132cb8-1030-425c-adef-10ee838bb748) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:41:39 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-4d45712e-cbf7-4221-8c83-eac46235f408 tempest-ProjectReaderTests-1128818246 None] Created volume successfully. Sep 28 09:41:39 devstack sudo[107963]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:39 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-aceaa2a3-129d-4fff-88fd-a8cb26c5970b tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.284s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:39 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-aceaa2a3-129d-4fff-88fd-a8cb26c5970b tempest-ProjectMemberTests-186690331 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:41:39 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-aceaa2a3-129d-4fff-88fd-a8cb26c5970b tempest-ProjectMemberTests-186690331 None] Deleted volume successfully. Sep 28 09:41:39 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-aceaa2a3-129d-4fff-88fd-a8cb26c5970b tempest-ProjectMemberTests-186690331 None] Lock "cinder-1a35ec1c-3f39-4e71-829f-04cf543de405-delete_volume" released by "delete_volume" :: held 1.242s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:41:40 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-072179a2-99f8-420a-981e-1b6da396cfac tempest-ProjectReaderTests-1128818246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:41:40 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-072179a2-99f8-420a-981e-1b6da396cfac tempest-ProjectReaderTests-1128818246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:41:40 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-072179a2-99f8-420a-981e-1b6da396cfac tempest-ProjectReaderTests-1128818246 None] Creating offline snapshot 6ddbb392-e69c-4656-ab78-a5c6e0cd4783 of volume c5e0892b-a14f-4bbb-ae4f-78f92f92fa58 {{(pid=86553) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 09:41:40 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[a11c1f62-62ac-463c-88a7-0a6f7046fc69]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:41:40 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-072179a2-99f8-420a-981e-1b6da396cfac tempest-ProjectReaderTests-1128818246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c5e0892b-a14f-4bbb-ae4f-78f92f92fa58 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:40 devstack sudo[107967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c5e0892b-a14f-4bbb-ae4f-78f92f92fa58 Sep 28 09:41:40 devstack sudo[107967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:40 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccd58518-7560-4e11-bd09-5481da0c4d88 tempest-ProjectMemberTests-186690331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:41:40 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ccd58518-7560-4e11-bd09-5481da0c4d88 tempest-ProjectMemberTests-186690331 None] Flow 'volume_create_manager' (f83bfbf0-4e0e-49bc-90a4-dd543b81d9e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:41:40 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ccd58518-7560-4e11-bd09-5481da0c4d88 tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a3963d0-c68a-42b2-a342-5f031e14e718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:40 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ccd58518-7560-4e11-bd09-5481da0c4d88 tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a3963d0-c68a-42b2-a342-5f031e14e718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:41:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-523730702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afe526dc-7d96-4f05-90c2-b81c6740052b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50c5ebfa35e84e1fa822f83efd2739e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:41:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:41:40Z,use_quota=True,user_id='029e33208bca4e258a762ad19e5ed78e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:40 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ccd58518-7560-4e11-bd09-5481da0c4d88 tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16aaadcd-813d-44dc-be1b-36527c6e6fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:40 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ccd58518-7560-4e11-bd09-5481da0c4d88 tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16aaadcd-813d-44dc-be1b-36527c6e6fbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:40 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ccd58518-7560-4e11-bd09-5481da0c4d88 tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8488e19-8c54-4acd-a183-32bfdb28bc7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:40 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ccd58518-7560-4e11-bd09-5481da0c4d88 tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8488e19-8c54-4acd-a183-32bfdb28bc7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afe526dc-7d96-4f05-90c2-b81c6740052b', 'volume_name': 'volume-afe526dc-7d96-4f05-90c2-b81c6740052b', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:40 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ccd58518-7560-4e11-bd09-5481da0c4d88 tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9eb59f9-38c9-48a2-a50e-23d4d1cf28b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:40 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ccd58518-7560-4e11-bd09-5481da0c4d88 tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9eb59f9-38c9-48a2-a50e-23d4d1cf28b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:40 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ccd58518-7560-4e11-bd09-5481da0c4d88 tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93edb179-edff-44d0-bee8-371f3b5de015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:40 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-ccd58518-7560-4e11-bd09-5481da0c4d88 tempest-ProjectMemberTests-186690331 None] Volume afe526dc-7d96-4f05-90c2-b81c6740052b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afe526dc-7d96-4f05-90c2-b81c6740052b', 'volume_size': 1} Sep 28 09:41:40 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ccd58518-7560-4e11-bd09-5481da0c4d88 tempest-ProjectMemberTests-186690331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:41:40 devstack sudo[107967]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:40 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-072179a2-99f8-420a-981e-1b6da396cfac tempest-ProjectReaderTests-1128818246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c5e0892b-a14f-4bbb-ae4f-78f92f92fa58" returned: 0 in 0.368s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:40 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-072179a2-99f8-420a-981e-1b6da396cfac tempest-ProjectReaderTests-1128818246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c5e0892b-a14f-4bbb-ae4f-78f92f92fa58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c5e0892b-a14f-4bbb-ae4f-78f92f92fa58.6ddbb392-e69c-4656-ab78-a5c6e0cd4783 1G {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:40 devstack sudo[107972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c5e0892b-a14f-4bbb-ae4f-78f92f92fa58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c5e0892b-a14f-4bbb-ae4f-78f92f92fa58.6ddbb392-e69c-4656-ab78-a5c6e0cd4783 1G Sep 28 09:41:40 devstack sudo[107972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:40 devstack sudo[107972]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:40 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-072179a2-99f8-420a-981e-1b6da396cfac tempest-ProjectReaderTests-1128818246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c5e0892b-a14f-4bbb-ae4f-78f92f92fa58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c5e0892b-a14f-4bbb-ae4f-78f92f92fa58.6ddbb392-e69c-4656-ab78-a5c6e0cd4783 1G" returned: 0 in 0.387s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:40 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-072179a2-99f8-420a-981e-1b6da396cfac tempest-ProjectReaderTests-1128818246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5e0892b-a14f-4bbb-ae4f-78f92f92fa58 -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c5e0892b-a14f-4bbb-ae4f-78f92f92fa58.6ddbb392-e69c-4656-ab78-a5c6e0cd4783 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:40 devstack sudo[107977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5e0892b-a14f-4bbb-ae4f-78f92f92fa58 -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c5e0892b-a14f-4bbb-ae4f-78f92f92fa58.6ddbb392-e69c-4656-ab78-a5c6e0cd4783 Sep 28 09:41:40 devstack sudo[107977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:41 devstack sudo[107977]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-072179a2-99f8-420a-981e-1b6da396cfac tempest-ProjectReaderTests-1128818246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5e0892b-a14f-4bbb-ae4f-78f92f92fa58 -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c5e0892b-a14f-4bbb-ae4f-78f92f92fa58.6ddbb392-e69c-4656-ab78-a5c6e0cd4783" returned: 0 in 0.285s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:41 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-072179a2-99f8-420a-981e-1b6da396cfac tempest-ProjectReaderTests-1128818246 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c5e0892b-a14f-4bbb-ae4f-78f92f92fa58.6ddbb392-e69c-4656-ab78-a5c6e0cd4783 is being set with open permissions: ugo+rw Sep 28 09:41:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-072179a2-99f8-420a-981e-1b6da396cfac tempest-ProjectReaderTests-1128818246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c5e0892b-a14f-4bbb-ae4f-78f92f92fa58.6ddbb392-e69c-4656-ab78-a5c6e0cd4783 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:41 devstack sudo[107982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c5e0892b-a14f-4bbb-ae4f-78f92f92fa58.6ddbb392-e69c-4656-ab78-a5c6e0cd4783 Sep 28 09:41:41 devstack sudo[107982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:41 devstack sudo[107982]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-072179a2-99f8-420a-981e-1b6da396cfac tempest-ProjectReaderTests-1128818246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c5e0892b-a14f-4bbb-ae4f-78f92f92fa58.6ddbb392-e69c-4656-ab78-a5c6e0cd4783" returned: 0 in 0.257s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-072179a2-99f8-420a-981e-1b6da396cfac tempest-ProjectReaderTests-1128818246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c5e0892b-a14f-4bbb-ae4f-78f92f92fa58.info {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:41 devstack sudo[107985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c5e0892b-a14f-4bbb-ae4f-78f92f92fa58.info Sep 28 09:41:41 devstack sudo[107985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:41 devstack sudo[107985]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-072179a2-99f8-420a-981e-1b6da396cfac tempest-ProjectReaderTests-1128818246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c5e0892b-a14f-4bbb-ae4f-78f92f92fa58.info" returned: 0 in 0.259s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:41 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-072179a2-99f8-420a-981e-1b6da396cfac tempest-ProjectReaderTests-1128818246 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c5e0892b-a14f-4bbb-ae4f-78f92f92fa58.info is being set with open permissions: ugo+rw Sep 28 09:41:41 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-072179a2-99f8-420a-981e-1b6da396cfac tempest-ProjectReaderTests-1128818246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c5e0892b-a14f-4bbb-ae4f-78f92f92fa58.info {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:41 devstack sudo[107988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c5e0892b-a14f-4bbb-ae4f-78f92f92fa58.info Sep 28 09:41:41 devstack sudo[107988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:41 devstack sudo[107988]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-072179a2-99f8-420a-981e-1b6da396cfac tempest-ProjectReaderTests-1128818246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c5e0892b-a14f-4bbb-ae4f-78f92f92fa58.info" returned: 0 in 0.242s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-072179a2-99f8-420a-981e-1b6da396cfac tempest-ProjectReaderTests-1128818246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.887s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:41:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ccd58518-7560-4e11-bd09-5481da0c4d88 tempest-ProjectMemberTests-186690331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.632s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:41:42 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ccd58518-7560-4e11-bd09-5481da0c4d88 tempest-ProjectMemberTests-186690331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:41:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-523730702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afe526dc-7d96-4f05-90c2-b81c6740052b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50c5ebfa35e84e1fa822f83efd2739e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:41:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:41:40Z,use_quota=True,user_id='029e33208bca4e258a762ad19e5ed78e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:41:42 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-ccd58518-7560-4e11-bd09-5481da0c4d88 tempest-ProjectMemberTests-186690331 None] Creating volume afe526dc-7d96-4f05-90c2-b81c6740052b {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:41:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ccd58518-7560-4e11-bd09-5481da0c4d88 tempest-ProjectMemberTests-186690331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:41:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ccd58518-7560-4e11-bd09-5481da0c4d88 tempest-ProjectMemberTests-186690331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:41:42 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ccd58518-7560-4e11-bd09-5481da0c4d88 tempest-ProjectMemberTests-186690331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:41:42 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ccd58518-7560-4e11-bd09-5481da0c4d88 tempest-ProjectMemberTests-186690331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:41:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ccd58518-7560-4e11-bd09-5481da0c4d88 tempest-ProjectMemberTests-186690331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:41:42 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ccd58518-7560-4e11-bd09-5481da0c4d88 tempest-ProjectMemberTests-186690331 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:41:42 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-ccd58518-7560-4e11-bd09-5481da0c4d88 tempest-ProjectMemberTests-186690331 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:41:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ccd58518-7560-4e11-bd09-5481da0c4d88 tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-afe526dc-7d96-4f05-90c2-b81c6740052b 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:42 devstack sudo[107991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-afe526dc-7d96-4f05-90c2-b81c6740052b 1073741824 Sep 28 09:41:42 devstack sudo[107991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:42 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-072179a2-99f8-420a-981e-1b6da396cfac tempest-ProjectReaderTests-1128818246 None] Create snapshot completed successfully Sep 28 09:41:42 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-fbdb8a67-9c80-4e08-b663-8910096ad1bc tempest-ProjectReaderTests-1128818246 None] Acquiring lock "cinder-6ddbb392-e69c-4656-ab78-a5c6e0cd4783-delete_snapshot" by "delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:41:42 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-fbdb8a67-9c80-4e08-b663-8910096ad1bc tempest-ProjectReaderTests-1128818246 None] Lock "cinder-6ddbb392-e69c-4656-ab78-a5c6e0cd4783-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:41:42 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-fbdb8a67-9c80-4e08-b663-8910096ad1bc tempest-ProjectReaderTests-1128818246 None] Acquiring lock "cinder-quobyte-c5e0892b-a14f-4bbb-ae4f-78f92f92fa58" by "delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:41:42 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-fbdb8a67-9c80-4e08-b663-8910096ad1bc tempest-ProjectReaderTests-1128818246 None] Lock "cinder-quobyte-c5e0892b-a14f-4bbb-ae4f-78f92f92fa58" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:41:42 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-fbdb8a67-9c80-4e08-b663-8910096ad1bc tempest-ProjectReaderTests-1128818246 None] Acquiring lock "cinder-quobyte-6ddbb392-e69c-4656-ab78-a5c6e0cd4783" by "_delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:41:42 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-fbdb8a67-9c80-4e08-b663-8910096ad1bc tempest-ProjectReaderTests-1128818246 None] Lock "cinder-quobyte-6ddbb392-e69c-4656-ab78-a5c6e0cd4783" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:41:42 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-fbdb8a67-9c80-4e08-b663-8910096ad1bc tempest-ProjectReaderTests-1128818246 None] Deleting offline snapshot 6ddbb392-e69c-4656-ab78-a5c6e0cd4783 of volume c5e0892b-a14f-4bbb-ae4f-78f92f92fa58 {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 09:41:42 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-fbdb8a67-9c80-4e08-b663-8910096ad1bc tempest-ProjectReaderTests-1128818246 None] snapshot_file for this snap is: volume-c5e0892b-a14f-4bbb-ae4f-78f92f92fa58.6ddbb392-e69c-4656-ab78-a5c6e0cd4783 {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 09:41:42 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca2ed26b-6b29-4d38-b9f8-155b498c3727]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:41:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-fbdb8a67-9c80-4e08-b663-8910096ad1bc tempest-ProjectReaderTests-1128818246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c5e0892b-a14f-4bbb-ae4f-78f92f92fa58.6ddbb392-e69c-4656-ab78-a5c6e0cd4783 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:42 devstack sudo[107996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c5e0892b-a14f-4bbb-ae4f-78f92f92fa58.6ddbb392-e69c-4656-ab78-a5c6e0cd4783 Sep 28 09:41:42 devstack sudo[107996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:42 devstack sudo[107991]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ccd58518-7560-4e11-bd09-5481da0c4d88 tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-afe526dc-7d96-4f05-90c2-b81c6740052b 1073741824" returned: 0 in 0.472s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ccd58518-7560-4e11-bd09-5481da0c4d88 tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-afe526dc-7d96-4f05-90c2-b81c6740052b {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:42 devstack sudo[107998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-afe526dc-7d96-4f05-90c2-b81c6740052b Sep 28 09:41:42 devstack sudo[107998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:42 devstack sudo[107996]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-fbdb8a67-9c80-4e08-b663-8910096ad1bc tempest-ProjectReaderTests-1128818246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c5e0892b-a14f-4bbb-ae4f-78f92f92fa58.6ddbb392-e69c-4656-ab78-a5c6e0cd4783" returned: 0 in 0.394s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:42 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-fbdb8a67-9c80-4e08-b663-8910096ad1bc tempest-ProjectReaderTests-1128818246 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5e0892b-a14f-4bbb-ae4f-78f92f92fa58(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86553) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 09:41:42 devstack sudo[107998]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:42 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[c94d15c7-d57d-4329-96c7-a4d92eb7db24]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:41:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-fbdb8a67-9c80-4e08-b663-8910096ad1bc tempest-ProjectReaderTests-1128818246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c5e0892b-a14f-4bbb-ae4f-78f92f92fa58 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ccd58518-7560-4e11-bd09-5481da0c4d88 tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-afe526dc-7d96-4f05-90c2-b81c6740052b" returned: 0 in 0.272s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:42 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ccd58518-7560-4e11-bd09-5481da0c4d88 tempest-ProjectMemberTests-186690331 None] <== create_volume: return (786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:41:42 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ccd58518-7560-4e11-bd09-5481da0c4d88 tempest-ProjectMemberTests-186690331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:41:42 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ccd58518-7560-4e11-bd09-5481da0c4d88 tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93edb179-edff-44d0-bee8-371f3b5de015) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afe526dc-7d96-4f05-90c2-b81c6740052b', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:42 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ccd58518-7560-4e11-bd09-5481da0c4d88 tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (560f0d57-16f9-4649-ba8e-d67de3ee7a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:42 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-ccd58518-7560-4e11-bd09-5481da0c4d88 tempest-ProjectMemberTests-186690331 None] Volume volume-afe526dc-7d96-4f05-90c2-b81c6740052b (afe526dc-7d96-4f05-90c2-b81c6740052b): created successfully Sep 28 09:41:42 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ccd58518-7560-4e11-bd09-5481da0c4d88 tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (560f0d57-16f9-4649-ba8e-d67de3ee7a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:42 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ccd58518-7560-4e11-bd09-5481da0c4d88 tempest-ProjectMemberTests-186690331 None] Flow 'volume_create_manager' (f83bfbf0-4e0e-49bc-90a4-dd543b81d9e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:41:42 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-ccd58518-7560-4e11-bd09-5481da0c4d88 tempest-ProjectMemberTests-186690331 None] Created volume successfully. Sep 28 09:41:42 devstack sudo[108004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c5e0892b-a14f-4bbb-ae4f-78f92f92fa58 Sep 28 09:41:42 devstack sudo[108004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:43 devstack sudo[108004]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:43 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-fbdb8a67-9c80-4e08-b663-8910096ad1bc tempest-ProjectReaderTests-1128818246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c5e0892b-a14f-4bbb-ae4f-78f92f92fa58" returned: 0 in 0.361s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:43 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-fbdb8a67-9c80-4e08-b663-8910096ad1bc tempest-ProjectReaderTests-1128818246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c5e0892b-a14f-4bbb-ae4f-78f92f92fa58.6ddbb392-e69c-4656-ab78-a5c6e0cd4783 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:43 devstack sudo[108010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c5e0892b-a14f-4bbb-ae4f-78f92f92fa58.6ddbb392-e69c-4656-ab78-a5c6e0cd4783 Sep 28 09:41:43 devstack sudo[108010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:43 devstack sudo[108010]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:43 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-fbdb8a67-9c80-4e08-b663-8910096ad1bc tempest-ProjectReaderTests-1128818246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c5e0892b-a14f-4bbb-ae4f-78f92f92fa58.6ddbb392-e69c-4656-ab78-a5c6e0cd4783" returned: 0 in 0.358s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:43 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-fbdb8a67-9c80-4e08-b663-8910096ad1bc tempest-ProjectReaderTests-1128818246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c5e0892b-a14f-4bbb-ae4f-78f92f92fa58.6ddbb392-e69c-4656-ab78-a5c6e0cd4783 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:43 devstack sudo[108015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c5e0892b-a14f-4bbb-ae4f-78f92f92fa58.6ddbb392-e69c-4656-ab78-a5c6e0cd4783 Sep 28 09:41:43 devstack sudo[108015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:43 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-b32d9b01-784d-4a5b-a4c5-3481daa31755 tempest-ProjectMemberTests-186690331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:41:43 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-b32d9b01-784d-4a5b-a4c5-3481daa31755 tempest-ProjectMemberTests-186690331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:41:43 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-b32d9b01-784d-4a5b-a4c5-3481daa31755 tempest-ProjectMemberTests-186690331 None] Creating offline snapshot 0e40db16-8239-4cab-9fcc-01cdb657f052 of volume afe526dc-7d96-4f05-90c2-b81c6740052b {{(pid=86553) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 09:41:43 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[3641d4ca-e338-449a-b6a1-babff4e6e9a4]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:41:43 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b32d9b01-784d-4a5b-a4c5-3481daa31755 tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-afe526dc-7d96-4f05-90c2-b81c6740052b {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:43 devstack sudo[108015]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:43 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-fbdb8a67-9c80-4e08-b663-8910096ad1bc tempest-ProjectReaderTests-1128818246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c5e0892b-a14f-4bbb-ae4f-78f92f92fa58.6ddbb392-e69c-4656-ab78-a5c6e0cd4783" returned: 0 in 0.274s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:43 devstack sudo[108017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-afe526dc-7d96-4f05-90c2-b81c6740052b Sep 28 09:41:43 devstack sudo[108017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:43 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-fbdb8a67-9c80-4e08-b663-8910096ad1bc tempest-ProjectReaderTests-1128818246 None] Lock "cinder-quobyte-6ddbb392-e69c-4656-ab78-a5c6e0cd4783" released by "_delete_snapshot" :: held 1.499s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:41:43 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-fbdb8a67-9c80-4e08-b663-8910096ad1bc tempest-ProjectReaderTests-1128818246 None] Lock "cinder-quobyte-c5e0892b-a14f-4bbb-ae4f-78f92f92fa58" released by "delete_snapshot" :: held 1.527s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:41:43 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-fbdb8a67-9c80-4e08-b663-8910096ad1bc tempest-ProjectReaderTests-1128818246 None] Created reservations ['a0160ffd-98f1-48e7-828c-c2814340fa63', 'f2342255-8249-4916-b0ee-e937da1b99b9', '060116b6-a9ce-44cd-afc5-40de88c85f75', 'ad3f9ed5-8bc4-4d9b-b256-3da4bbdc714c'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:41:43 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-fbdb8a67-9c80-4e08-b663-8910096ad1bc tempest-ProjectReaderTests-1128818246 None] Delete snapshot completed successfully. Sep 28 09:41:44 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-fbdb8a67-9c80-4e08-b663-8910096ad1bc tempest-ProjectReaderTests-1128818246 None] Lock "cinder-6ddbb392-e69c-4656-ab78-a5c6e0cd4783-delete_snapshot" released by "delete_snapshot" :: held 1.715s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:41:44 devstack sudo[108017]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b32d9b01-784d-4a5b-a4c5-3481daa31755 tempest-ProjectMemberTests-186690331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-afe526dc-7d96-4f05-90c2-b81c6740052b" returned: 0 in 0.388s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b32d9b01-784d-4a5b-a4c5-3481daa31755 tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-afe526dc-7d96-4f05-90c2-b81c6740052b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-afe526dc-7d96-4f05-90c2-b81c6740052b.0e40db16-8239-4cab-9fcc-01cdb657f052 1G {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:44 devstack sudo[108023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-afe526dc-7d96-4f05-90c2-b81c6740052b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-afe526dc-7d96-4f05-90c2-b81c6740052b.0e40db16-8239-4cab-9fcc-01cdb657f052 1G Sep 28 09:41:44 devstack sudo[108023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:44 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-672bb6b7-e630-4786-a37b-cd4f40cfe6b9 tempest-ProjectReaderTests-1128818246 None] Acquiring lock "cinder-c5e0892b-a14f-4bbb-ae4f-78f92f92fa58-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:41:44 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-672bb6b7-e630-4786-a37b-cd4f40cfe6b9 tempest-ProjectReaderTests-1128818246 None] Lock "cinder-c5e0892b-a14f-4bbb-ae4f-78f92f92fa58-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:41:44 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-672bb6b7-e630-4786-a37b-cd4f40cfe6b9 tempest-ProjectReaderTests-1128818246 None] Acquiring lock "cinder-quobyte-c5e0892b-a14f-4bbb-ae4f-78f92f92fa58" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:41:44 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-672bb6b7-e630-4786-a37b-cd4f40cfe6b9 tempest-ProjectReaderTests-1128818246 None] Lock "cinder-quobyte-c5e0892b-a14f-4bbb-ae4f-78f92f92fa58" acquired by "delete_volume" :: waited 0.016s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:41:44 devstack sudo[108023]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b32d9b01-784d-4a5b-a4c5-3481daa31755 tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-afe526dc-7d96-4f05-90c2-b81c6740052b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-afe526dc-7d96-4f05-90c2-b81c6740052b.0e40db16-8239-4cab-9fcc-01cdb657f052 1G" returned: 0 in 0.456s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b32d9b01-784d-4a5b-a4c5-3481daa31755 tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afe526dc-7d96-4f05-90c2-b81c6740052b -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-afe526dc-7d96-4f05-90c2-b81c6740052b.0e40db16-8239-4cab-9fcc-01cdb657f052 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:44 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[20875294-73f8-4957-b712-478cb2220ac0]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:41:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-672bb6b7-e630-4786-a37b-cd4f40cfe6b9 tempest-ProjectReaderTests-1128818246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c5e0892b-a14f-4bbb-ae4f-78f92f92fa58 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:44 devstack sudo[108030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afe526dc-7d96-4f05-90c2-b81c6740052b -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-afe526dc-7d96-4f05-90c2-b81c6740052b.0e40db16-8239-4cab-9fcc-01cdb657f052 Sep 28 09:41:44 devstack sudo[108030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:44 devstack sudo[108031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c5e0892b-a14f-4bbb-ae4f-78f92f92fa58 Sep 28 09:41:44 devstack sudo[108031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:44 devstack sudo[108030]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b32d9b01-784d-4a5b-a4c5-3481daa31755 tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afe526dc-7d96-4f05-90c2-b81c6740052b -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-afe526dc-7d96-4f05-90c2-b81c6740052b.0e40db16-8239-4cab-9fcc-01cdb657f052" returned: 0 in 0.315s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:44 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-b32d9b01-784d-4a5b-a4c5-3481daa31755 tempest-ProjectMemberTests-186690331 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-afe526dc-7d96-4f05-90c2-b81c6740052b.0e40db16-8239-4cab-9fcc-01cdb657f052 is being set with open permissions: ugo+rw Sep 28 09:41:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b32d9b01-784d-4a5b-a4c5-3481daa31755 tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-afe526dc-7d96-4f05-90c2-b81c6740052b.0e40db16-8239-4cab-9fcc-01cdb657f052 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:44 devstack sudo[108037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-afe526dc-7d96-4f05-90c2-b81c6740052b.0e40db16-8239-4cab-9fcc-01cdb657f052 Sep 28 09:41:44 devstack sudo[108037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:44 devstack sudo[108031]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-672bb6b7-e630-4786-a37b-cd4f40cfe6b9 tempest-ProjectReaderTests-1128818246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c5e0892b-a14f-4bbb-ae4f-78f92f92fa58" returned: 0 in 0.398s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:44 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-672bb6b7-e630-4786-a37b-cd4f40cfe6b9 tempest-ProjectReaderTests-1128818246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c5e0892b-a14f-4bbb-ae4f-78f92f92fa58 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:44 devstack sudo[108042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c5e0892b-a14f-4bbb-ae4f-78f92f92fa58 Sep 28 09:41:44 devstack sudo[108042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:45 devstack sudo[108037]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:45 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b32d9b01-784d-4a5b-a4c5-3481daa31755 tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-afe526dc-7d96-4f05-90c2-b81c6740052b.0e40db16-8239-4cab-9fcc-01cdb657f052" returned: 0 in 0.266s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:45 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b32d9b01-784d-4a5b-a4c5-3481daa31755 tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-afe526dc-7d96-4f05-90c2-b81c6740052b.info {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:45 devstack sudo[108045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-afe526dc-7d96-4f05-90c2-b81c6740052b.info Sep 28 09:41:45 devstack sudo[108045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:45 devstack sudo[108042]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:45 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-672bb6b7-e630-4786-a37b-cd4f40cfe6b9 tempest-ProjectReaderTests-1128818246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-c5e0892b-a14f-4bbb-ae4f-78f92f92fa58" returned: 0 in 0.262s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:45 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-672bb6b7-e630-4786-a37b-cd4f40cfe6b9 tempest-ProjectReaderTests-1128818246 None] Lock "cinder-quobyte-c5e0892b-a14f-4bbb-ae4f-78f92f92fa58" released by "delete_volume" :: held 0.730s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:41:45 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-672bb6b7-e630-4786-a37b-cd4f40cfe6b9 tempest-ProjectReaderTests-1128818246 None] Created reservations ['38559711-1b7c-4786-bb4d-c77b8006c254', '89ddc37a-0a9e-4800-91cb-ed51cb933dd6', '3a9df541-cbc3-43b5-b33f-d798374bac23', 'b79d9577-34c8-4c72-884c-88fe738f2ec6'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:41:45 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-672bb6b7-e630-4786-a37b-cd4f40cfe6b9 tempest-ProjectReaderTests-1128818246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:41:45 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-672bb6b7-e630-4786-a37b-cd4f40cfe6b9 tempest-ProjectReaderTests-1128818246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:41:45 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-672bb6b7-e630-4786-a37b-cd4f40cfe6b9 tempest-ProjectReaderTests-1128818246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:41:45 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-672bb6b7-e630-4786-a37b-cd4f40cfe6b9 tempest-ProjectReaderTests-1128818246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:41:45 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-672bb6b7-e630-4786-a37b-cd4f40cfe6b9 tempest-ProjectReaderTests-1128818246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:41:45 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-672bb6b7-e630-4786-a37b-cd4f40cfe6b9 tempest-ProjectReaderTests-1128818246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:45 devstack sudo[108045]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:45 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b32d9b01-784d-4a5b-a4c5-3481daa31755 tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-afe526dc-7d96-4f05-90c2-b81c6740052b.info" returned: 0 in 0.295s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:45 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-b32d9b01-784d-4a5b-a4c5-3481daa31755 tempest-ProjectMemberTests-186690331 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-afe526dc-7d96-4f05-90c2-b81c6740052b.info is being set with open permissions: ugo+rw Sep 28 09:41:45 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b32d9b01-784d-4a5b-a4c5-3481daa31755 tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-afe526dc-7d96-4f05-90c2-b81c6740052b.info {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:45 devstack sudo[108049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:41:45 devstack sudo[108049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:45 devstack sudo[108050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-afe526dc-7d96-4f05-90c2-b81c6740052b.info Sep 28 09:41:45 devstack sudo[108050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:45 devstack sudo[108049]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:45 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-672bb6b7-e630-4786-a37b-cd4f40cfe6b9 tempest-ProjectReaderTests-1128818246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.277s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:45 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-672bb6b7-e630-4786-a37b-cd4f40cfe6b9 tempest-ProjectReaderTests-1128818246 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:41:45 devstack sudo[108050]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:45 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-b32d9b01-784d-4a5b-a4c5-3481daa31755 tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-afe526dc-7d96-4f05-90c2-b81c6740052b.info" returned: 0 in 0.271s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:45 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-b32d9b01-784d-4a5b-a4c5-3481daa31755 tempest-ProjectMemberTests-186690331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.093s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:41:45 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-672bb6b7-e630-4786-a37b-cd4f40cfe6b9 tempest-ProjectReaderTests-1128818246 None] Deleted volume successfully. Sep 28 09:41:45 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-672bb6b7-e630-4786-a37b-cd4f40cfe6b9 tempest-ProjectReaderTests-1128818246 None] Lock "cinder-c5e0892b-a14f-4bbb-ae4f-78f92f92fa58-delete_volume" released by "delete_volume" :: held 1.318s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:41:45 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-b32d9b01-784d-4a5b-a4c5-3481daa31755 tempest-ProjectMemberTests-186690331 None] Create snapshot completed successfully Sep 28 09:41:46 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-947ab4ad-76ff-4c7f-818c-b54937b3641f tempest-ProjectReaderTests-1128818246 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:41:46 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-947ab4ad-76ff-4c7f-818c-b54937b3641f tempest-ProjectReaderTests-1128818246 None] Flow 'volume_create_manager' (a49633cc-2457-4d18-a56c-fbcc820843dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:41:46 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-947ab4ad-76ff-4c7f-818c-b54937b3641f tempest-ProjectReaderTests-1128818246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a114506-433d-4b5e-aa7f-a0a326c898e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:46 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-947ab4ad-76ff-4c7f-818c-b54937b3641f tempest-ProjectReaderTests-1128818246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a114506-433d-4b5e-aa7f-a0a326c898e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:41:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-84681305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=017e54bb-b0c7-41cf-81cd-f70d6d0207b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0dcf5b1b00845ed9eabf4d8b49498f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:41:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:41:46Z,use_quota=True,user_id='289f96a422b64fc99acbae7951190a7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:46 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-947ab4ad-76ff-4c7f-818c-b54937b3641f tempest-ProjectReaderTests-1128818246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b51fb307-158a-4f98-a5a8-741145f88a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:46 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-947ab4ad-76ff-4c7f-818c-b54937b3641f tempest-ProjectReaderTests-1128818246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b51fb307-158a-4f98-a5a8-741145f88a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:46 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-947ab4ad-76ff-4c7f-818c-b54937b3641f tempest-ProjectReaderTests-1128818246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (035f4223-51dd-49d5-9af9-36704277305e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:46 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-947ab4ad-76ff-4c7f-818c-b54937b3641f tempest-ProjectReaderTests-1128818246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (035f4223-51dd-49d5-9af9-36704277305e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '017e54bb-b0c7-41cf-81cd-f70d6d0207b2', 'volume_name': 'volume-017e54bb-b0c7-41cf-81cd-f70d6d0207b2', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:46 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-947ab4ad-76ff-4c7f-818c-b54937b3641f tempest-ProjectReaderTests-1128818246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55e62508-97f1-4529-b0ec-cf5fbd740d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:46 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-947ab4ad-76ff-4c7f-818c-b54937b3641f tempest-ProjectReaderTests-1128818246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55e62508-97f1-4529-b0ec-cf5fbd740d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:46 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-947ab4ad-76ff-4c7f-818c-b54937b3641f tempest-ProjectReaderTests-1128818246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4aab7712-ba0e-4899-a335-d5e28926f7a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:46 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-947ab4ad-76ff-4c7f-818c-b54937b3641f tempest-ProjectReaderTests-1128818246 None] Volume 017e54bb-b0c7-41cf-81cd-f70d6d0207b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-017e54bb-b0c7-41cf-81cd-f70d6d0207b2', 'volume_size': 1} Sep 28 09:41:46 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-947ab4ad-76ff-4c7f-818c-b54937b3641f tempest-ProjectReaderTests-1128818246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:41:46 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-947ab4ad-76ff-4c7f-818c-b54937b3641f tempest-ProjectReaderTests-1128818246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:41:46 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-947ab4ad-76ff-4c7f-818c-b54937b3641f tempest-ProjectReaderTests-1128818246 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:41:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-84681305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=017e54bb-b0c7-41cf-81cd-f70d6d0207b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0dcf5b1b00845ed9eabf4d8b49498f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:41:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:41:46Z,use_quota=True,user_id='289f96a422b64fc99acbae7951190a7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:41:46 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-947ab4ad-76ff-4c7f-818c-b54937b3641f tempest-ProjectReaderTests-1128818246 None] Creating volume 017e54bb-b0c7-41cf-81cd-f70d6d0207b2 {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:41:46 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-947ab4ad-76ff-4c7f-818c-b54937b3641f tempest-ProjectReaderTests-1128818246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:41:46 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-947ab4ad-76ff-4c7f-818c-b54937b3641f tempest-ProjectReaderTests-1128818246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:41:46 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-947ab4ad-76ff-4c7f-818c-b54937b3641f tempest-ProjectReaderTests-1128818246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:41:46 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-947ab4ad-76ff-4c7f-818c-b54937b3641f tempest-ProjectReaderTests-1128818246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:41:46 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-947ab4ad-76ff-4c7f-818c-b54937b3641f tempest-ProjectReaderTests-1128818246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:41:46 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-947ab4ad-76ff-4c7f-818c-b54937b3641f tempest-ProjectReaderTests-1128818246 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:41:46 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-947ab4ad-76ff-4c7f-818c-b54937b3641f tempest-ProjectReaderTests-1128818246 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:41:46 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-947ab4ad-76ff-4c7f-818c-b54937b3641f tempest-ProjectReaderTests-1128818246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-017e54bb-b0c7-41cf-81cd-f70d6d0207b2 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:46 devstack sudo[108055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-017e54bb-b0c7-41cf-81cd-f70d6d0207b2 1073741824 Sep 28 09:41:46 devstack sudo[108055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:46 devstack sudo[108055]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:46 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-947ab4ad-76ff-4c7f-818c-b54937b3641f tempest-ProjectReaderTests-1128818246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-017e54bb-b0c7-41cf-81cd-f70d6d0207b2 1073741824" returned: 0 in 0.406s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:46 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-947ab4ad-76ff-4c7f-818c-b54937b3641f tempest-ProjectReaderTests-1128818246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-017e54bb-b0c7-41cf-81cd-f70d6d0207b2 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:46 devstack sudo[108060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-017e54bb-b0c7-41cf-81cd-f70d6d0207b2 Sep 28 09:41:46 devstack sudo[108060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:46 devstack sudo[108060]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:46 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-947ab4ad-76ff-4c7f-818c-b54937b3641f tempest-ProjectReaderTests-1128818246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-017e54bb-b0c7-41cf-81cd-f70d6d0207b2" returned: 0 in 0.248s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:46 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-0e5cda9b-61cb-496d-a501-c82b7ee26931 tempest-ProjectMemberTests-186690331 None] Acquiring lock "cinder-0e40db16-8239-4cab-9fcc-01cdb657f052-delete_snapshot" by "delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:41:46 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-947ab4ad-76ff-4c7f-818c-b54937b3641f tempest-ProjectReaderTests-1128818246 None] <== create_volume: return (706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:41:46 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-947ab4ad-76ff-4c7f-818c-b54937b3641f tempest-ProjectReaderTests-1128818246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.709s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:41:46 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-947ab4ad-76ff-4c7f-818c-b54937b3641f tempest-ProjectReaderTests-1128818246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4aab7712-ba0e-4899-a335-d5e28926f7a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-017e54bb-b0c7-41cf-81cd-f70d6d0207b2', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:46 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-947ab4ad-76ff-4c7f-818c-b54937b3641f tempest-ProjectReaderTests-1128818246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd28948d-812b-47d0-81ca-f58f592239ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:46 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-0e5cda9b-61cb-496d-a501-c82b7ee26931 tempest-ProjectMemberTests-186690331 None] Lock "cinder-0e40db16-8239-4cab-9fcc-01cdb657f052-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:41:46 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-0e5cda9b-61cb-496d-a501-c82b7ee26931 tempest-ProjectMemberTests-186690331 None] Acquiring lock "cinder-quobyte-afe526dc-7d96-4f05-90c2-b81c6740052b" by "delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:41:46 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-947ab4ad-76ff-4c7f-818c-b54937b3641f tempest-ProjectReaderTests-1128818246 None] Volume volume-017e54bb-b0c7-41cf-81cd-f70d6d0207b2 (017e54bb-b0c7-41cf-81cd-f70d6d0207b2): created successfully Sep 28 09:41:46 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-947ab4ad-76ff-4c7f-818c-b54937b3641f tempest-ProjectReaderTests-1128818246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd28948d-812b-47d0-81ca-f58f592239ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:46 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-947ab4ad-76ff-4c7f-818c-b54937b3641f tempest-ProjectReaderTests-1128818246 None] Flow 'volume_create_manager' (a49633cc-2457-4d18-a56c-fbcc820843dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:41:46 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-0e5cda9b-61cb-496d-a501-c82b7ee26931 tempest-ProjectMemberTests-186690331 None] Lock "cinder-quobyte-afe526dc-7d96-4f05-90c2-b81c6740052b" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:41:46 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-0e5cda9b-61cb-496d-a501-c82b7ee26931 tempest-ProjectMemberTests-186690331 None] Acquiring lock "cinder-quobyte-0e40db16-8239-4cab-9fcc-01cdb657f052" by "_delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:41:46 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-947ab4ad-76ff-4c7f-818c-b54937b3641f tempest-ProjectReaderTests-1128818246 None] Created volume successfully. Sep 28 09:41:46 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-0e5cda9b-61cb-496d-a501-c82b7ee26931 tempest-ProjectMemberTests-186690331 None] Lock "cinder-quobyte-0e40db16-8239-4cab-9fcc-01cdb657f052" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:41:46 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-0e5cda9b-61cb-496d-a501-c82b7ee26931 tempest-ProjectMemberTests-186690331 None] Deleting offline snapshot 0e40db16-8239-4cab-9fcc-01cdb657f052 of volume afe526dc-7d96-4f05-90c2-b81c6740052b {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 09:41:46 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-0e5cda9b-61cb-496d-a501-c82b7ee26931 tempest-ProjectMemberTests-186690331 None] snapshot_file for this snap is: volume-afe526dc-7d96-4f05-90c2-b81c6740052b.0e40db16-8239-4cab-9fcc-01cdb657f052 {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 09:41:46 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[300d20bf-e68d-4cff-8d24-4a2fb552d94c]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:41:46 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0e5cda9b-61cb-496d-a501-c82b7ee26931 tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-afe526dc-7d96-4f05-90c2-b81c6740052b.0e40db16-8239-4cab-9fcc-01cdb657f052 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:47 devstack sudo[108063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-afe526dc-7d96-4f05-90c2-b81c6740052b.0e40db16-8239-4cab-9fcc-01cdb657f052 Sep 28 09:41:47 devstack sudo[108063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:47 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-7ad06c05-02c5-4f2c-bc0e-4efa805b86c1 tempest-ProjectReaderTests-1128818246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:41:47 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-7ad06c05-02c5-4f2c-bc0e-4efa805b86c1 tempest-ProjectReaderTests-1128818246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:41:47 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-7ad06c05-02c5-4f2c-bc0e-4efa805b86c1 tempest-ProjectReaderTests-1128818246 None] Creating offline snapshot 30bb32bc-634e-49e8-9844-87d1ac3d89c4 of volume 017e54bb-b0c7-41cf-81cd-f70d6d0207b2 {{(pid=86553) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 09:41:47 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c79b694-0f39-49e5-8a3b-82fa5dfb9747]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:41:47 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-7ad06c05-02c5-4f2c-bc0e-4efa805b86c1 tempest-ProjectReaderTests-1128818246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-017e54bb-b0c7-41cf-81cd-f70d6d0207b2 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:47 devstack sudo[108063]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:47 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0e5cda9b-61cb-496d-a501-c82b7ee26931 tempest-ProjectMemberTests-186690331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-afe526dc-7d96-4f05-90c2-b81c6740052b.0e40db16-8239-4cab-9fcc-01cdb657f052" returned: 0 in 0.394s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:47 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-0e5cda9b-61cb-496d-a501-c82b7ee26931 tempest-ProjectMemberTests-186690331 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-afe526dc-7d96-4f05-90c2-b81c6740052b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86553) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 09:41:47 devstack sudo[108065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-017e54bb-b0c7-41cf-81cd-f70d6d0207b2 Sep 28 09:41:47 devstack sudo[108065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:47 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ada99b-0716-4789-ab87-086251ff12d1]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:41:47 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0e5cda9b-61cb-496d-a501-c82b7ee26931 tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-afe526dc-7d96-4f05-90c2-b81c6740052b {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:47 devstack sudo[108070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-afe526dc-7d96-4f05-90c2-b81c6740052b Sep 28 09:41:47 devstack sudo[108070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:47 devstack sudo[108065]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:47 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-7ad06c05-02c5-4f2c-bc0e-4efa805b86c1 tempest-ProjectReaderTests-1128818246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-017e54bb-b0c7-41cf-81cd-f70d6d0207b2" returned: 0 in 0.383s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:47 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-7ad06c05-02c5-4f2c-bc0e-4efa805b86c1 tempest-ProjectReaderTests-1128818246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-017e54bb-b0c7-41cf-81cd-f70d6d0207b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-017e54bb-b0c7-41cf-81cd-f70d6d0207b2.30bb32bc-634e-49e8-9844-87d1ac3d89c4 1G {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:47 devstack sudo[108075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-017e54bb-b0c7-41cf-81cd-f70d6d0207b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-017e54bb-b0c7-41cf-81cd-f70d6d0207b2.30bb32bc-634e-49e8-9844-87d1ac3d89c4 1G Sep 28 09:41:47 devstack sudo[108075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:47 devstack sudo[108070]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:47 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0e5cda9b-61cb-496d-a501-c82b7ee26931 tempest-ProjectMemberTests-186690331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-afe526dc-7d96-4f05-90c2-b81c6740052b" returned: 0 in 0.372s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:47 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0e5cda9b-61cb-496d-a501-c82b7ee26931 tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-afe526dc-7d96-4f05-90c2-b81c6740052b.0e40db16-8239-4cab-9fcc-01cdb657f052 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:47 devstack sudo[108080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-afe526dc-7d96-4f05-90c2-b81c6740052b.0e40db16-8239-4cab-9fcc-01cdb657f052 Sep 28 09:41:47 devstack sudo[108080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:48 devstack sudo[108075]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-7ad06c05-02c5-4f2c-bc0e-4efa805b86c1 tempest-ProjectReaderTests-1128818246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-017e54bb-b0c7-41cf-81cd-f70d6d0207b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-017e54bb-b0c7-41cf-81cd-f70d6d0207b2.30bb32bc-634e-49e8-9844-87d1ac3d89c4 1G" returned: 0 in 0.397s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-7ad06c05-02c5-4f2c-bc0e-4efa805b86c1 tempest-ProjectReaderTests-1128818246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-017e54bb-b0c7-41cf-81cd-f70d6d0207b2 -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-017e54bb-b0c7-41cf-81cd-f70d6d0207b2.30bb32bc-634e-49e8-9844-87d1ac3d89c4 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:48 devstack sudo[108088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-017e54bb-b0c7-41cf-81cd-f70d6d0207b2 -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-017e54bb-b0c7-41cf-81cd-f70d6d0207b2.30bb32bc-634e-49e8-9844-87d1ac3d89c4 Sep 28 09:41:48 devstack sudo[108088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:48 devstack sudo[108080]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0e5cda9b-61cb-496d-a501-c82b7ee26931 tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-afe526dc-7d96-4f05-90c2-b81c6740052b.0e40db16-8239-4cab-9fcc-01cdb657f052" returned: 0 in 0.389s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0e5cda9b-61cb-496d-a501-c82b7ee26931 tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-afe526dc-7d96-4f05-90c2-b81c6740052b.0e40db16-8239-4cab-9fcc-01cdb657f052 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:48 devstack sudo[108091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-afe526dc-7d96-4f05-90c2-b81c6740052b.0e40db16-8239-4cab-9fcc-01cdb657f052 Sep 28 09:41:48 devstack sudo[108091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:48 devstack sudo[108088]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-7ad06c05-02c5-4f2c-bc0e-4efa805b86c1 tempest-ProjectReaderTests-1128818246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-017e54bb-b0c7-41cf-81cd-f70d6d0207b2 -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-017e54bb-b0c7-41cf-81cd-f70d6d0207b2.30bb32bc-634e-49e8-9844-87d1ac3d89c4" returned: 0 in 0.314s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:48 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-7ad06c05-02c5-4f2c-bc0e-4efa805b86c1 tempest-ProjectReaderTests-1128818246 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-017e54bb-b0c7-41cf-81cd-f70d6d0207b2.30bb32bc-634e-49e8-9844-87d1ac3d89c4 is being set with open permissions: ugo+rw Sep 28 09:41:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-7ad06c05-02c5-4f2c-bc0e-4efa805b86c1 tempest-ProjectReaderTests-1128818246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-017e54bb-b0c7-41cf-81cd-f70d6d0207b2.30bb32bc-634e-49e8-9844-87d1ac3d89c4 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:48 devstack sudo[108096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-017e54bb-b0c7-41cf-81cd-f70d6d0207b2.30bb32bc-634e-49e8-9844-87d1ac3d89c4 Sep 28 09:41:48 devstack sudo[108096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:48 devstack sudo[108091]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0e5cda9b-61cb-496d-a501-c82b7ee26931 tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-afe526dc-7d96-4f05-90c2-b81c6740052b.0e40db16-8239-4cab-9fcc-01cdb657f052" returned: 0 in 0.266s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:48 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-0e5cda9b-61cb-496d-a501-c82b7ee26931 tempest-ProjectMemberTests-186690331 None] Lock "cinder-quobyte-0e40db16-8239-4cab-9fcc-01cdb657f052" released by "_delete_snapshot" :: held 1.533s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:41:48 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-0e5cda9b-61cb-496d-a501-c82b7ee26931 tempest-ProjectMemberTests-186690331 None] Lock "cinder-quobyte-afe526dc-7d96-4f05-90c2-b81c6740052b" released by "delete_snapshot" :: held 1.561s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:41:48 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-0e5cda9b-61cb-496d-a501-c82b7ee26931 tempest-ProjectMemberTests-186690331 None] Created reservations ['9e69c3a1-786d-4fa4-84cc-4b2efd50c8c0', 'ab545f64-ff28-4927-8f37-cdbe19a7d2d5', '1c4ba8c8-4ab8-425a-9c35-f82ba7a09299', 'cf6c89bc-635d-49b2-a34e-0f273693fac5'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:41:48 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-0e5cda9b-61cb-496d-a501-c82b7ee26931 tempest-ProjectMemberTests-186690331 None] Delete snapshot completed successfully. Sep 28 09:41:48 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-0e5cda9b-61cb-496d-a501-c82b7ee26931 tempest-ProjectMemberTests-186690331 None] Lock "cinder-0e40db16-8239-4cab-9fcc-01cdb657f052-delete_snapshot" released by "delete_snapshot" :: held 1.723s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:41:48 devstack sudo[108096]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-7ad06c05-02c5-4f2c-bc0e-4efa805b86c1 tempest-ProjectReaderTests-1128818246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-017e54bb-b0c7-41cf-81cd-f70d6d0207b2.30bb32bc-634e-49e8-9844-87d1ac3d89c4" returned: 0 in 0.261s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-7ad06c05-02c5-4f2c-bc0e-4efa805b86c1 tempest-ProjectReaderTests-1128818246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-017e54bb-b0c7-41cf-81cd-f70d6d0207b2.info {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:48 devstack sudo[108100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-017e54bb-b0c7-41cf-81cd-f70d6d0207b2.info Sep 28 09:41:48 devstack sudo[108100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:48 devstack sudo[108100]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-7ad06c05-02c5-4f2c-bc0e-4efa805b86c1 tempest-ProjectReaderTests-1128818246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-017e54bb-b0c7-41cf-81cd-f70d6d0207b2.info" returned: 0 in 0.257s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:48 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-7ad06c05-02c5-4f2c-bc0e-4efa805b86c1 tempest-ProjectReaderTests-1128818246 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-017e54bb-b0c7-41cf-81cd-f70d6d0207b2.info is being set with open permissions: ugo+rw Sep 28 09:41:48 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-7ad06c05-02c5-4f2c-bc0e-4efa805b86c1 tempest-ProjectReaderTests-1128818246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-017e54bb-b0c7-41cf-81cd-f70d6d0207b2.info {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:48 devstack sudo[108103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-017e54bb-b0c7-41cf-81cd-f70d6d0207b2.info Sep 28 09:41:48 devstack sudo[108103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:48 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-a1d9e3b6-81f7-46f8-bf84-155f09aabbef tempest-ProjectMemberTests-186690331 None] Acquiring lock "cinder-afe526dc-7d96-4f05-90c2-b81c6740052b-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:41:48 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-a1d9e3b6-81f7-46f8-bf84-155f09aabbef tempest-ProjectMemberTests-186690331 None] Lock "cinder-afe526dc-7d96-4f05-90c2-b81c6740052b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:41:49 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-a1d9e3b6-81f7-46f8-bf84-155f09aabbef tempest-ProjectMemberTests-186690331 None] Acquiring lock "cinder-quobyte-afe526dc-7d96-4f05-90c2-b81c6740052b" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:41:49 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-a1d9e3b6-81f7-46f8-bf84-155f09aabbef tempest-ProjectMemberTests-186690331 None] Lock "cinder-quobyte-afe526dc-7d96-4f05-90c2-b81c6740052b" acquired by "delete_volume" :: waited 0.015s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:41:49 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[98504b0c-c187-41ea-ac9a-10d26b757392]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:41:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a1d9e3b6-81f7-46f8-bf84-155f09aabbef tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-afe526dc-7d96-4f05-90c2-b81c6740052b {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:49 devstack sudo[108103]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-7ad06c05-02c5-4f2c-bc0e-4efa805b86c1 tempest-ProjectReaderTests-1128818246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-017e54bb-b0c7-41cf-81cd-f70d6d0207b2.info" returned: 0 in 0.261s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-7ad06c05-02c5-4f2c-bc0e-4efa805b86c1 tempest-ProjectReaderTests-1128818246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.955s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:41:49 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-7ad06c05-02c5-4f2c-bc0e-4efa805b86c1 tempest-ProjectReaderTests-1128818246 None] Create snapshot completed successfully Sep 28 09:41:49 devstack sudo[108105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-afe526dc-7d96-4f05-90c2-b81c6740052b Sep 28 09:41:49 devstack sudo[108105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:49 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-c734cb9a-db26-42a6-80d9-bc0dfe26a8df tempest-ProjectReaderTests-1128818246 None] Acquiring lock "cinder-30bb32bc-634e-49e8-9844-87d1ac3d89c4-delete_snapshot" by "delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:41:49 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-c734cb9a-db26-42a6-80d9-bc0dfe26a8df tempest-ProjectReaderTests-1128818246 None] Lock "cinder-30bb32bc-634e-49e8-9844-87d1ac3d89c4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:41:49 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-c734cb9a-db26-42a6-80d9-bc0dfe26a8df tempest-ProjectReaderTests-1128818246 None] Acquiring lock "cinder-quobyte-017e54bb-b0c7-41cf-81cd-f70d6d0207b2" by "delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:41:49 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-c734cb9a-db26-42a6-80d9-bc0dfe26a8df tempest-ProjectReaderTests-1128818246 None] Lock "cinder-quobyte-017e54bb-b0c7-41cf-81cd-f70d6d0207b2" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:41:49 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-c734cb9a-db26-42a6-80d9-bc0dfe26a8df tempest-ProjectReaderTests-1128818246 None] Acquiring lock "cinder-quobyte-30bb32bc-634e-49e8-9844-87d1ac3d89c4" by "_delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:41:49 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-c734cb9a-db26-42a6-80d9-bc0dfe26a8df tempest-ProjectReaderTests-1128818246 None] Lock "cinder-quobyte-30bb32bc-634e-49e8-9844-87d1ac3d89c4" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:41:49 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-c734cb9a-db26-42a6-80d9-bc0dfe26a8df tempest-ProjectReaderTests-1128818246 None] Deleting offline snapshot 30bb32bc-634e-49e8-9844-87d1ac3d89c4 of volume 017e54bb-b0c7-41cf-81cd-f70d6d0207b2 {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 09:41:49 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-c734cb9a-db26-42a6-80d9-bc0dfe26a8df tempest-ProjectReaderTests-1128818246 None] snapshot_file for this snap is: volume-017e54bb-b0c7-41cf-81cd-f70d6d0207b2.30bb32bc-634e-49e8-9844-87d1ac3d89c4 {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 09:41:49 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[d21c606b-172f-4ba8-ade0-dd23ef773dad]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:41:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c734cb9a-db26-42a6-80d9-bc0dfe26a8df tempest-ProjectReaderTests-1128818246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-017e54bb-b0c7-41cf-81cd-f70d6d0207b2.30bb32bc-634e-49e8-9844-87d1ac3d89c4 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:49 devstack sudo[108105]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a1d9e3b6-81f7-46f8-bf84-155f09aabbef tempest-ProjectMemberTests-186690331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-afe526dc-7d96-4f05-90c2-b81c6740052b" returned: 0 in 0.386s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a1d9e3b6-81f7-46f8-bf84-155f09aabbef tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-afe526dc-7d96-4f05-90c2-b81c6740052b {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:49 devstack sudo[108112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-afe526dc-7d96-4f05-90c2-b81c6740052b Sep 28 09:41:49 devstack sudo[108112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:49 devstack sudo[108111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-017e54bb-b0c7-41cf-81cd-f70d6d0207b2.30bb32bc-634e-49e8-9844-87d1ac3d89c4 Sep 28 09:41:49 devstack sudo[108111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:49 devstack sudo[108112]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a1d9e3b6-81f7-46f8-bf84-155f09aabbef tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-afe526dc-7d96-4f05-90c2-b81c6740052b" returned: 0 in 0.258s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:49 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-a1d9e3b6-81f7-46f8-bf84-155f09aabbef tempest-ProjectMemberTests-186690331 None] Lock "cinder-quobyte-afe526dc-7d96-4f05-90c2-b81c6740052b" released by "delete_volume" :: held 0.719s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:41:49 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-a1d9e3b6-81f7-46f8-bf84-155f09aabbef tempest-ProjectMemberTests-186690331 None] Created reservations ['629c0337-7608-4ea1-9002-72d3bee19665', 'd7cae197-c37d-4ccd-bff0-d028309d2814', '43b23fcf-dced-4628-91b6-669d94f48daf', '967236e0-3baf-4b69-8c1b-faebb560f557'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:41:49 devstack sudo[108111]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c734cb9a-db26-42a6-80d9-bc0dfe26a8df tempest-ProjectReaderTests-1128818246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-017e54bb-b0c7-41cf-81cd-f70d6d0207b2.30bb32bc-634e-49e8-9844-87d1ac3d89c4" returned: 0 in 0.373s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:49 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-c734cb9a-db26-42a6-80d9-bc0dfe26a8df tempest-ProjectReaderTests-1128818246 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-017e54bb-b0c7-41cf-81cd-f70d6d0207b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86553) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 09:41:49 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[f10e86df-4f28-427e-abda-81bb4858843e]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:41:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c734cb9a-db26-42a6-80d9-bc0dfe26a8df tempest-ProjectReaderTests-1128818246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-017e54bb-b0c7-41cf-81cd-f70d6d0207b2 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-a1d9e3b6-81f7-46f8-bf84-155f09aabbef tempest-ProjectMemberTests-186690331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:41:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-a1d9e3b6-81f7-46f8-bf84-155f09aabbef tempest-ProjectMemberTests-186690331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:41:49 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-a1d9e3b6-81f7-46f8-bf84-155f09aabbef tempest-ProjectMemberTests-186690331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:41:49 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-a1d9e3b6-81f7-46f8-bf84-155f09aabbef tempest-ProjectMemberTests-186690331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:41:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-a1d9e3b6-81f7-46f8-bf84-155f09aabbef tempest-ProjectMemberTests-186690331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:41:49 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a1d9e3b6-81f7-46f8-bf84-155f09aabbef tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:49 devstack sudo[108120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:41:49 devstack sudo[108120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:49 devstack sudo[108119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-017e54bb-b0c7-41cf-81cd-f70d6d0207b2 Sep 28 09:41:49 devstack sudo[108119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:50 devstack sudo[108120]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a1d9e3b6-81f7-46f8-bf84-155f09aabbef tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.278s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:50 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-a1d9e3b6-81f7-46f8-bf84-155f09aabbef tempest-ProjectMemberTests-186690331 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:41:50 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-a1d9e3b6-81f7-46f8-bf84-155f09aabbef tempest-ProjectMemberTests-186690331 None] Deleted volume successfully. Sep 28 09:41:50 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-a1d9e3b6-81f7-46f8-bf84-155f09aabbef tempest-ProjectMemberTests-186690331 None] Lock "cinder-afe526dc-7d96-4f05-90c2-b81c6740052b-delete_volume" released by "delete_volume" :: held 1.244s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:41:50 devstack sudo[108119]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c734cb9a-db26-42a6-80d9-bc0dfe26a8df tempest-ProjectReaderTests-1128818246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-017e54bb-b0c7-41cf-81cd-f70d6d0207b2" returned: 0 in 0.393s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c734cb9a-db26-42a6-80d9-bc0dfe26a8df tempest-ProjectReaderTests-1128818246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-017e54bb-b0c7-41cf-81cd-f70d6d0207b2.30bb32bc-634e-49e8-9844-87d1ac3d89c4 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:50 devstack sudo[108127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-017e54bb-b0c7-41cf-81cd-f70d6d0207b2.30bb32bc-634e-49e8-9844-87d1ac3d89c4 Sep 28 09:41:50 devstack sudo[108127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:50 devstack sudo[108127]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c734cb9a-db26-42a6-80d9-bc0dfe26a8df tempest-ProjectReaderTests-1128818246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-017e54bb-b0c7-41cf-81cd-f70d6d0207b2.30bb32bc-634e-49e8-9844-87d1ac3d89c4" returned: 0 in 0.372s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c734cb9a-db26-42a6-80d9-bc0dfe26a8df tempest-ProjectReaderTests-1128818246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-017e54bb-b0c7-41cf-81cd-f70d6d0207b2.30bb32bc-634e-49e8-9844-87d1ac3d89c4 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:50 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-be4fdb4e-0b17-43f7-85e8-695b4bac803a tempest-ProjectMemberTests-186690331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:41:50 devstack sudo[108133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-017e54bb-b0c7-41cf-81cd-f70d6d0207b2.30bb32bc-634e-49e8-9844-87d1ac3d89c4 Sep 28 09:41:50 devstack sudo[108133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:50 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-be4fdb4e-0b17-43f7-85e8-695b4bac803a tempest-ProjectMemberTests-186690331 None] Flow 'volume_create_manager' (f66c9496-ca01-495b-8fd2-4f0c40e01a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:41:50 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-be4fdb4e-0b17-43f7-85e8-695b4bac803a tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (269fdf8e-d736-4060-93ee-4e3dbaa127a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:50 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-be4fdb4e-0b17-43f7-85e8-695b4bac803a tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (269fdf8e-d736-4060-93ee-4e3dbaa127a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:41:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1963614944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17f736e1-90ce-47b7-9f75-16ff038e1f0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50c5ebfa35e84e1fa822f83efd2739e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:41:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:41:51Z,use_quota=True,user_id='029e33208bca4e258a762ad19e5ed78e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:50 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-be4fdb4e-0b17-43f7-85e8-695b4bac803a tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dbb4a3a-e2f7-4f12-bee4-fe31e537679e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:50 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-be4fdb4e-0b17-43f7-85e8-695b4bac803a tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dbb4a3a-e2f7-4f12-bee4-fe31e537679e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:50 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-be4fdb4e-0b17-43f7-85e8-695b4bac803a tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5100a5c3-3344-4c42-a128-d785395c154d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:50 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-be4fdb4e-0b17-43f7-85e8-695b4bac803a tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5100a5c3-3344-4c42-a128-d785395c154d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17f736e1-90ce-47b7-9f75-16ff038e1f0e', 'volume_name': 'volume-17f736e1-90ce-47b7-9f75-16ff038e1f0e', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:50 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-be4fdb4e-0b17-43f7-85e8-695b4bac803a tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d1417d2-520f-4981-b5b8-d0c0407fa26b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:50 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-be4fdb4e-0b17-43f7-85e8-695b4bac803a tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d1417d2-520f-4981-b5b8-d0c0407fa26b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:50 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-be4fdb4e-0b17-43f7-85e8-695b4bac803a tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d354dbc-ae44-4240-8b33-d62aa5e705b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:50 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-be4fdb4e-0b17-43f7-85e8-695b4bac803a tempest-ProjectMemberTests-186690331 None] Volume 17f736e1-90ce-47b7-9f75-16ff038e1f0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17f736e1-90ce-47b7-9f75-16ff038e1f0e', 'volume_size': 1} Sep 28 09:41:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-be4fdb4e-0b17-43f7-85e8-695b4bac803a tempest-ProjectMemberTests-186690331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:41:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-be4fdb4e-0b17-43f7-85e8-695b4bac803a tempest-ProjectMemberTests-186690331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:41:50 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-be4fdb4e-0b17-43f7-85e8-695b4bac803a tempest-ProjectMemberTests-186690331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:41:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1963614944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17f736e1-90ce-47b7-9f75-16ff038e1f0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50c5ebfa35e84e1fa822f83efd2739e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:41:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:41:51Z,use_quota=True,user_id='029e33208bca4e258a762ad19e5ed78e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:41:50 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-be4fdb4e-0b17-43f7-85e8-695b4bac803a tempest-ProjectMemberTests-186690331 None] Creating volume 17f736e1-90ce-47b7-9f75-16ff038e1f0e {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:41:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-be4fdb4e-0b17-43f7-85e8-695b4bac803a tempest-ProjectMemberTests-186690331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:41:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-be4fdb4e-0b17-43f7-85e8-695b4bac803a tempest-ProjectMemberTests-186690331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:41:50 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-be4fdb4e-0b17-43f7-85e8-695b4bac803a tempest-ProjectMemberTests-186690331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:41:50 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-be4fdb4e-0b17-43f7-85e8-695b4bac803a tempest-ProjectMemberTests-186690331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:41:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-be4fdb4e-0b17-43f7-85e8-695b4bac803a tempest-ProjectMemberTests-186690331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:41:50 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-be4fdb4e-0b17-43f7-85e8-695b4bac803a tempest-ProjectMemberTests-186690331 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:41:50 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-be4fdb4e-0b17-43f7-85e8-695b4bac803a tempest-ProjectMemberTests-186690331 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:41:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-be4fdb4e-0b17-43f7-85e8-695b4bac803a tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-17f736e1-90ce-47b7-9f75-16ff038e1f0e 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:50 devstack sudo[108135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-17f736e1-90ce-47b7-9f75-16ff038e1f0e 1073741824 Sep 28 09:41:50 devstack sudo[108135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:50 devstack sudo[108133]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:50 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-c734cb9a-db26-42a6-80d9-bc0dfe26a8df tempest-ProjectReaderTests-1128818246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-017e54bb-b0c7-41cf-81cd-f70d6d0207b2.30bb32bc-634e-49e8-9844-87d1ac3d89c4" returned: 0 in 0.264s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:50 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-c734cb9a-db26-42a6-80d9-bc0dfe26a8df tempest-ProjectReaderTests-1128818246 None] Lock "cinder-quobyte-30bb32bc-634e-49e8-9844-87d1ac3d89c4" released by "_delete_snapshot" :: held 1.514s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:41:50 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-c734cb9a-db26-42a6-80d9-bc0dfe26a8df tempest-ProjectReaderTests-1128818246 None] Lock "cinder-quobyte-017e54bb-b0c7-41cf-81cd-f70d6d0207b2" released by "delete_snapshot" :: held 1.537s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:41:51 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-c734cb9a-db26-42a6-80d9-bc0dfe26a8df tempest-ProjectReaderTests-1128818246 None] Created reservations ['29602e62-435f-4ffa-b6a3-cbd966c6713b', '811c32d8-07f8-46fe-a588-4b18e3294b2b', '5285090c-a32f-415c-a7ed-3be4d147c47c', '432e1bb4-07a5-46c5-a4ab-2e50324f48c0'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:41:51 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-c734cb9a-db26-42a6-80d9-bc0dfe26a8df tempest-ProjectReaderTests-1128818246 None] Delete snapshot completed successfully. Sep 28 09:41:51 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-c734cb9a-db26-42a6-80d9-bc0dfe26a8df tempest-ProjectReaderTests-1128818246 None] Lock "cinder-30bb32bc-634e-49e8-9844-87d1ac3d89c4-delete_snapshot" released by "delete_snapshot" :: held 1.679s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:41:51 devstack sudo[108135]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:51 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-be4fdb4e-0b17-43f7-85e8-695b4bac803a tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-17f736e1-90ce-47b7-9f75-16ff038e1f0e 1073741824" returned: 0 in 0.450s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:51 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-be4fdb4e-0b17-43f7-85e8-695b4bac803a tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-17f736e1-90ce-47b7-9f75-16ff038e1f0e {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:51 devstack sudo[108141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-17f736e1-90ce-47b7-9f75-16ff038e1f0e Sep 28 09:41:51 devstack sudo[108141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:51 devstack sudo[108141]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:51 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-be4fdb4e-0b17-43f7-85e8-695b4bac803a tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-17f736e1-90ce-47b7-9f75-16ff038e1f0e" returned: 0 in 0.247s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:51 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-be4fdb4e-0b17-43f7-85e8-695b4bac803a tempest-ProjectMemberTests-186690331 None] <== create_volume: return (740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:41:51 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-be4fdb4e-0b17-43f7-85e8-695b4bac803a tempest-ProjectMemberTests-186690331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.743s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:41:51 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-be4fdb4e-0b17-43f7-85e8-695b4bac803a tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d354dbc-ae44-4240-8b33-d62aa5e705b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17f736e1-90ce-47b7-9f75-16ff038e1f0e', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:51 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-be4fdb4e-0b17-43f7-85e8-695b4bac803a tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9efd0c7-da73-4938-8296-aa5f89c96ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:51 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-be4fdb4e-0b17-43f7-85e8-695b4bac803a tempest-ProjectMemberTests-186690331 None] Volume volume-17f736e1-90ce-47b7-9f75-16ff038e1f0e (17f736e1-90ce-47b7-9f75-16ff038e1f0e): created successfully Sep 28 09:41:51 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-be4fdb4e-0b17-43f7-85e8-695b4bac803a tempest-ProjectMemberTests-186690331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9efd0c7-da73-4938-8296-aa5f89c96ce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:51 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-be4fdb4e-0b17-43f7-85e8-695b4bac803a tempest-ProjectMemberTests-186690331 None] Flow 'volume_create_manager' (f66c9496-ca01-495b-8fd2-4f0c40e01a98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:41:51 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-0f03a5ad-7c66-47f6-acb4-46534d779bec tempest-ProjectReaderTests-1128818246 None] Acquiring lock "cinder-017e54bb-b0c7-41cf-81cd-f70d6d0207b2-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:41:51 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-be4fdb4e-0b17-43f7-85e8-695b4bac803a tempest-ProjectMemberTests-186690331 None] Created volume successfully. Sep 28 09:41:51 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-0f03a5ad-7c66-47f6-acb4-46534d779bec tempest-ProjectReaderTests-1128818246 None] Lock "cinder-017e54bb-b0c7-41cf-81cd-f70d6d0207b2-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:41:51 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-0f03a5ad-7c66-47f6-acb4-46534d779bec tempest-ProjectReaderTests-1128818246 None] Acquiring lock "cinder-quobyte-017e54bb-b0c7-41cf-81cd-f70d6d0207b2" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:41:51 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-0f03a5ad-7c66-47f6-acb4-46534d779bec tempest-ProjectReaderTests-1128818246 None] Lock "cinder-quobyte-017e54bb-b0c7-41cf-81cd-f70d6d0207b2" acquired by "delete_volume" :: waited 0.016s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:41:51 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae57fc2f-8d5b-42c4-93c0-d0dc9ae80883]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:41:51 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0f03a5ad-7c66-47f6-acb4-46534d779bec tempest-ProjectReaderTests-1128818246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-017e54bb-b0c7-41cf-81cd-f70d6d0207b2 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:51 devstack sudo[108144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-017e54bb-b0c7-41cf-81cd-f70d6d0207b2 Sep 28 09:41:51 devstack sudo[108144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:52 devstack sudo[108144]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:52 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0f03a5ad-7c66-47f6-acb4-46534d779bec tempest-ProjectReaderTests-1128818246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-017e54bb-b0c7-41cf-81cd-f70d6d0207b2" returned: 0 in 0.366s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:52 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0f03a5ad-7c66-47f6-acb4-46534d779bec tempest-ProjectReaderTests-1128818246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-017e54bb-b0c7-41cf-81cd-f70d6d0207b2 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:52 devstack sudo[108149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-017e54bb-b0c7-41cf-81cd-f70d6d0207b2 Sep 28 09:41:52 devstack sudo[108149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:52 devstack sudo[108149]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:52 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0f03a5ad-7c66-47f6-acb4-46534d779bec tempest-ProjectReaderTests-1128818246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-017e54bb-b0c7-41cf-81cd-f70d6d0207b2" returned: 0 in 0.243s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:52 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-0f03a5ad-7c66-47f6-acb4-46534d779bec tempest-ProjectReaderTests-1128818246 None] Lock "cinder-quobyte-017e54bb-b0c7-41cf-81cd-f70d6d0207b2" released by "delete_volume" :: held 0.670s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:41:52 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-0f03a5ad-7c66-47f6-acb4-46534d779bec tempest-ProjectReaderTests-1128818246 None] Created reservations ['24b4b009-3e52-49ee-9be5-4086130fdc1f', 'e065fd82-69ee-47c3-9832-c77b7b0fefe3', '1a7034b8-6901-4338-a263-ace65c20a891', 'e62c31bf-dddd-433d-8e81-a0c699db8ed5'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:41:52 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-0f03a5ad-7c66-47f6-acb4-46534d779bec tempest-ProjectReaderTests-1128818246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:41:52 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-0f03a5ad-7c66-47f6-acb4-46534d779bec tempest-ProjectReaderTests-1128818246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:41:52 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-0f03a5ad-7c66-47f6-acb4-46534d779bec tempest-ProjectReaderTests-1128818246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:41:52 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-0f03a5ad-7c66-47f6-acb4-46534d779bec tempest-ProjectReaderTests-1128818246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:41:52 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-0f03a5ad-7c66-47f6-acb4-46534d779bec tempest-ProjectReaderTests-1128818246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:41:52 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0f03a5ad-7c66-47f6-acb4-46534d779bec tempest-ProjectReaderTests-1128818246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:52 devstack sudo[108152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:41:52 devstack sudo[108152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:52 devstack sudo[108152]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:52 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-0f03a5ad-7c66-47f6-acb4-46534d779bec tempest-ProjectReaderTests-1128818246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.250s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:52 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-0f03a5ad-7c66-47f6-acb4-46534d779bec tempest-ProjectReaderTests-1128818246 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:41:52 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-0f03a5ad-7c66-47f6-acb4-46534d779bec tempest-ProjectReaderTests-1128818246 None] Deleted volume successfully. Sep 28 09:41:52 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-0f03a5ad-7c66-47f6-acb4-46534d779bec tempest-ProjectReaderTests-1128818246 None] Lock "cinder-017e54bb-b0c7-41cf-81cd-f70d6d0207b2-delete_volume" released by "delete_volume" :: held 1.116s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:41:52 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-bce552ae-b413-4fa2-889d-d8684ca1f2fc tempest-ProjectMemberTests-186690331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:41:52 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-bce552ae-b413-4fa2-889d-d8684ca1f2fc tempest-ProjectMemberTests-186690331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:41:52 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-bce552ae-b413-4fa2-889d-d8684ca1f2fc tempest-ProjectMemberTests-186690331 None] Creating offline snapshot 5c411108-3a5d-43b5-b964-d3a215e88d75 of volume 17f736e1-90ce-47b7-9f75-16ff038e1f0e {{(pid=86553) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 09:41:52 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[e07390f1-5733-4ba1-a2ab-f7ce9c78d751]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:41:52 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-bce552ae-b413-4fa2-889d-d8684ca1f2fc tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-17f736e1-90ce-47b7-9f75-16ff038e1f0e {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:53 devstack sudo[108155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-17f736e1-90ce-47b7-9f75-16ff038e1f0e Sep 28 09:41:53 devstack sudo[108155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:53 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-95c93982-3060-4d47-9b23-87d70242aceb tempest-ProjectReaderTests-1128818246 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:41:53 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-95c93982-3060-4d47-9b23-87d70242aceb tempest-ProjectReaderTests-1128818246 None] Flow 'volume_create_manager' (e4552753-f044-4b1c-b6cf-8cbaab3ee0eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:41:53 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-95c93982-3060-4d47-9b23-87d70242aceb tempest-ProjectReaderTests-1128818246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (895f9599-db07-4084-9b89-6455a251751f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:53 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-95c93982-3060-4d47-9b23-87d70242aceb tempest-ProjectReaderTests-1128818246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (895f9599-db07-4084-9b89-6455a251751f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:41:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2000363481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df1fc01b-7125-475d-9c68-8fa89e5d5857,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0dcf5b1b00845ed9eabf4d8b49498f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:41:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:41:53Z,use_quota=True,user_id='289f96a422b64fc99acbae7951190a7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:53 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-95c93982-3060-4d47-9b23-87d70242aceb tempest-ProjectReaderTests-1128818246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (588d1e6b-2bb5-4e33-ba25-4d489e996cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:53 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-95c93982-3060-4d47-9b23-87d70242aceb tempest-ProjectReaderTests-1128818246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (588d1e6b-2bb5-4e33-ba25-4d489e996cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:53 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-95c93982-3060-4d47-9b23-87d70242aceb tempest-ProjectReaderTests-1128818246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14977f8d-1ca9-47b8-8096-ce9e965caa92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:53 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-95c93982-3060-4d47-9b23-87d70242aceb tempest-ProjectReaderTests-1128818246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14977f8d-1ca9-47b8-8096-ce9e965caa92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df1fc01b-7125-475d-9c68-8fa89e5d5857', 'volume_name': 'volume-df1fc01b-7125-475d-9c68-8fa89e5d5857', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:53 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-95c93982-3060-4d47-9b23-87d70242aceb tempest-ProjectReaderTests-1128818246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (588f038a-a96e-4636-9052-4b4de6e28e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:53 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-95c93982-3060-4d47-9b23-87d70242aceb tempest-ProjectReaderTests-1128818246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (588f038a-a96e-4636-9052-4b4de6e28e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:53 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-95c93982-3060-4d47-9b23-87d70242aceb tempest-ProjectReaderTests-1128818246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9bbe1f9-c9a4-4d63-b2b3-b75f76dc7291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:53 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-95c93982-3060-4d47-9b23-87d70242aceb tempest-ProjectReaderTests-1128818246 None] Volume df1fc01b-7125-475d-9c68-8fa89e5d5857: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df1fc01b-7125-475d-9c68-8fa89e5d5857', 'volume_size': 1} Sep 28 09:41:53 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-95c93982-3060-4d47-9b23-87d70242aceb tempest-ProjectReaderTests-1128818246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:41:53 devstack sudo[108155]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:53 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-bce552ae-b413-4fa2-889d-d8684ca1f2fc tempest-ProjectMemberTests-186690331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-17f736e1-90ce-47b7-9f75-16ff038e1f0e" returned: 0 in 0.399s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:53 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-bce552ae-b413-4fa2-889d-d8684ca1f2fc tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-17f736e1-90ce-47b7-9f75-16ff038e1f0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-17f736e1-90ce-47b7-9f75-16ff038e1f0e.5c411108-3a5d-43b5-b964-d3a215e88d75 1G {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:53 devstack sudo[108160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-17f736e1-90ce-47b7-9f75-16ff038e1f0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-17f736e1-90ce-47b7-9f75-16ff038e1f0e.5c411108-3a5d-43b5-b964-d3a215e88d75 1G Sep 28 09:41:53 devstack sudo[108160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:53 devstack sudo[108160]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:53 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-bce552ae-b413-4fa2-889d-d8684ca1f2fc tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-17f736e1-90ce-47b7-9f75-16ff038e1f0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-17f736e1-90ce-47b7-9f75-16ff038e1f0e.5c411108-3a5d-43b5-b964-d3a215e88d75 1G" returned: 0 in 0.388s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:53 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-bce552ae-b413-4fa2-889d-d8684ca1f2fc tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17f736e1-90ce-47b7-9f75-16ff038e1f0e -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-17f736e1-90ce-47b7-9f75-16ff038e1f0e.5c411108-3a5d-43b5-b964-d3a215e88d75 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:53 devstack sudo[108165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17f736e1-90ce-47b7-9f75-16ff038e1f0e -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-17f736e1-90ce-47b7-9f75-16ff038e1f0e.5c411108-3a5d-43b5-b964-d3a215e88d75 Sep 28 09:41:53 devstack sudo[108165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:53 devstack sudo[108165]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:53 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-bce552ae-b413-4fa2-889d-d8684ca1f2fc tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17f736e1-90ce-47b7-9f75-16ff038e1f0e -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-17f736e1-90ce-47b7-9f75-16ff038e1f0e.5c411108-3a5d-43b5-b964-d3a215e88d75" returned: 0 in 0.275s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:53 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-bce552ae-b413-4fa2-889d-d8684ca1f2fc tempest-ProjectMemberTests-186690331 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-17f736e1-90ce-47b7-9f75-16ff038e1f0e.5c411108-3a5d-43b5-b964-d3a215e88d75 is being set with open permissions: ugo+rw Sep 28 09:41:53 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-bce552ae-b413-4fa2-889d-d8684ca1f2fc tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-17f736e1-90ce-47b7-9f75-16ff038e1f0e.5c411108-3a5d-43b5-b964-d3a215e88d75 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:54 devstack sudo[108170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-17f736e1-90ce-47b7-9f75-16ff038e1f0e.5c411108-3a5d-43b5-b964-d3a215e88d75 Sep 28 09:41:54 devstack sudo[108170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:54 devstack sudo[108170]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:54 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-bce552ae-b413-4fa2-889d-d8684ca1f2fc tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-17f736e1-90ce-47b7-9f75-16ff038e1f0e.5c411108-3a5d-43b5-b964-d3a215e88d75" returned: 0 in 0.242s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:54 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-bce552ae-b413-4fa2-889d-d8684ca1f2fc tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-17f736e1-90ce-47b7-9f75-16ff038e1f0e.info {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:54 devstack sudo[108173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-17f736e1-90ce-47b7-9f75-16ff038e1f0e.info Sep 28 09:41:54 devstack sudo[108173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:54 devstack sudo[108173]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:54 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-bce552ae-b413-4fa2-889d-d8684ca1f2fc tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-17f736e1-90ce-47b7-9f75-16ff038e1f0e.info" returned: 0 in 0.240s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:54 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-bce552ae-b413-4fa2-889d-d8684ca1f2fc tempest-ProjectMemberTests-186690331 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-17f736e1-90ce-47b7-9f75-16ff038e1f0e.info is being set with open permissions: ugo+rw Sep 28 09:41:54 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-bce552ae-b413-4fa2-889d-d8684ca1f2fc tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-17f736e1-90ce-47b7-9f75-16ff038e1f0e.info {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:54 devstack sudo[108176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-17f736e1-90ce-47b7-9f75-16ff038e1f0e.info Sep 28 09:41:54 devstack sudo[108176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:54 devstack sudo[108176]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:54 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-bce552ae-b413-4fa2-889d-d8684ca1f2fc tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-17f736e1-90ce-47b7-9f75-16ff038e1f0e.info" returned: 0 in 0.237s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:54 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-bce552ae-b413-4fa2-889d-d8684ca1f2fc tempest-ProjectMemberTests-186690331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.867s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:41:54 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-95c93982-3060-4d47-9b23-87d70242aceb tempest-ProjectReaderTests-1128818246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.473s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:41:54 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-95c93982-3060-4d47-9b23-87d70242aceb tempest-ProjectReaderTests-1128818246 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:41:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2000363481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df1fc01b-7125-475d-9c68-8fa89e5d5857,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0dcf5b1b00845ed9eabf4d8b49498f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:41:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:41:53Z,use_quota=True,user_id='289f96a422b64fc99acbae7951190a7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:41:54 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-95c93982-3060-4d47-9b23-87d70242aceb tempest-ProjectReaderTests-1128818246 None] Creating volume df1fc01b-7125-475d-9c68-8fa89e5d5857 {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:41:54 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-95c93982-3060-4d47-9b23-87d70242aceb tempest-ProjectReaderTests-1128818246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:41:54 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-95c93982-3060-4d47-9b23-87d70242aceb tempest-ProjectReaderTests-1128818246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:41:54 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-95c93982-3060-4d47-9b23-87d70242aceb tempest-ProjectReaderTests-1128818246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:41:54 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-95c93982-3060-4d47-9b23-87d70242aceb tempest-ProjectReaderTests-1128818246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:41:54 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-95c93982-3060-4d47-9b23-87d70242aceb tempest-ProjectReaderTests-1128818246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:41:54 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-95c93982-3060-4d47-9b23-87d70242aceb tempest-ProjectReaderTests-1128818246 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:41:54 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-95c93982-3060-4d47-9b23-87d70242aceb tempest-ProjectReaderTests-1128818246 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:41:54 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-95c93982-3060-4d47-9b23-87d70242aceb tempest-ProjectReaderTests-1128818246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-df1fc01b-7125-475d-9c68-8fa89e5d5857 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:54 devstack sudo[108179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-df1fc01b-7125-475d-9c68-8fa89e5d5857 1073741824 Sep 28 09:41:54 devstack sudo[108179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:54 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-bce552ae-b413-4fa2-889d-d8684ca1f2fc tempest-ProjectMemberTests-186690331 None] Create snapshot completed successfully Sep 28 09:41:55 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-2a91ae4a-9320-48b3-a43f-28ca2cb72ea1 tempest-ProjectMemberTests-186690331 None] Acquiring lock "cinder-5c411108-3a5d-43b5-b964-d3a215e88d75-delete_snapshot" by "delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:41:55 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-2a91ae4a-9320-48b3-a43f-28ca2cb72ea1 tempest-ProjectMemberTests-186690331 None] Lock "cinder-5c411108-3a5d-43b5-b964-d3a215e88d75-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:41:55 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-2a91ae4a-9320-48b3-a43f-28ca2cb72ea1 tempest-ProjectMemberTests-186690331 None] Acquiring lock "cinder-quobyte-17f736e1-90ce-47b7-9f75-16ff038e1f0e" by "delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:41:55 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-2a91ae4a-9320-48b3-a43f-28ca2cb72ea1 tempest-ProjectMemberTests-186690331 None] Lock "cinder-quobyte-17f736e1-90ce-47b7-9f75-16ff038e1f0e" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:41:55 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-2a91ae4a-9320-48b3-a43f-28ca2cb72ea1 tempest-ProjectMemberTests-186690331 None] Acquiring lock "cinder-quobyte-5c411108-3a5d-43b5-b964-d3a215e88d75" by "_delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:41:55 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-2a91ae4a-9320-48b3-a43f-28ca2cb72ea1 tempest-ProjectMemberTests-186690331 None] Lock "cinder-quobyte-5c411108-3a5d-43b5-b964-d3a215e88d75" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:41:55 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-2a91ae4a-9320-48b3-a43f-28ca2cb72ea1 tempest-ProjectMemberTests-186690331 None] Deleting offline snapshot 5c411108-3a5d-43b5-b964-d3a215e88d75 of volume 17f736e1-90ce-47b7-9f75-16ff038e1f0e {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 09:41:55 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-2a91ae4a-9320-48b3-a43f-28ca2cb72ea1 tempest-ProjectMemberTests-186690331 None] snapshot_file for this snap is: volume-17f736e1-90ce-47b7-9f75-16ff038e1f0e.5c411108-3a5d-43b5-b964-d3a215e88d75 {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 09:41:55 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a47457-4203-4dca-aebe-a374e89f1cf6]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:41:55 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2a91ae4a-9320-48b3-a43f-28ca2cb72ea1 tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-17f736e1-90ce-47b7-9f75-16ff038e1f0e.5c411108-3a5d-43b5-b964-d3a215e88d75 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:55 devstack sudo[108179]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:55 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-95c93982-3060-4d47-9b23-87d70242aceb tempest-ProjectReaderTests-1128818246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-df1fc01b-7125-475d-9c68-8fa89e5d5857 1073741824" returned: 0 in 0.508s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:55 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-95c93982-3060-4d47-9b23-87d70242aceb tempest-ProjectReaderTests-1128818246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-df1fc01b-7125-475d-9c68-8fa89e5d5857 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:55 devstack sudo[108186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-df1fc01b-7125-475d-9c68-8fa89e5d5857 Sep 28 09:41:55 devstack sudo[108186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:55 devstack sudo[108185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-17f736e1-90ce-47b7-9f75-16ff038e1f0e.5c411108-3a5d-43b5-b964-d3a215e88d75 Sep 28 09:41:55 devstack sudo[108185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:55 devstack sudo[108186]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:55 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-95c93982-3060-4d47-9b23-87d70242aceb tempest-ProjectReaderTests-1128818246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-df1fc01b-7125-475d-9c68-8fa89e5d5857" returned: 0 in 0.249s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:55 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-95c93982-3060-4d47-9b23-87d70242aceb tempest-ProjectReaderTests-1128818246 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:41:55 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-95c93982-3060-4d47-9b23-87d70242aceb tempest-ProjectReaderTests-1128818246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:41:55 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-95c93982-3060-4d47-9b23-87d70242aceb tempest-ProjectReaderTests-1128818246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9bbe1f9-c9a4-4d63-b2b3-b75f76dc7291) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df1fc01b-7125-475d-9c68-8fa89e5d5857', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:55 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-95c93982-3060-4d47-9b23-87d70242aceb tempest-ProjectReaderTests-1128818246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56eca3f9-c5fa-477f-a1cf-3168be60bb3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:41:55 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-95c93982-3060-4d47-9b23-87d70242aceb tempest-ProjectReaderTests-1128818246 None] Volume volume-df1fc01b-7125-475d-9c68-8fa89e5d5857 (df1fc01b-7125-475d-9c68-8fa89e5d5857): created successfully Sep 28 09:41:55 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-95c93982-3060-4d47-9b23-87d70242aceb tempest-ProjectReaderTests-1128818246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56eca3f9-c5fa-477f-a1cf-3168be60bb3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:41:55 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-95c93982-3060-4d47-9b23-87d70242aceb tempest-ProjectReaderTests-1128818246 None] Flow 'volume_create_manager' (e4552753-f044-4b1c-b6cf-8cbaab3ee0eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:41:55 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-95c93982-3060-4d47-9b23-87d70242aceb tempest-ProjectReaderTests-1128818246 None] Created volume successfully. Sep 28 09:41:55 devstack sudo[108185]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:55 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2a91ae4a-9320-48b3-a43f-28ca2cb72ea1 tempest-ProjectMemberTests-186690331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-17f736e1-90ce-47b7-9f75-16ff038e1f0e.5c411108-3a5d-43b5-b964-d3a215e88d75" returned: 0 in 0.395s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:55 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-2a91ae4a-9320-48b3-a43f-28ca2cb72ea1 tempest-ProjectMemberTests-186690331 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17f736e1-90ce-47b7-9f75-16ff038e1f0e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86553) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 09:41:55 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[20731962-4e49-4276-9428-0e5ca3e06414]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:41:55 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2a91ae4a-9320-48b3-a43f-28ca2cb72ea1 tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-17f736e1-90ce-47b7-9f75-16ff038e1f0e {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:55 devstack sudo[108193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-17f736e1-90ce-47b7-9f75-16ff038e1f0e Sep 28 09:41:55 devstack sudo[108193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:56 devstack sudo[108193]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:56 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2a91ae4a-9320-48b3-a43f-28ca2cb72ea1 tempest-ProjectMemberTests-186690331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-17f736e1-90ce-47b7-9f75-16ff038e1f0e" returned: 0 in 0.361s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:56 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2a91ae4a-9320-48b3-a43f-28ca2cb72ea1 tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-17f736e1-90ce-47b7-9f75-16ff038e1f0e.5c411108-3a5d-43b5-b964-d3a215e88d75 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:56 devstack sudo[108198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-17f736e1-90ce-47b7-9f75-16ff038e1f0e.5c411108-3a5d-43b5-b964-d3a215e88d75 Sep 28 09:41:56 devstack sudo[108198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:56 devstack sudo[108198]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:56 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2a91ae4a-9320-48b3-a43f-28ca2cb72ea1 tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-17f736e1-90ce-47b7-9f75-16ff038e1f0e.5c411108-3a5d-43b5-b964-d3a215e88d75" returned: 0 in 0.342s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:56 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2a91ae4a-9320-48b3-a43f-28ca2cb72ea1 tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-17f736e1-90ce-47b7-9f75-16ff038e1f0e.5c411108-3a5d-43b5-b964-d3a215e88d75 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:56 devstack sudo[108203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-17f736e1-90ce-47b7-9f75-16ff038e1f0e.5c411108-3a5d-43b5-b964-d3a215e88d75 Sep 28 09:41:56 devstack sudo[108203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:56 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-5bef9113-8bb5-45b6-b4d6-f93acfd8ae9d tempest-ProjectReaderTests-1128818246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:41:56 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-5bef9113-8bb5-45b6-b4d6-f93acfd8ae9d tempest-ProjectReaderTests-1128818246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:41:56 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-5bef9113-8bb5-45b6-b4d6-f93acfd8ae9d tempest-ProjectReaderTests-1128818246 None] Creating offline snapshot c224d762-1e27-4c2d-803b-c3f202e27f7f of volume df1fc01b-7125-475d-9c68-8fa89e5d5857 {{(pid=86553) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 09:41:56 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe25033-34cd-4d7c-9abf-051ef422ef13]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:41:56 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-5bef9113-8bb5-45b6-b4d6-f93acfd8ae9d tempest-ProjectReaderTests-1128818246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-df1fc01b-7125-475d-9c68-8fa89e5d5857 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:56 devstack sudo[108203]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:56 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2a91ae4a-9320-48b3-a43f-28ca2cb72ea1 tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-17f736e1-90ce-47b7-9f75-16ff038e1f0e.5c411108-3a5d-43b5-b964-d3a215e88d75" returned: 0 in 0.264s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:56 devstack sudo[108205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-df1fc01b-7125-475d-9c68-8fa89e5d5857 Sep 28 09:41:56 devstack sudo[108205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:56 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-2a91ae4a-9320-48b3-a43f-28ca2cb72ea1 tempest-ProjectMemberTests-186690331 None] Lock "cinder-quobyte-5c411108-3a5d-43b5-b964-d3a215e88d75" released by "_delete_snapshot" :: held 1.471s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:41:56 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-2a91ae4a-9320-48b3-a43f-28ca2cb72ea1 tempest-ProjectMemberTests-186690331 None] Lock "cinder-quobyte-17f736e1-90ce-47b7-9f75-16ff038e1f0e" released by "delete_snapshot" :: held 1.497s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:41:56 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-2a91ae4a-9320-48b3-a43f-28ca2cb72ea1 tempest-ProjectMemberTests-186690331 None] Created reservations ['62c9ef3d-016b-4d9c-92fa-7aca13c447fd', '1fbd2b66-c14c-49a1-b748-a2fe013406cd', '2ecea608-16ce-4a11-80de-6af216d59bdd', '9b8d5f93-6439-4b8c-9e00-31304c31dfd7'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:41:56 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-2a91ae4a-9320-48b3-a43f-28ca2cb72ea1 tempest-ProjectMemberTests-186690331 None] Delete snapshot completed successfully. Sep 28 09:41:56 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-2a91ae4a-9320-48b3-a43f-28ca2cb72ea1 tempest-ProjectMemberTests-186690331 None] Lock "cinder-5c411108-3a5d-43b5-b964-d3a215e88d75-delete_snapshot" released by "delete_snapshot" :: held 1.637s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:41:56 devstack sudo[108205]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:56 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-5bef9113-8bb5-45b6-b4d6-f93acfd8ae9d tempest-ProjectReaderTests-1128818246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-df1fc01b-7125-475d-9c68-8fa89e5d5857" returned: 0 in 0.385s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:56 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-5bef9113-8bb5-45b6-b4d6-f93acfd8ae9d tempest-ProjectReaderTests-1128818246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-df1fc01b-7125-475d-9c68-8fa89e5d5857,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-df1fc01b-7125-475d-9c68-8fa89e5d5857.c224d762-1e27-4c2d-803b-c3f202e27f7f 1G {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:56 devstack sudo[108211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-df1fc01b-7125-475d-9c68-8fa89e5d5857,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-df1fc01b-7125-475d-9c68-8fa89e5d5857.c224d762-1e27-4c2d-803b-c3f202e27f7f 1G Sep 28 09:41:56 devstack sudo[108211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:57 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-cb15b72e-e626-4274-b869-a661ea6e5b69 tempest-ProjectMemberTests-186690331 None] Acquiring lock "cinder-17f736e1-90ce-47b7-9f75-16ff038e1f0e-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:41:57 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-cb15b72e-e626-4274-b869-a661ea6e5b69 tempest-ProjectMemberTests-186690331 None] Lock "cinder-17f736e1-90ce-47b7-9f75-16ff038e1f0e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:41:57 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-cb15b72e-e626-4274-b869-a661ea6e5b69 tempest-ProjectMemberTests-186690331 None] Acquiring lock "cinder-quobyte-17f736e1-90ce-47b7-9f75-16ff038e1f0e" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:41:57 devstack sudo[108211]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:57 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-5bef9113-8bb5-45b6-b4d6-f93acfd8ae9d tempest-ProjectReaderTests-1128818246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-df1fc01b-7125-475d-9c68-8fa89e5d5857,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-df1fc01b-7125-475d-9c68-8fa89e5d5857.c224d762-1e27-4c2d-803b-c3f202e27f7f 1G" returned: 0 in 0.446s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:57 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-5bef9113-8bb5-45b6-b4d6-f93acfd8ae9d tempest-ProjectReaderTests-1128818246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df1fc01b-7125-475d-9c68-8fa89e5d5857 -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-df1fc01b-7125-475d-9c68-8fa89e5d5857.c224d762-1e27-4c2d-803b-c3f202e27f7f {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:57 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-cb15b72e-e626-4274-b869-a661ea6e5b69 tempest-ProjectMemberTests-186690331 None] Lock "cinder-quobyte-17f736e1-90ce-47b7-9f75-16ff038e1f0e" acquired by "delete_volume" :: waited 0.026s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:41:57 devstack sudo[108217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df1fc01b-7125-475d-9c68-8fa89e5d5857 -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-df1fc01b-7125-475d-9c68-8fa89e5d5857.c224d762-1e27-4c2d-803b-c3f202e27f7f Sep 28 09:41:57 devstack sudo[108217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:57 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf836040-1310-42b6-aabd-4698d8f55391]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:41:57 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-cb15b72e-e626-4274-b869-a661ea6e5b69 tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-17f736e1-90ce-47b7-9f75-16ff038e1f0e {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:57 devstack sudo[108219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-17f736e1-90ce-47b7-9f75-16ff038e1f0e Sep 28 09:41:57 devstack sudo[108219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:57 devstack sudo[108217]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:57 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-5bef9113-8bb5-45b6-b4d6-f93acfd8ae9d tempest-ProjectReaderTests-1128818246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df1fc01b-7125-475d-9c68-8fa89e5d5857 -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-df1fc01b-7125-475d-9c68-8fa89e5d5857.c224d762-1e27-4c2d-803b-c3f202e27f7f" returned: 0 in 0.310s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:57 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-5bef9113-8bb5-45b6-b4d6-f93acfd8ae9d tempest-ProjectReaderTests-1128818246 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-df1fc01b-7125-475d-9c68-8fa89e5d5857.c224d762-1e27-4c2d-803b-c3f202e27f7f is being set with open permissions: ugo+rw Sep 28 09:41:57 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-5bef9113-8bb5-45b6-b4d6-f93acfd8ae9d tempest-ProjectReaderTests-1128818246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-df1fc01b-7125-475d-9c68-8fa89e5d5857.c224d762-1e27-4c2d-803b-c3f202e27f7f {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:57 devstack sudo[108224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-df1fc01b-7125-475d-9c68-8fa89e5d5857.c224d762-1e27-4c2d-803b-c3f202e27f7f Sep 28 09:41:57 devstack sudo[108224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:57 devstack sudo[108219]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:57 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-cb15b72e-e626-4274-b869-a661ea6e5b69 tempest-ProjectMemberTests-186690331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-17f736e1-90ce-47b7-9f75-16ff038e1f0e" returned: 0 in 0.391s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:57 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-cb15b72e-e626-4274-b869-a661ea6e5b69 tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-17f736e1-90ce-47b7-9f75-16ff038e1f0e {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:57 devstack sudo[108229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-17f736e1-90ce-47b7-9f75-16ff038e1f0e Sep 28 09:41:57 devstack sudo[108229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:57 devstack sudo[108224]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:57 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-5bef9113-8bb5-45b6-b4d6-f93acfd8ae9d tempest-ProjectReaderTests-1128818246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-df1fc01b-7125-475d-9c68-8fa89e5d5857.c224d762-1e27-4c2d-803b-c3f202e27f7f" returned: 0 in 0.244s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:57 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-5bef9113-8bb5-45b6-b4d6-f93acfd8ae9d tempest-ProjectReaderTests-1128818246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-df1fc01b-7125-475d-9c68-8fa89e5d5857.info {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:57 devstack sudo[108232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-df1fc01b-7125-475d-9c68-8fa89e5d5857.info Sep 28 09:41:57 devstack sudo[108232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:58 devstack sudo[108229]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:58 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-cb15b72e-e626-4274-b869-a661ea6e5b69 tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-17f736e1-90ce-47b7-9f75-16ff038e1f0e" returned: 0 in 0.257s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:58 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-cb15b72e-e626-4274-b869-a661ea6e5b69 tempest-ProjectMemberTests-186690331 None] Lock "cinder-quobyte-17f736e1-90ce-47b7-9f75-16ff038e1f0e" released by "delete_volume" :: held 0.724s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:41:58 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-cb15b72e-e626-4274-b869-a661ea6e5b69 tempest-ProjectMemberTests-186690331 None] Created reservations ['fb2896ba-c60c-422e-9b03-e572c1a80712', 'fd7ebff9-9462-41f3-ac19-e658443da177', '9b7f237b-3dc9-47e2-b7c3-cfb7ed8fa9ce', '60a28ac8-30e1-4461-9920-75f42f573c4b'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:41:58 devstack sudo[108232]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:58 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-5bef9113-8bb5-45b6-b4d6-f93acfd8ae9d tempest-ProjectReaderTests-1128818246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-df1fc01b-7125-475d-9c68-8fa89e5d5857.info" returned: 0 in 0.262s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:58 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-5bef9113-8bb5-45b6-b4d6-f93acfd8ae9d tempest-ProjectReaderTests-1128818246 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-df1fc01b-7125-475d-9c68-8fa89e5d5857.info is being set with open permissions: ugo+rw Sep 28 09:41:58 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-5bef9113-8bb5-45b6-b4d6-f93acfd8ae9d tempest-ProjectReaderTests-1128818246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-df1fc01b-7125-475d-9c68-8fa89e5d5857.info {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:58 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-cb15b72e-e626-4274-b869-a661ea6e5b69 tempest-ProjectMemberTests-186690331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:41:58 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-cb15b72e-e626-4274-b869-a661ea6e5b69 tempest-ProjectMemberTests-186690331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:41:58 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-cb15b72e-e626-4274-b869-a661ea6e5b69 tempest-ProjectMemberTests-186690331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:41:58 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-cb15b72e-e626-4274-b869-a661ea6e5b69 tempest-ProjectMemberTests-186690331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:41:58 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-cb15b72e-e626-4274-b869-a661ea6e5b69 tempest-ProjectMemberTests-186690331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:41:58 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-cb15b72e-e626-4274-b869-a661ea6e5b69 tempest-ProjectMemberTests-186690331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:58 devstack sudo[108237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-df1fc01b-7125-475d-9c68-8fa89e5d5857.info Sep 28 09:41:58 devstack sudo[108237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:58 devstack sudo[108239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:41:58 devstack sudo[108239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:41:58 devstack sudo[108237]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:58 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-5bef9113-8bb5-45b6-b4d6-f93acfd8ae9d tempest-ProjectReaderTests-1128818246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-df1fc01b-7125-475d-9c68-8fa89e5d5857.info" returned: 0 in 0.271s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:58 devstack sudo[108239]: pam_unix(sudo:session): session closed for user root Sep 28 09:41:58 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-5bef9113-8bb5-45b6-b4d6-f93acfd8ae9d tempest-ProjectReaderTests-1128818246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.027s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:41:58 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-cb15b72e-e626-4274-b869-a661ea6e5b69 tempest-ProjectMemberTests-186690331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.283s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:41:58 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-cb15b72e-e626-4274-b869-a661ea6e5b69 tempest-ProjectMemberTests-186690331 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:41:58 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-cb15b72e-e626-4274-b869-a661ea6e5b69 tempest-ProjectMemberTests-186690331 None] Deleted volume successfully. Sep 28 09:41:58 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-cb15b72e-e626-4274-b869-a661ea6e5b69 tempest-ProjectMemberTests-186690331 None] Lock "cinder-17f736e1-90ce-47b7-9f75-16ff038e1f0e-delete_volume" released by "delete_volume" :: held 1.238s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:41:58 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-5bef9113-8bb5-45b6-b4d6-f93acfd8ae9d tempest-ProjectReaderTests-1128818246 None] Create snapshot completed successfully Sep 28 09:41:59 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-8c256620-334e-4d55-8393-fa70896973af tempest-ProjectReaderTests-1128818246 None] Acquiring lock "cinder-c224d762-1e27-4c2d-803b-c3f202e27f7f-delete_snapshot" by "delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:41:59 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-8c256620-334e-4d55-8393-fa70896973af tempest-ProjectReaderTests-1128818246 None] Lock "cinder-c224d762-1e27-4c2d-803b-c3f202e27f7f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:41:59 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-8c256620-334e-4d55-8393-fa70896973af tempest-ProjectReaderTests-1128818246 None] Acquiring lock "cinder-quobyte-df1fc01b-7125-475d-9c68-8fa89e5d5857" by "delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:41:59 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-8c256620-334e-4d55-8393-fa70896973af tempest-ProjectReaderTests-1128818246 None] Lock "cinder-quobyte-df1fc01b-7125-475d-9c68-8fa89e5d5857" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:41:59 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-8c256620-334e-4d55-8393-fa70896973af tempest-ProjectReaderTests-1128818246 None] Acquiring lock "cinder-quobyte-c224d762-1e27-4c2d-803b-c3f202e27f7f" by "_delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:41:59 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-8c256620-334e-4d55-8393-fa70896973af tempest-ProjectReaderTests-1128818246 None] Lock "cinder-quobyte-c224d762-1e27-4c2d-803b-c3f202e27f7f" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:41:59 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-8c256620-334e-4d55-8393-fa70896973af tempest-ProjectReaderTests-1128818246 None] Deleting offline snapshot c224d762-1e27-4c2d-803b-c3f202e27f7f of volume df1fc01b-7125-475d-9c68-8fa89e5d5857 {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 09:41:59 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-8c256620-334e-4d55-8393-fa70896973af tempest-ProjectReaderTests-1128818246 None] snapshot_file for this snap is: volume-df1fc01b-7125-475d-9c68-8fa89e5d5857.c224d762-1e27-4c2d-803b-c3f202e27f7f {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 09:41:59 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bef6c23-8d00-4622-93f8-08cb52b8f5b4]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:41:59 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-8c256620-334e-4d55-8393-fa70896973af tempest-ProjectReaderTests-1128818246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-df1fc01b-7125-475d-9c68-8fa89e5d5857.c224d762-1e27-4c2d-803b-c3f202e27f7f {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:41:59 devstack sudo[108244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-df1fc01b-7125-475d-9c68-8fa89e5d5857.c224d762-1e27-4c2d-803b-c3f202e27f7f Sep 28 09:41:59 devstack sudo[108244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:42:00 devstack sudo[108244]: pam_unix(sudo:session): session closed for user root Sep 28 09:42:00 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-8c256620-334e-4d55-8393-fa70896973af tempest-ProjectReaderTests-1128818246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-df1fc01b-7125-475d-9c68-8fa89e5d5857.c224d762-1e27-4c2d-803b-c3f202e27f7f" returned: 0 in 0.381s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:42:00 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-8c256620-334e-4d55-8393-fa70896973af tempest-ProjectReaderTests-1128818246 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df1fc01b-7125-475d-9c68-8fa89e5d5857(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86553) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 09:42:00 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c808ed-ce88-46ca-b9ce-3a833c33697c]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:42:00 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-8c256620-334e-4d55-8393-fa70896973af tempest-ProjectReaderTests-1128818246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-df1fc01b-7125-475d-9c68-8fa89e5d5857 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:42:00 devstack sudo[108249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-df1fc01b-7125-475d-9c68-8fa89e5d5857 Sep 28 09:42:00 devstack sudo[108249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:42:00 devstack sudo[108249]: pam_unix(sudo:session): session closed for user root Sep 28 09:42:00 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-8c256620-334e-4d55-8393-fa70896973af tempest-ProjectReaderTests-1128818246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-df1fc01b-7125-475d-9c68-8fa89e5d5857" returned: 0 in 0.372s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:42:00 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-8c256620-334e-4d55-8393-fa70896973af tempest-ProjectReaderTests-1128818246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-df1fc01b-7125-475d-9c68-8fa89e5d5857.c224d762-1e27-4c2d-803b-c3f202e27f7f {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:42:00 devstack sudo[108254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-df1fc01b-7125-475d-9c68-8fa89e5d5857.c224d762-1e27-4c2d-803b-c3f202e27f7f Sep 28 09:42:00 devstack sudo[108254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:42:00 devstack sudo[108254]: pam_unix(sudo:session): session closed for user root Sep 28 09:42:00 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-8c256620-334e-4d55-8393-fa70896973af tempest-ProjectReaderTests-1128818246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-df1fc01b-7125-475d-9c68-8fa89e5d5857.c224d762-1e27-4c2d-803b-c3f202e27f7f" returned: 0 in 0.358s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:42:00 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-8c256620-334e-4d55-8393-fa70896973af tempest-ProjectReaderTests-1128818246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-df1fc01b-7125-475d-9c68-8fa89e5d5857.c224d762-1e27-4c2d-803b-c3f202e27f7f {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:42:00 devstack sudo[108259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-df1fc01b-7125-475d-9c68-8fa89e5d5857.c224d762-1e27-4c2d-803b-c3f202e27f7f Sep 28 09:42:00 devstack sudo[108259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:42:01 devstack sudo[108259]: pam_unix(sudo:session): session closed for user root Sep 28 09:42:01 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-8c256620-334e-4d55-8393-fa70896973af tempest-ProjectReaderTests-1128818246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-df1fc01b-7125-475d-9c68-8fa89e5d5857.c224d762-1e27-4c2d-803b-c3f202e27f7f" returned: 0 in 0.264s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:42:01 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-8c256620-334e-4d55-8393-fa70896973af tempest-ProjectReaderTests-1128818246 None] Lock "cinder-quobyte-c224d762-1e27-4c2d-803b-c3f202e27f7f" released by "_delete_snapshot" :: held 1.488s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:42:01 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-8c256620-334e-4d55-8393-fa70896973af tempest-ProjectReaderTests-1128818246 None] Lock "cinder-quobyte-df1fc01b-7125-475d-9c68-8fa89e5d5857" released by "delete_snapshot" :: held 1.510s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:42:01 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-8c256620-334e-4d55-8393-fa70896973af tempest-ProjectReaderTests-1128818246 None] Created reservations ['a04e597a-aac5-4132-a27f-5029cf8c8570', 'b1eb65a8-26c1-4410-9f48-f654e5883a14', 'd6ade910-ff9e-4ad4-8554-2a4a446c00a5', '9841e1e4-b811-463f-86a5-b340ce559efb'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:42:01 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-8c256620-334e-4d55-8393-fa70896973af tempest-ProjectReaderTests-1128818246 None] Delete snapshot completed successfully. Sep 28 09:42:01 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-8c256620-334e-4d55-8393-fa70896973af tempest-ProjectReaderTests-1128818246 None] Lock "cinder-c224d762-1e27-4c2d-803b-c3f202e27f7f-delete_snapshot" released by "delete_snapshot" :: held 1.682s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:42:01 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-2285d17b-e24f-4480-b599-9da5a805bc21 tempest-ProjectReaderTests-1128818246 None] Acquiring lock "cinder-df1fc01b-7125-475d-9c68-8fa89e5d5857-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:42:01 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-2285d17b-e24f-4480-b599-9da5a805bc21 tempest-ProjectReaderTests-1128818246 None] Lock "cinder-df1fc01b-7125-475d-9c68-8fa89e5d5857-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:42:01 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-2285d17b-e24f-4480-b599-9da5a805bc21 tempest-ProjectReaderTests-1128818246 None] Acquiring lock "cinder-quobyte-df1fc01b-7125-475d-9c68-8fa89e5d5857" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:42:01 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-2285d17b-e24f-4480-b599-9da5a805bc21 tempest-ProjectReaderTests-1128818246 None] Lock "cinder-quobyte-df1fc01b-7125-475d-9c68-8fa89e5d5857" acquired by "delete_volume" :: waited 0.014s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:42:01 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[da14777d-7bd6-4bd2-b4fd-da1d3f7a04af]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:42:01 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2285d17b-e24f-4480-b599-9da5a805bc21 tempest-ProjectReaderTests-1128818246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-df1fc01b-7125-475d-9c68-8fa89e5d5857 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:42:02 devstack sudo[108264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-df1fc01b-7125-475d-9c68-8fa89e5d5857 Sep 28 09:42:02 devstack sudo[108264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:42:02 devstack sudo[108264]: pam_unix(sudo:session): session closed for user root Sep 28 09:42:02 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2285d17b-e24f-4480-b599-9da5a805bc21 tempest-ProjectReaderTests-1128818246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-df1fc01b-7125-475d-9c68-8fa89e5d5857" returned: 0 in 0.357s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:42:02 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2285d17b-e24f-4480-b599-9da5a805bc21 tempest-ProjectReaderTests-1128818246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-df1fc01b-7125-475d-9c68-8fa89e5d5857 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:42:02 devstack sudo[108269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-df1fc01b-7125-475d-9c68-8fa89e5d5857 Sep 28 09:42:02 devstack sudo[108269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:42:02 devstack sudo[108269]: pam_unix(sudo:session): session closed for user root Sep 28 09:42:02 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2285d17b-e24f-4480-b599-9da5a805bc21 tempest-ProjectReaderTests-1128818246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-df1fc01b-7125-475d-9c68-8fa89e5d5857" returned: 0 in 0.252s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:42:02 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-2285d17b-e24f-4480-b599-9da5a805bc21 tempest-ProjectReaderTests-1128818246 None] Lock "cinder-quobyte-df1fc01b-7125-475d-9c68-8fa89e5d5857" released by "delete_volume" :: held 0.673s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:42:02 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-2285d17b-e24f-4480-b599-9da5a805bc21 tempest-ProjectReaderTests-1128818246 None] Created reservations ['420607c3-0ea8-4205-b774-e256c0139c95', '4ed96b14-0eee-42c1-b1f8-794ab748e126', '0b7e3989-a9bd-4725-be3c-ed1a0cd2f798', 'f7af0b8f-8db7-4bc9-b277-ab17ca4a0004'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:42:02 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-2285d17b-e24f-4480-b599-9da5a805bc21 tempest-ProjectReaderTests-1128818246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:42:02 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-2285d17b-e24f-4480-b599-9da5a805bc21 tempest-ProjectReaderTests-1128818246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:42:02 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-2285d17b-e24f-4480-b599-9da5a805bc21 tempest-ProjectReaderTests-1128818246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:42:02 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-2285d17b-e24f-4480-b599-9da5a805bc21 tempest-ProjectReaderTests-1128818246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:42:02 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-2285d17b-e24f-4480-b599-9da5a805bc21 tempest-ProjectReaderTests-1128818246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:42:02 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2285d17b-e24f-4480-b599-9da5a805bc21 tempest-ProjectReaderTests-1128818246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:42:02 devstack sudo[108272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:42:02 devstack sudo[108272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:42:02 devstack sudo[108272]: pam_unix(sudo:session): session closed for user root Sep 28 09:42:02 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2285d17b-e24f-4480-b599-9da5a805bc21 tempest-ProjectReaderTests-1128818246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.269s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:42:02 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-2285d17b-e24f-4480-b599-9da5a805bc21 tempest-ProjectReaderTests-1128818246 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:42:02 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-2285d17b-e24f-4480-b599-9da5a805bc21 tempest-ProjectReaderTests-1128818246 None] Deleted volume successfully. Sep 28 09:42:02 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-2285d17b-e24f-4480-b599-9da5a805bc21 tempest-ProjectReaderTests-1128818246 None] Lock "cinder-df1fc01b-7125-475d-9c68-8fa89e5d5857-delete_volume" released by "delete_volume" :: held 1.159s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:42:03 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-f02a76f1-39d1-42aa-803e-a31a29678322 tempest-ProjectReaderTests-1128818246 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:42:03 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-f02a76f1-39d1-42aa-803e-a31a29678322 tempest-ProjectReaderTests-1128818246 None] Flow 'volume_create_manager' (15c67ed7-c3ed-42a7-bc4d-8932f5feed5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:42:03 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-f02a76f1-39d1-42aa-803e-a31a29678322 tempest-ProjectReaderTests-1128818246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9918acbd-f55c-4a41-8524-95f07b87b79b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:42:03 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-f02a76f1-39d1-42aa-803e-a31a29678322 tempest-ProjectReaderTests-1128818246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9918acbd-f55c-4a41-8524-95f07b87b79b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:42:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-961360568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f714bea-134b-4b41-9692-703d8570fa1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0dcf5b1b00845ed9eabf4d8b49498f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:42:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:42:03Z,use_quota=True,user_id='289f96a422b64fc99acbae7951190a7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:42:03 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-f02a76f1-39d1-42aa-803e-a31a29678322 tempest-ProjectReaderTests-1128818246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (246ebb94-6873-472b-a97e-f36078164791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:42:03 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-f02a76f1-39d1-42aa-803e-a31a29678322 tempest-ProjectReaderTests-1128818246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (246ebb94-6873-472b-a97e-f36078164791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:42:03 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-f02a76f1-39d1-42aa-803e-a31a29678322 tempest-ProjectReaderTests-1128818246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5592028-f22d-4978-8871-de724c82c566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:42:03 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-f02a76f1-39d1-42aa-803e-a31a29678322 tempest-ProjectReaderTests-1128818246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5592028-f22d-4978-8871-de724c82c566) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f714bea-134b-4b41-9692-703d8570fa1f', 'volume_name': 'volume-1f714bea-134b-4b41-9692-703d8570fa1f', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:42:03 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-f02a76f1-39d1-42aa-803e-a31a29678322 tempest-ProjectReaderTests-1128818246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9abe2d8-a02b-4f63-be66-6285949d59e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:42:03 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-f02a76f1-39d1-42aa-803e-a31a29678322 tempest-ProjectReaderTests-1128818246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9abe2d8-a02b-4f63-be66-6285949d59e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:42:03 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-f02a76f1-39d1-42aa-803e-a31a29678322 tempest-ProjectReaderTests-1128818246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0373623f-aefc-4834-a3dd-57d9fd7b2aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:42:03 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-f02a76f1-39d1-42aa-803e-a31a29678322 tempest-ProjectReaderTests-1128818246 None] Volume 1f714bea-134b-4b41-9692-703d8570fa1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f714bea-134b-4b41-9692-703d8570fa1f', 'volume_size': 1} Sep 28 09:42:03 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-f02a76f1-39d1-42aa-803e-a31a29678322 tempest-ProjectReaderTests-1128818246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:42:03 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-f02a76f1-39d1-42aa-803e-a31a29678322 tempest-ProjectReaderTests-1128818246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:42:03 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-f02a76f1-39d1-42aa-803e-a31a29678322 tempest-ProjectReaderTests-1128818246 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:42:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-961360568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f714bea-134b-4b41-9692-703d8570fa1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0dcf5b1b00845ed9eabf4d8b49498f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:42:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:42:03Z,use_quota=True,user_id='289f96a422b64fc99acbae7951190a7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:42:03 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-f02a76f1-39d1-42aa-803e-a31a29678322 tempest-ProjectReaderTests-1128818246 None] Creating volume 1f714bea-134b-4b41-9692-703d8570fa1f {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:42:03 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-f02a76f1-39d1-42aa-803e-a31a29678322 tempest-ProjectReaderTests-1128818246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:42:03 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-f02a76f1-39d1-42aa-803e-a31a29678322 tempest-ProjectReaderTests-1128818246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:42:03 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-f02a76f1-39d1-42aa-803e-a31a29678322 tempest-ProjectReaderTests-1128818246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:42:03 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-f02a76f1-39d1-42aa-803e-a31a29678322 tempest-ProjectReaderTests-1128818246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:42:03 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-f02a76f1-39d1-42aa-803e-a31a29678322 tempest-ProjectReaderTests-1128818246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:42:03 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-f02a76f1-39d1-42aa-803e-a31a29678322 tempest-ProjectReaderTests-1128818246 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:42:03 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-f02a76f1-39d1-42aa-803e-a31a29678322 tempest-ProjectReaderTests-1128818246 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:42:03 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f02a76f1-39d1-42aa-803e-a31a29678322 tempest-ProjectReaderTests-1128818246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1f714bea-134b-4b41-9692-703d8570fa1f 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:42:03 devstack sudo[108275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1f714bea-134b-4b41-9692-703d8570fa1f 1073741824 Sep 28 09:42:03 devstack sudo[108275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:42:04 devstack sudo[108275]: pam_unix(sudo:session): session closed for user root Sep 28 09:42:04 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f02a76f1-39d1-42aa-803e-a31a29678322 tempest-ProjectReaderTests-1128818246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1f714bea-134b-4b41-9692-703d8570fa1f 1073741824" returned: 0 in 0.411s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:42:04 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f02a76f1-39d1-42aa-803e-a31a29678322 tempest-ProjectReaderTests-1128818246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1f714bea-134b-4b41-9692-703d8570fa1f {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:42:04 devstack sudo[108280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1f714bea-134b-4b41-9692-703d8570fa1f Sep 28 09:42:04 devstack sudo[108280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:42:04 devstack sudo[108280]: pam_unix(sudo:session): session closed for user root Sep 28 09:42:04 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f02a76f1-39d1-42aa-803e-a31a29678322 tempest-ProjectReaderTests-1128818246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1f714bea-134b-4b41-9692-703d8570fa1f" returned: 0 in 0.252s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:42:04 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-f02a76f1-39d1-42aa-803e-a31a29678322 tempest-ProjectReaderTests-1128818246 None] <== create_volume: return (703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:42:04 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-f02a76f1-39d1-42aa-803e-a31a29678322 tempest-ProjectReaderTests-1128818246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.706s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:42:04 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-f02a76f1-39d1-42aa-803e-a31a29678322 tempest-ProjectReaderTests-1128818246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0373623f-aefc-4834-a3dd-57d9fd7b2aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f714bea-134b-4b41-9692-703d8570fa1f', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:42:04 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-f02a76f1-39d1-42aa-803e-a31a29678322 tempest-ProjectReaderTests-1128818246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12e56b3a-367a-4e78-977c-b4702c097235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:42:04 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-f02a76f1-39d1-42aa-803e-a31a29678322 tempest-ProjectReaderTests-1128818246 None] Volume volume-1f714bea-134b-4b41-9692-703d8570fa1f (1f714bea-134b-4b41-9692-703d8570fa1f): created successfully Sep 28 09:42:04 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-f02a76f1-39d1-42aa-803e-a31a29678322 tempest-ProjectReaderTests-1128818246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12e56b3a-367a-4e78-977c-b4702c097235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:42:04 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-f02a76f1-39d1-42aa-803e-a31a29678322 tempest-ProjectReaderTests-1128818246 None] Flow 'volume_create_manager' (15c67ed7-c3ed-42a7-bc4d-8932f5feed5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:42:04 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-f02a76f1-39d1-42aa-803e-a31a29678322 tempest-ProjectReaderTests-1128818246 None] Created volume successfully. Sep 28 09:42:05 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-54e3f35a-1fef-44a3-82e4-96962e78f3e2 tempest-ProjectReaderTests-1128818246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:42:05 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-54e3f35a-1fef-44a3-82e4-96962e78f3e2 tempest-ProjectReaderTests-1128818246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:42:05 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-54e3f35a-1fef-44a3-82e4-96962e78f3e2 tempest-ProjectReaderTests-1128818246 None] Creating offline snapshot 2e18186b-21a0-4aac-8706-08bb62c32e77 of volume 1f714bea-134b-4b41-9692-703d8570fa1f {{(pid=86553) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 09:42:05 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd50a50c-0d36-450a-b858-401f4608fe2c]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:42:05 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-54e3f35a-1fef-44a3-82e4-96962e78f3e2 tempest-ProjectReaderTests-1128818246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1f714bea-134b-4b41-9692-703d8570fa1f {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:42:05 devstack sudo[108283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1f714bea-134b-4b41-9692-703d8570fa1f Sep 28 09:42:05 devstack sudo[108283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:42:06 devstack sudo[108283]: pam_unix(sudo:session): session closed for user root Sep 28 09:42:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-54e3f35a-1fef-44a3-82e4-96962e78f3e2 tempest-ProjectReaderTests-1128818246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1f714bea-134b-4b41-9692-703d8570fa1f" returned: 0 in 0.352s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:42:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-54e3f35a-1fef-44a3-82e4-96962e78f3e2 tempest-ProjectReaderTests-1128818246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1f714bea-134b-4b41-9692-703d8570fa1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1f714bea-134b-4b41-9692-703d8570fa1f.2e18186b-21a0-4aac-8706-08bb62c32e77 1G {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:42:06 devstack sudo[108288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1f714bea-134b-4b41-9692-703d8570fa1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1f714bea-134b-4b41-9692-703d8570fa1f.2e18186b-21a0-4aac-8706-08bb62c32e77 1G Sep 28 09:42:06 devstack sudo[108288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:42:06 devstack sudo[108288]: pam_unix(sudo:session): session closed for user root Sep 28 09:42:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-54e3f35a-1fef-44a3-82e4-96962e78f3e2 tempest-ProjectReaderTests-1128818246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1f714bea-134b-4b41-9692-703d8570fa1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1f714bea-134b-4b41-9692-703d8570fa1f.2e18186b-21a0-4aac-8706-08bb62c32e77 1G" returned: 0 in 0.434s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:42:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-54e3f35a-1fef-44a3-82e4-96962e78f3e2 tempest-ProjectReaderTests-1128818246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f714bea-134b-4b41-9692-703d8570fa1f -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1f714bea-134b-4b41-9692-703d8570fa1f.2e18186b-21a0-4aac-8706-08bb62c32e77 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:42:06 devstack sudo[108294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f714bea-134b-4b41-9692-703d8570fa1f -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1f714bea-134b-4b41-9692-703d8570fa1f.2e18186b-21a0-4aac-8706-08bb62c32e77 Sep 28 09:42:06 devstack sudo[108294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:42:06 devstack sudo[108294]: pam_unix(sudo:session): session closed for user root Sep 28 09:42:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-54e3f35a-1fef-44a3-82e4-96962e78f3e2 tempest-ProjectReaderTests-1128818246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f714bea-134b-4b41-9692-703d8570fa1f -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1f714bea-134b-4b41-9692-703d8570fa1f.2e18186b-21a0-4aac-8706-08bb62c32e77" returned: 0 in 0.303s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:42:06 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-54e3f35a-1fef-44a3-82e4-96962e78f3e2 tempest-ProjectReaderTests-1128818246 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1f714bea-134b-4b41-9692-703d8570fa1f.2e18186b-21a0-4aac-8706-08bb62c32e77 is being set with open permissions: ugo+rw Sep 28 09:42:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-54e3f35a-1fef-44a3-82e4-96962e78f3e2 tempest-ProjectReaderTests-1128818246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1f714bea-134b-4b41-9692-703d8570fa1f.2e18186b-21a0-4aac-8706-08bb62c32e77 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:42:06 devstack sudo[108299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1f714bea-134b-4b41-9692-703d8570fa1f.2e18186b-21a0-4aac-8706-08bb62c32e77 Sep 28 09:42:06 devstack sudo[108299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:42:07 devstack sudo[108299]: pam_unix(sudo:session): session closed for user root Sep 28 09:42:07 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-54e3f35a-1fef-44a3-82e4-96962e78f3e2 tempest-ProjectReaderTests-1128818246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1f714bea-134b-4b41-9692-703d8570fa1f.2e18186b-21a0-4aac-8706-08bb62c32e77" returned: 0 in 0.248s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:42:07 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-54e3f35a-1fef-44a3-82e4-96962e78f3e2 tempest-ProjectReaderTests-1128818246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1f714bea-134b-4b41-9692-703d8570fa1f.info {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:42:07 devstack sudo[108302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1f714bea-134b-4b41-9692-703d8570fa1f.info Sep 28 09:42:07 devstack sudo[108302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:42:07 devstack sudo[108302]: pam_unix(sudo:session): session closed for user root Sep 28 09:42:07 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-54e3f35a-1fef-44a3-82e4-96962e78f3e2 tempest-ProjectReaderTests-1128818246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1f714bea-134b-4b41-9692-703d8570fa1f.info" returned: 0 in 0.279s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:42:07 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-54e3f35a-1fef-44a3-82e4-96962e78f3e2 tempest-ProjectReaderTests-1128818246 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1f714bea-134b-4b41-9692-703d8570fa1f.info is being set with open permissions: ugo+rw Sep 28 09:42:07 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-54e3f35a-1fef-44a3-82e4-96962e78f3e2 tempest-ProjectReaderTests-1128818246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1f714bea-134b-4b41-9692-703d8570fa1f.info {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:42:07 devstack sudo[108305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1f714bea-134b-4b41-9692-703d8570fa1f.info Sep 28 09:42:07 devstack sudo[108305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:42:07 devstack sudo[108305]: pam_unix(sudo:session): session closed for user root Sep 28 09:42:07 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-54e3f35a-1fef-44a3-82e4-96962e78f3e2 tempest-ProjectReaderTests-1128818246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1f714bea-134b-4b41-9692-703d8570fa1f.info" returned: 0 in 0.263s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:42:07 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-54e3f35a-1fef-44a3-82e4-96962e78f3e2 tempest-ProjectReaderTests-1128818246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.969s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:42:07 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-54e3f35a-1fef-44a3-82e4-96962e78f3e2 tempest-ProjectReaderTests-1128818246 None] Create snapshot completed successfully Sep 28 09:42:07 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-13eb9134-f297-4a6b-bdf2-be12201727ef tempest-ProjectReaderTests-1128818246 None] Acquiring lock "cinder-2e18186b-21a0-4aac-8706-08bb62c32e77-delete_snapshot" by "delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:42:07 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-13eb9134-f297-4a6b-bdf2-be12201727ef tempest-ProjectReaderTests-1128818246 None] Lock "cinder-2e18186b-21a0-4aac-8706-08bb62c32e77-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:42:07 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-13eb9134-f297-4a6b-bdf2-be12201727ef tempest-ProjectReaderTests-1128818246 None] Acquiring lock "cinder-quobyte-1f714bea-134b-4b41-9692-703d8570fa1f" by "delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:42:07 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-13eb9134-f297-4a6b-bdf2-be12201727ef tempest-ProjectReaderTests-1128818246 None] Lock "cinder-quobyte-1f714bea-134b-4b41-9692-703d8570fa1f" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:42:07 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-13eb9134-f297-4a6b-bdf2-be12201727ef tempest-ProjectReaderTests-1128818246 None] Acquiring lock "cinder-quobyte-2e18186b-21a0-4aac-8706-08bb62c32e77" by "_delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:42:07 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-13eb9134-f297-4a6b-bdf2-be12201727ef tempest-ProjectReaderTests-1128818246 None] Lock "cinder-quobyte-2e18186b-21a0-4aac-8706-08bb62c32e77" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:42:07 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-13eb9134-f297-4a6b-bdf2-be12201727ef tempest-ProjectReaderTests-1128818246 None] Deleting offline snapshot 2e18186b-21a0-4aac-8706-08bb62c32e77 of volume 1f714bea-134b-4b41-9692-703d8570fa1f {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 09:42:07 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-13eb9134-f297-4a6b-bdf2-be12201727ef tempest-ProjectReaderTests-1128818246 None] snapshot_file for this snap is: volume-1f714bea-134b-4b41-9692-703d8570fa1f.2e18186b-21a0-4aac-8706-08bb62c32e77 {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 09:42:07 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9559d8d-1426-49e8-95eb-da955fba64d7]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:42:07 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-13eb9134-f297-4a6b-bdf2-be12201727ef tempest-ProjectReaderTests-1128818246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1f714bea-134b-4b41-9692-703d8570fa1f.2e18186b-21a0-4aac-8706-08bb62c32e77 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:42:08 devstack sudo[108308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1f714bea-134b-4b41-9692-703d8570fa1f.2e18186b-21a0-4aac-8706-08bb62c32e77 Sep 28 09:42:08 devstack sudo[108308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:42:08 devstack sudo[108308]: pam_unix(sudo:session): session closed for user root Sep 28 09:42:08 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-13eb9134-f297-4a6b-bdf2-be12201727ef tempest-ProjectReaderTests-1128818246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1f714bea-134b-4b41-9692-703d8570fa1f.2e18186b-21a0-4aac-8706-08bb62c32e77" returned: 0 in 0.384s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:42:08 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-13eb9134-f297-4a6b-bdf2-be12201727ef tempest-ProjectReaderTests-1128818246 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f714bea-134b-4b41-9692-703d8570fa1f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86553) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 09:42:08 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[b128d729-238d-418b-84e4-c9ebbd7fd294]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:42:08 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-13eb9134-f297-4a6b-bdf2-be12201727ef tempest-ProjectReaderTests-1128818246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1f714bea-134b-4b41-9692-703d8570fa1f {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:42:08 devstack sudo[108314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1f714bea-134b-4b41-9692-703d8570fa1f Sep 28 09:42:08 devstack sudo[108314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:42:08 devstack sudo[108314]: pam_unix(sudo:session): session closed for user root Sep 28 09:42:08 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-13eb9134-f297-4a6b-bdf2-be12201727ef tempest-ProjectReaderTests-1128818246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1f714bea-134b-4b41-9692-703d8570fa1f" returned: 0 in 0.386s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:42:08 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-13eb9134-f297-4a6b-bdf2-be12201727ef tempest-ProjectReaderTests-1128818246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1f714bea-134b-4b41-9692-703d8570fa1f.2e18186b-21a0-4aac-8706-08bb62c32e77 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:42:08 devstack sudo[108319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1f714bea-134b-4b41-9692-703d8570fa1f.2e18186b-21a0-4aac-8706-08bb62c32e77 Sep 28 09:42:08 devstack sudo[108319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:42:09 devstack sudo[108319]: pam_unix(sudo:session): session closed for user root Sep 28 09:42:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-13eb9134-f297-4a6b-bdf2-be12201727ef tempest-ProjectReaderTests-1128818246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1f714bea-134b-4b41-9692-703d8570fa1f.2e18186b-21a0-4aac-8706-08bb62c32e77" returned: 0 in 0.346s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:42:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-13eb9134-f297-4a6b-bdf2-be12201727ef tempest-ProjectReaderTests-1128818246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1f714bea-134b-4b41-9692-703d8570fa1f.2e18186b-21a0-4aac-8706-08bb62c32e77 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:42:09 devstack sudo[108324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1f714bea-134b-4b41-9692-703d8570fa1f.2e18186b-21a0-4aac-8706-08bb62c32e77 Sep 28 09:42:09 devstack sudo[108324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:42:09 devstack sudo[108324]: pam_unix(sudo:session): session closed for user root Sep 28 09:42:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-13eb9134-f297-4a6b-bdf2-be12201727ef tempest-ProjectReaderTests-1128818246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1f714bea-134b-4b41-9692-703d8570fa1f.2e18186b-21a0-4aac-8706-08bb62c32e77" returned: 0 in 0.267s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:42:09 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-13eb9134-f297-4a6b-bdf2-be12201727ef tempest-ProjectReaderTests-1128818246 None] Lock "cinder-quobyte-2e18186b-21a0-4aac-8706-08bb62c32e77" released by "_delete_snapshot" :: held 1.503s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:42:09 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-13eb9134-f297-4a6b-bdf2-be12201727ef tempest-ProjectReaderTests-1128818246 None] Lock "cinder-quobyte-1f714bea-134b-4b41-9692-703d8570fa1f" released by "delete_snapshot" :: held 1.529s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:42:09 devstack cinder-volume[86553]: DEBUG dbcounter [-] [86553] Writing DB stats cinder:UPDATE=251,cinder:SELECT=192,cinder:INSERT=65,cinder:DELETE=21 {{(pid=86553) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 09:42:09 devstack cinder-volume[86553]: DEBUG dbcounter [-] [86553] Writing DB stats cinder:UPDATE=261,cinder:DELETE=23,cinder:SELECT=184,cinder:INSERT=69 {{(pid=86553) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 09:42:09 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-13eb9134-f297-4a6b-bdf2-be12201727ef tempest-ProjectReaderTests-1128818246 None] Created reservations ['2a26cb6c-d562-41e1-9dec-1919ff8c6c02', '2233cd1c-9f81-4712-acb4-531a176d0a93', '0196f8e2-b6ad-4009-940c-3f2b01f98fd3', 'c50e6681-ff2f-46c1-9fd9-b51ef16c9248'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:42:09 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-13eb9134-f297-4a6b-bdf2-be12201727ef tempest-ProjectReaderTests-1128818246 None] Delete snapshot completed successfully. Sep 28 09:42:09 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-13eb9134-f297-4a6b-bdf2-be12201727ef tempest-ProjectReaderTests-1128818246 None] Lock "cinder-2e18186b-21a0-4aac-8706-08bb62c32e77-delete_snapshot" released by "delete_snapshot" :: held 1.678s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:42:09 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-2e514b15-ffca-41a2-8e77-0a9f16ec43dd tempest-ProjectReaderTests-1128818246 None] Acquiring lock "cinder-1f714bea-134b-4b41-9692-703d8570fa1f-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:42:10 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-2e514b15-ffca-41a2-8e77-0a9f16ec43dd tempest-ProjectReaderTests-1128818246 None] Lock "cinder-1f714bea-134b-4b41-9692-703d8570fa1f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:42:10 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-2e514b15-ffca-41a2-8e77-0a9f16ec43dd tempest-ProjectReaderTests-1128818246 None] Acquiring lock "cinder-quobyte-1f714bea-134b-4b41-9692-703d8570fa1f" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:42:10 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-2e514b15-ffca-41a2-8e77-0a9f16ec43dd tempest-ProjectReaderTests-1128818246 None] Lock "cinder-quobyte-1f714bea-134b-4b41-9692-703d8570fa1f" acquired by "delete_volume" :: waited 0.016s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:42:10 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[5383a29e-2b0b-4ffb-829a-18152379a251]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:42:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2e514b15-ffca-41a2-8e77-0a9f16ec43dd tempest-ProjectReaderTests-1128818246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1f714bea-134b-4b41-9692-703d8570fa1f {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:42:10 devstack sudo[108327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1f714bea-134b-4b41-9692-703d8570fa1f Sep 28 09:42:10 devstack sudo[108327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:42:10 devstack sudo[108327]: pam_unix(sudo:session): session closed for user root Sep 28 09:42:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2e514b15-ffca-41a2-8e77-0a9f16ec43dd tempest-ProjectReaderTests-1128818246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1f714bea-134b-4b41-9692-703d8570fa1f" returned: 0 in 0.361s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:42:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2e514b15-ffca-41a2-8e77-0a9f16ec43dd tempest-ProjectReaderTests-1128818246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1f714bea-134b-4b41-9692-703d8570fa1f {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:42:10 devstack sudo[108332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1f714bea-134b-4b41-9692-703d8570fa1f Sep 28 09:42:10 devstack sudo[108332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:42:10 devstack sudo[108332]: pam_unix(sudo:session): session closed for user root Sep 28 09:42:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2e514b15-ffca-41a2-8e77-0a9f16ec43dd tempest-ProjectReaderTests-1128818246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-1f714bea-134b-4b41-9692-703d8570fa1f" returned: 0 in 0.254s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:42:10 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-2e514b15-ffca-41a2-8e77-0a9f16ec43dd tempest-ProjectReaderTests-1128818246 None] Lock "cinder-quobyte-1f714bea-134b-4b41-9692-703d8570fa1f" released by "delete_volume" :: held 0.687s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:42:10 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-2e514b15-ffca-41a2-8e77-0a9f16ec43dd tempest-ProjectReaderTests-1128818246 None] Created reservations ['4a841484-c947-4be0-b325-8de73ece0c96', 'f9bfed7a-038e-4c1d-8f7a-45b2307da4f8', 'e8c14a14-542f-4f10-b759-3864d87147d8', '79ea09cc-a918-4e00-b834-9665d2c9cd2d'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:42:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-2e514b15-ffca-41a2-8e77-0a9f16ec43dd tempest-ProjectReaderTests-1128818246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:42:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-2e514b15-ffca-41a2-8e77-0a9f16ec43dd tempest-ProjectReaderTests-1128818246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:42:10 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-2e514b15-ffca-41a2-8e77-0a9f16ec43dd tempest-ProjectReaderTests-1128818246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:42:10 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-2e514b15-ffca-41a2-8e77-0a9f16ec43dd tempest-ProjectReaderTests-1128818246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:42:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-2e514b15-ffca-41a2-8e77-0a9f16ec43dd tempest-ProjectReaderTests-1128818246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:42:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2e514b15-ffca-41a2-8e77-0a9f16ec43dd tempest-ProjectReaderTests-1128818246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:42:10 devstack sudo[108335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:42:10 devstack sudo[108335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:42:11 devstack sudo[108335]: pam_unix(sudo:session): session closed for user root Sep 28 09:42:11 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-2e514b15-ffca-41a2-8e77-0a9f16ec43dd tempest-ProjectReaderTests-1128818246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.255s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:42:11 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-2e514b15-ffca-41a2-8e77-0a9f16ec43dd tempest-ProjectReaderTests-1128818246 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:42:11 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-2e514b15-ffca-41a2-8e77-0a9f16ec43dd tempest-ProjectReaderTests-1128818246 None] Deleted volume successfully. Sep 28 09:42:11 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-2e514b15-ffca-41a2-8e77-0a9f16ec43dd tempest-ProjectReaderTests-1128818246 None] Lock "cinder-1f714bea-134b-4b41-9692-703d8570fa1f-delete_volume" released by "delete_volume" :: held 1.144s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:42:20 devstack cinder-volume[86553]: DEBUG dbcounter [-] [86553] Writing DB stats cinder:SELECT=10,cinder:INSERT=4,cinder:UPDATE=13 {{(pid=86553) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 09:42:21 devstack cinder-volume[86553]: DEBUG dbcounter [-] [86553] Writing DB stats cinder:SELECT=7,cinder:INSERT=4,cinder:UPDATE=14,cinder:DELETE=1 {{(pid=86553) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 09:42:21 devstack cinder-volume[86553]: DEBUG oslo_service.periodic_task [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86553) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 09:42:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:42:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:42:21 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:42:21 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:42:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:42:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:42:21 devstack sudo[108340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:42:21 devstack sudo[108340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:42:21 devstack sudo[108340]: pam_unix(sudo:session): session closed for user root Sep 28 09:42:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.266s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:42:21 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:42:21 devstack cinder-volume[86553]: DEBUG oslo_service.periodic_task [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Running periodic task VolumeManager._thread_info {{(pid=86553) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 09:42:21 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] thread count: 28 {{(pid=86553) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 09:42:21 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] thread info: [<_MainThread(MainThread, started 134684877779072)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86553) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 09:42:22 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3ef18f0-22d6-4753-9105-09a2ccaec26b tempest-ProjectReaderTests-346463393 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:42:22 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-a3ef18f0-22d6-4753-9105-09a2ccaec26b tempest-ProjectReaderTests-346463393 None] Flow 'volume_create_manager' (63cbd114-397f-45da-bfd8-cc18f5e2a354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:42:22 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-a3ef18f0-22d6-4753-9105-09a2ccaec26b tempest-ProjectReaderTests-346463393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (036145c3-ca88-42ea-9a1a-35291cf32e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:42:22 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-a3ef18f0-22d6-4753-9105-09a2ccaec26b tempest-ProjectReaderTests-346463393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (036145c3-ca88-42ea-9a1a-35291cf32e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:42:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1023962792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50116b81-7db2-46c5-bf29-8f969612313a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ebdd5a1f33f400cae3aa89908488380',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:42:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:42:23Z,use_quota=True,user_id='8fc1fae2ea59441490e377c2ccc5b058',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:42:22 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-a3ef18f0-22d6-4753-9105-09a2ccaec26b tempest-ProjectReaderTests-346463393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d383764-f34c-410d-82b6-d5f4f56ef1e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:42:22 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-a3ef18f0-22d6-4753-9105-09a2ccaec26b tempest-ProjectReaderTests-346463393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d383764-f34c-410d-82b6-d5f4f56ef1e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:42:22 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-a3ef18f0-22d6-4753-9105-09a2ccaec26b tempest-ProjectReaderTests-346463393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41eb8ce6-6e2e-4714-b859-47e29aef094e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:42:22 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-a3ef18f0-22d6-4753-9105-09a2ccaec26b tempest-ProjectReaderTests-346463393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41eb8ce6-6e2e-4714-b859-47e29aef094e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50116b81-7db2-46c5-bf29-8f969612313a', 'volume_name': 'volume-50116b81-7db2-46c5-bf29-8f969612313a', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:42:22 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-a3ef18f0-22d6-4753-9105-09a2ccaec26b tempest-ProjectReaderTests-346463393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63786d99-569d-48ce-8993-851402c59277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:42:22 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-a3ef18f0-22d6-4753-9105-09a2ccaec26b tempest-ProjectReaderTests-346463393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63786d99-569d-48ce-8993-851402c59277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:42:22 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-a3ef18f0-22d6-4753-9105-09a2ccaec26b tempest-ProjectReaderTests-346463393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d0b3a0e-9aeb-4893-916f-16f988dfae3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:42:22 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-a3ef18f0-22d6-4753-9105-09a2ccaec26b tempest-ProjectReaderTests-346463393 None] Volume 50116b81-7db2-46c5-bf29-8f969612313a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50116b81-7db2-46c5-bf29-8f969612313a', 'volume_size': 1} Sep 28 09:42:22 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-a3ef18f0-22d6-4753-9105-09a2ccaec26b tempest-ProjectReaderTests-346463393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:42:22 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-a3ef18f0-22d6-4753-9105-09a2ccaec26b tempest-ProjectReaderTests-346463393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:42:22 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-a3ef18f0-22d6-4753-9105-09a2ccaec26b tempest-ProjectReaderTests-346463393 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:42:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1023962792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50116b81-7db2-46c5-bf29-8f969612313a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ebdd5a1f33f400cae3aa89908488380',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:42:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:42:23Z,use_quota=True,user_id='8fc1fae2ea59441490e377c2ccc5b058',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:42:22 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-a3ef18f0-22d6-4753-9105-09a2ccaec26b tempest-ProjectReaderTests-346463393 None] Creating volume 50116b81-7db2-46c5-bf29-8f969612313a {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:42:22 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-a3ef18f0-22d6-4753-9105-09a2ccaec26b tempest-ProjectReaderTests-346463393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:42:22 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-a3ef18f0-22d6-4753-9105-09a2ccaec26b tempest-ProjectReaderTests-346463393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:42:22 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-a3ef18f0-22d6-4753-9105-09a2ccaec26b tempest-ProjectReaderTests-346463393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:42:22 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-a3ef18f0-22d6-4753-9105-09a2ccaec26b tempest-ProjectReaderTests-346463393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:42:22 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-a3ef18f0-22d6-4753-9105-09a2ccaec26b tempest-ProjectReaderTests-346463393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:42:22 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-a3ef18f0-22d6-4753-9105-09a2ccaec26b tempest-ProjectReaderTests-346463393 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:42:22 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-a3ef18f0-22d6-4753-9105-09a2ccaec26b tempest-ProjectReaderTests-346463393 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:42:22 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a3ef18f0-22d6-4753-9105-09a2ccaec26b tempest-ProjectReaderTests-346463393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-50116b81-7db2-46c5-bf29-8f969612313a 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:42:22 devstack sudo[108344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-50116b81-7db2-46c5-bf29-8f969612313a 1073741824 Sep 28 09:42:22 devstack sudo[108344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:42:23 devstack sudo[108344]: pam_unix(sudo:session): session closed for user root Sep 28 09:42:23 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a3ef18f0-22d6-4753-9105-09a2ccaec26b tempest-ProjectReaderTests-346463393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-50116b81-7db2-46c5-bf29-8f969612313a 1073741824" returned: 0 in 0.397s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:42:23 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a3ef18f0-22d6-4753-9105-09a2ccaec26b tempest-ProjectReaderTests-346463393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-50116b81-7db2-46c5-bf29-8f969612313a {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:42:23 devstack sudo[108349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-50116b81-7db2-46c5-bf29-8f969612313a Sep 28 09:42:23 devstack sudo[108349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:42:23 devstack sudo[108349]: pam_unix(sudo:session): session closed for user root Sep 28 09:42:23 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-a3ef18f0-22d6-4753-9105-09a2ccaec26b tempest-ProjectReaderTests-346463393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-50116b81-7db2-46c5-bf29-8f969612313a" returned: 0 in 0.239s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:42:23 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-a3ef18f0-22d6-4753-9105-09a2ccaec26b tempest-ProjectReaderTests-346463393 None] <== create_volume: return (675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:42:23 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-a3ef18f0-22d6-4753-9105-09a2ccaec26b tempest-ProjectReaderTests-346463393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.678s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:42:23 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-a3ef18f0-22d6-4753-9105-09a2ccaec26b tempest-ProjectReaderTests-346463393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d0b3a0e-9aeb-4893-916f-16f988dfae3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50116b81-7db2-46c5-bf29-8f969612313a', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:42:23 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-a3ef18f0-22d6-4753-9105-09a2ccaec26b tempest-ProjectReaderTests-346463393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a86f581-d3ff-4804-a1cc-c631afeaa424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:42:23 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-a3ef18f0-22d6-4753-9105-09a2ccaec26b tempest-ProjectReaderTests-346463393 None] Volume volume-50116b81-7db2-46c5-bf29-8f969612313a (50116b81-7db2-46c5-bf29-8f969612313a): created successfully Sep 28 09:42:23 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-a3ef18f0-22d6-4753-9105-09a2ccaec26b tempest-ProjectReaderTests-346463393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a86f581-d3ff-4804-a1cc-c631afeaa424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:42:23 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-a3ef18f0-22d6-4753-9105-09a2ccaec26b tempest-ProjectReaderTests-346463393 None] Flow 'volume_create_manager' (63cbd114-397f-45da-bfd8-cc18f5e2a354) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:42:23 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-a3ef18f0-22d6-4753-9105-09a2ccaec26b tempest-ProjectReaderTests-346463393 None] Created volume successfully. Sep 28 09:42:23 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-04257408-8f67-43b3-9afc-0d7c27012ec4 tempest-ProjectReaderTests-346463393 None] Acquiring lock "cinder-50116b81-7db2-46c5-bf29-8f969612313a-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:42:23 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-04257408-8f67-43b3-9afc-0d7c27012ec4 tempest-ProjectReaderTests-346463393 None] Lock "cinder-50116b81-7db2-46c5-bf29-8f969612313a-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:42:24 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-04257408-8f67-43b3-9afc-0d7c27012ec4 tempest-ProjectReaderTests-346463393 None] Acquiring lock "cinder-quobyte-50116b81-7db2-46c5-bf29-8f969612313a" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:42:24 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-04257408-8f67-43b3-9afc-0d7c27012ec4 tempest-ProjectReaderTests-346463393 None] Lock "cinder-quobyte-50116b81-7db2-46c5-bf29-8f969612313a" acquired by "delete_volume" :: waited 0.014s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:42:24 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[2595accc-932b-4494-b655-9507213d536c]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:42:24 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-04257408-8f67-43b3-9afc-0d7c27012ec4 tempest-ProjectReaderTests-346463393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-50116b81-7db2-46c5-bf29-8f969612313a {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:42:24 devstack sudo[108352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-50116b81-7db2-46c5-bf29-8f969612313a Sep 28 09:42:24 devstack sudo[108352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:42:24 devstack sudo[108352]: pam_unix(sudo:session): session closed for user root Sep 28 09:42:24 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-04257408-8f67-43b3-9afc-0d7c27012ec4 tempest-ProjectReaderTests-346463393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-50116b81-7db2-46c5-bf29-8f969612313a" returned: 0 in 0.355s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:42:24 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-04257408-8f67-43b3-9afc-0d7c27012ec4 tempest-ProjectReaderTests-346463393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-50116b81-7db2-46c5-bf29-8f969612313a {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:42:24 devstack sudo[108357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-50116b81-7db2-46c5-bf29-8f969612313a Sep 28 09:42:24 devstack sudo[108357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:42:24 devstack sudo[108357]: pam_unix(sudo:session): session closed for user root Sep 28 09:42:24 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-04257408-8f67-43b3-9afc-0d7c27012ec4 tempest-ProjectReaderTests-346463393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-50116b81-7db2-46c5-bf29-8f969612313a" returned: 0 in 0.241s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:42:24 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-04257408-8f67-43b3-9afc-0d7c27012ec4 tempest-ProjectReaderTests-346463393 None] Lock "cinder-quobyte-50116b81-7db2-46c5-bf29-8f969612313a" released by "delete_volume" :: held 0.636s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:42:24 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-04257408-8f67-43b3-9afc-0d7c27012ec4 tempest-ProjectReaderTests-346463393 None] Created reservations ['475e5ac0-ddeb-4a3b-90c3-f1ce86c9fe0d', '1306c5bd-9bf3-452e-9aeb-984183be3e78', '0d07a392-8bbc-4414-a460-99c354eb9434', 'cf70a1b6-f8f8-42dc-a357-840dd43a6f7e'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:42:24 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-04257408-8f67-43b3-9afc-0d7c27012ec4 tempest-ProjectReaderTests-346463393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:42:24 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-04257408-8f67-43b3-9afc-0d7c27012ec4 tempest-ProjectReaderTests-346463393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:42:24 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-04257408-8f67-43b3-9afc-0d7c27012ec4 tempest-ProjectReaderTests-346463393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:42:24 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-04257408-8f67-43b3-9afc-0d7c27012ec4 tempest-ProjectReaderTests-346463393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:42:24 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-04257408-8f67-43b3-9afc-0d7c27012ec4 tempest-ProjectReaderTests-346463393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:42:24 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-04257408-8f67-43b3-9afc-0d7c27012ec4 tempest-ProjectReaderTests-346463393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:42:24 devstack sudo[108360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:42:24 devstack sudo[108360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:42:25 devstack sudo[108360]: pam_unix(sudo:session): session closed for user root Sep 28 09:42:25 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-04257408-8f67-43b3-9afc-0d7c27012ec4 tempest-ProjectReaderTests-346463393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.240s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:42:25 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-04257408-8f67-43b3-9afc-0d7c27012ec4 tempest-ProjectReaderTests-346463393 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:42:25 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-04257408-8f67-43b3-9afc-0d7c27012ec4 tempest-ProjectReaderTests-346463393 None] Deleted volume successfully. Sep 28 09:42:25 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-04257408-8f67-43b3-9afc-0d7c27012ec4 tempest-ProjectReaderTests-346463393 None] Lock "cinder-50116b81-7db2-46c5-bf29-8f969612313a-delete_volume" released by "delete_volume" :: held 1.076s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:42:25 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-e37a08fe-f568-48e7-8be3-31c8694cde90 tempest-ProjectReaderTests-346463393 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:42:25 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e37a08fe-f568-48e7-8be3-31c8694cde90 tempest-ProjectReaderTests-346463393 None] Flow 'volume_create_manager' (eaec6b32-68e9-4ba9-8405-e789714fef51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:42:25 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e37a08fe-f568-48e7-8be3-31c8694cde90 tempest-ProjectReaderTests-346463393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1de2d7a-d1fb-4bf5-bf1d-391fcebcd774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:42:25 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e37a08fe-f568-48e7-8be3-31c8694cde90 tempest-ProjectReaderTests-346463393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1de2d7a-d1fb-4bf5-bf1d-391fcebcd774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:42:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1041012436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec4eae95-4ee4-4356-a49b-ba3855317b1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ebdd5a1f33f400cae3aa89908488380',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:42:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:42:25Z,use_quota=True,user_id='8fc1fae2ea59441490e377c2ccc5b058',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:42:25 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e37a08fe-f568-48e7-8be3-31c8694cde90 tempest-ProjectReaderTests-346463393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a05e23b1-c040-49d1-bff6-ef86ba769044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:42:25 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e37a08fe-f568-48e7-8be3-31c8694cde90 tempest-ProjectReaderTests-346463393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a05e23b1-c040-49d1-bff6-ef86ba769044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:42:25 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e37a08fe-f568-48e7-8be3-31c8694cde90 tempest-ProjectReaderTests-346463393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0731da5f-f79f-4776-90d5-d05dfe3d6850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:42:25 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e37a08fe-f568-48e7-8be3-31c8694cde90 tempest-ProjectReaderTests-346463393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0731da5f-f79f-4776-90d5-d05dfe3d6850) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec4eae95-4ee4-4356-a49b-ba3855317b1b', 'volume_name': 'volume-ec4eae95-4ee4-4356-a49b-ba3855317b1b', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:42:25 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e37a08fe-f568-48e7-8be3-31c8694cde90 tempest-ProjectReaderTests-346463393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c95e092-1007-4af8-a850-51b2a230cb8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:42:25 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e37a08fe-f568-48e7-8be3-31c8694cde90 tempest-ProjectReaderTests-346463393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c95e092-1007-4af8-a850-51b2a230cb8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:42:25 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e37a08fe-f568-48e7-8be3-31c8694cde90 tempest-ProjectReaderTests-346463393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11f0926d-9855-4876-9d12-bc83afeb1ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:42:25 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-e37a08fe-f568-48e7-8be3-31c8694cde90 tempest-ProjectReaderTests-346463393 None] Volume ec4eae95-4ee4-4356-a49b-ba3855317b1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec4eae95-4ee4-4356-a49b-ba3855317b1b', 'volume_size': 1} Sep 28 09:42:25 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-e37a08fe-f568-48e7-8be3-31c8694cde90 tempest-ProjectReaderTests-346463393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:42:25 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-e37a08fe-f568-48e7-8be3-31c8694cde90 tempest-ProjectReaderTests-346463393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:42:25 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-e37a08fe-f568-48e7-8be3-31c8694cde90 tempest-ProjectReaderTests-346463393 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:42:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1041012436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec4eae95-4ee4-4356-a49b-ba3855317b1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ebdd5a1f33f400cae3aa89908488380',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:42:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:42:25Z,use_quota=True,user_id='8fc1fae2ea59441490e377c2ccc5b058',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:42:25 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-e37a08fe-f568-48e7-8be3-31c8694cde90 tempest-ProjectReaderTests-346463393 None] Creating volume ec4eae95-4ee4-4356-a49b-ba3855317b1b {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:42:25 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-e37a08fe-f568-48e7-8be3-31c8694cde90 tempest-ProjectReaderTests-346463393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:42:25 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-e37a08fe-f568-48e7-8be3-31c8694cde90 tempest-ProjectReaderTests-346463393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:42:25 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-e37a08fe-f568-48e7-8be3-31c8694cde90 tempest-ProjectReaderTests-346463393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:42:25 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-e37a08fe-f568-48e7-8be3-31c8694cde90 tempest-ProjectReaderTests-346463393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:42:25 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-e37a08fe-f568-48e7-8be3-31c8694cde90 tempest-ProjectReaderTests-346463393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:42:25 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-e37a08fe-f568-48e7-8be3-31c8694cde90 tempest-ProjectReaderTests-346463393 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:42:25 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-e37a08fe-f568-48e7-8be3-31c8694cde90 tempest-ProjectReaderTests-346463393 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:42:25 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e37a08fe-f568-48e7-8be3-31c8694cde90 tempest-ProjectReaderTests-346463393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-ec4eae95-4ee4-4356-a49b-ba3855317b1b 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:42:25 devstack sudo[108363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-ec4eae95-4ee4-4356-a49b-ba3855317b1b 1073741824 Sep 28 09:42:25 devstack sudo[108363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:42:26 devstack sudo[108363]: pam_unix(sudo:session): session closed for user root Sep 28 09:42:26 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e37a08fe-f568-48e7-8be3-31c8694cde90 tempest-ProjectReaderTests-346463393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-ec4eae95-4ee4-4356-a49b-ba3855317b1b 1073741824" returned: 0 in 0.407s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:42:26 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e37a08fe-f568-48e7-8be3-31c8694cde90 tempest-ProjectReaderTests-346463393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-ec4eae95-4ee4-4356-a49b-ba3855317b1b {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:42:26 devstack sudo[108368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-ec4eae95-4ee4-4356-a49b-ba3855317b1b Sep 28 09:42:26 devstack sudo[108368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:42:26 devstack sudo[108368]: pam_unix(sudo:session): session closed for user root Sep 28 09:42:26 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-e37a08fe-f568-48e7-8be3-31c8694cde90 tempest-ProjectReaderTests-346463393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-ec4eae95-4ee4-4356-a49b-ba3855317b1b" returned: 0 in 0.249s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:42:26 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-e37a08fe-f568-48e7-8be3-31c8694cde90 tempest-ProjectReaderTests-346463393 None] <== create_volume: return (698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:42:26 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-e37a08fe-f568-48e7-8be3-31c8694cde90 tempest-ProjectReaderTests-346463393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:42:26 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e37a08fe-f568-48e7-8be3-31c8694cde90 tempest-ProjectReaderTests-346463393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11f0926d-9855-4876-9d12-bc83afeb1ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec4eae95-4ee4-4356-a49b-ba3855317b1b', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:42:26 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e37a08fe-f568-48e7-8be3-31c8694cde90 tempest-ProjectReaderTests-346463393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fecb052-d803-49de-86af-aeb687b8091a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:42:26 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-e37a08fe-f568-48e7-8be3-31c8694cde90 tempest-ProjectReaderTests-346463393 None] Volume volume-ec4eae95-4ee4-4356-a49b-ba3855317b1b (ec4eae95-4ee4-4356-a49b-ba3855317b1b): created successfully Sep 28 09:42:26 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e37a08fe-f568-48e7-8be3-31c8694cde90 tempest-ProjectReaderTests-346463393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fecb052-d803-49de-86af-aeb687b8091a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:42:26 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-e37a08fe-f568-48e7-8be3-31c8694cde90 tempest-ProjectReaderTests-346463393 None] Flow 'volume_create_manager' (eaec6b32-68e9-4ba9-8405-e789714fef51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:42:26 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-e37a08fe-f568-48e7-8be3-31c8694cde90 tempest-ProjectReaderTests-346463393 None] Created volume successfully. Sep 28 09:42:26 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-7171c738-9be6-4fc6-bf14-da0e0e68aeb4 tempest-ProjectReaderTests-346463393 None] Acquiring lock "cinder-ec4eae95-4ee4-4356-a49b-ba3855317b1b-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:42:26 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-7171c738-9be6-4fc6-bf14-da0e0e68aeb4 tempest-ProjectReaderTests-346463393 None] Lock "cinder-ec4eae95-4ee4-4356-a49b-ba3855317b1b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:42:26 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-7171c738-9be6-4fc6-bf14-da0e0e68aeb4 tempest-ProjectReaderTests-346463393 None] Acquiring lock "cinder-quobyte-ec4eae95-4ee4-4356-a49b-ba3855317b1b" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:42:26 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-7171c738-9be6-4fc6-bf14-da0e0e68aeb4 tempest-ProjectReaderTests-346463393 None] Lock "cinder-quobyte-ec4eae95-4ee4-4356-a49b-ba3855317b1b" acquired by "delete_volume" :: waited 0.017s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:42:26 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[932e4ac9-1bc8-413e-b836-9fc8c597907e]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:42:26 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-7171c738-9be6-4fc6-bf14-da0e0e68aeb4 tempest-ProjectReaderTests-346463393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-ec4eae95-4ee4-4356-a49b-ba3855317b1b {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:42:26 devstack sudo[108371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-ec4eae95-4ee4-4356-a49b-ba3855317b1b Sep 28 09:42:26 devstack sudo[108371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:42:27 devstack sudo[108371]: pam_unix(sudo:session): session closed for user root Sep 28 09:42:27 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-7171c738-9be6-4fc6-bf14-da0e0e68aeb4 tempest-ProjectReaderTests-346463393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-ec4eae95-4ee4-4356-a49b-ba3855317b1b" returned: 0 in 0.405s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:42:27 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-7171c738-9be6-4fc6-bf14-da0e0e68aeb4 tempest-ProjectReaderTests-346463393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-ec4eae95-4ee4-4356-a49b-ba3855317b1b {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:42:27 devstack sudo[108412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-ec4eae95-4ee4-4356-a49b-ba3855317b1b Sep 28 09:42:27 devstack sudo[108412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:42:27 devstack sudo[108412]: pam_unix(sudo:session): session closed for user root Sep 28 09:42:27 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-7171c738-9be6-4fc6-bf14-da0e0e68aeb4 tempest-ProjectReaderTests-346463393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-ec4eae95-4ee4-4356-a49b-ba3855317b1b" returned: 0 in 0.290s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:42:27 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-7171c738-9be6-4fc6-bf14-da0e0e68aeb4 tempest-ProjectReaderTests-346463393 None] Lock "cinder-quobyte-ec4eae95-4ee4-4356-a49b-ba3855317b1b" released by "delete_volume" :: held 0.739s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:42:27 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-7171c738-9be6-4fc6-bf14-da0e0e68aeb4 tempest-ProjectReaderTests-346463393 None] Created reservations ['fa3e71ff-1282-41d7-96ac-367a2eaa0d48', '6589d911-4445-4884-8fb4-4ade49ecac7e', '77d82899-2fe3-4375-ad52-cf35305e1995', '2077651a-5b20-4842-a36d-325c6e270fc9'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:42:27 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-7171c738-9be6-4fc6-bf14-da0e0e68aeb4 tempest-ProjectReaderTests-346463393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:42:27 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-7171c738-9be6-4fc6-bf14-da0e0e68aeb4 tempest-ProjectReaderTests-346463393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:42:27 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-7171c738-9be6-4fc6-bf14-da0e0e68aeb4 tempest-ProjectReaderTests-346463393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:42:27 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-7171c738-9be6-4fc6-bf14-da0e0e68aeb4 tempest-ProjectReaderTests-346463393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:42:27 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-7171c738-9be6-4fc6-bf14-da0e0e68aeb4 tempest-ProjectReaderTests-346463393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:42:27 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-7171c738-9be6-4fc6-bf14-da0e0e68aeb4 tempest-ProjectReaderTests-346463393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:42:27 devstack sudo[108417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:42:27 devstack sudo[108417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:42:27 devstack sudo[108417]: pam_unix(sudo:session): session closed for user root Sep 28 09:42:27 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-7171c738-9be6-4fc6-bf14-da0e0e68aeb4 tempest-ProjectReaderTests-346463393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.253s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:42:27 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-7171c738-9be6-4fc6-bf14-da0e0e68aeb4 tempest-ProjectReaderTests-346463393 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:42:27 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-7171c738-9be6-4fc6-bf14-da0e0e68aeb4 tempest-ProjectReaderTests-346463393 None] Deleted volume successfully. Sep 28 09:42:27 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-7171c738-9be6-4fc6-bf14-da0e0e68aeb4 tempest-ProjectReaderTests-346463393 None] Lock "cinder-ec4eae95-4ee4-4356-a49b-ba3855317b1b-delete_volume" released by "delete_volume" :: held 1.186s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:42:28 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad48d384-8a3a-4167-9e70-49e6f0ed6aa1 tempest-ProjectReaderTests-346463393 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:42:28 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ad48d384-8a3a-4167-9e70-49e6f0ed6aa1 tempest-ProjectReaderTests-346463393 None] Flow 'volume_create_manager' (d4027294-5ba8-4660-87f7-5935abd2148c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:42:28 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ad48d384-8a3a-4167-9e70-49e6f0ed6aa1 tempest-ProjectReaderTests-346463393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9af55c0a-9313-4418-9d52-d38248d8422e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:42:28 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ad48d384-8a3a-4167-9e70-49e6f0ed6aa1 tempest-ProjectReaderTests-346463393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9af55c0a-9313-4418-9d52-d38248d8422e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:42:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1339424690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa9be7f3-6ee9-4701-932c-e70d6b86168a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ebdd5a1f33f400cae3aa89908488380',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:42:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:42:28Z,use_quota=True,user_id='8fc1fae2ea59441490e377c2ccc5b058',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:42:28 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ad48d384-8a3a-4167-9e70-49e6f0ed6aa1 tempest-ProjectReaderTests-346463393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23f05396-d474-4c39-939c-f43944c6e917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:42:28 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ad48d384-8a3a-4167-9e70-49e6f0ed6aa1 tempest-ProjectReaderTests-346463393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23f05396-d474-4c39-939c-f43944c6e917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:42:28 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ad48d384-8a3a-4167-9e70-49e6f0ed6aa1 tempest-ProjectReaderTests-346463393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc19acb5-0bd6-4dcc-95d4-52d36862a834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:42:28 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ad48d384-8a3a-4167-9e70-49e6f0ed6aa1 tempest-ProjectReaderTests-346463393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc19acb5-0bd6-4dcc-95d4-52d36862a834) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa9be7f3-6ee9-4701-932c-e70d6b86168a', 'volume_name': 'volume-fa9be7f3-6ee9-4701-932c-e70d6b86168a', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:42:28 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ad48d384-8a3a-4167-9e70-49e6f0ed6aa1 tempest-ProjectReaderTests-346463393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9a9f75b-5a70-4845-a932-648a749470c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:42:28 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ad48d384-8a3a-4167-9e70-49e6f0ed6aa1 tempest-ProjectReaderTests-346463393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9a9f75b-5a70-4845-a932-648a749470c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:42:28 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ad48d384-8a3a-4167-9e70-49e6f0ed6aa1 tempest-ProjectReaderTests-346463393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5d2bd2d-0961-4208-a48e-b12037a9b071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:42:28 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-ad48d384-8a3a-4167-9e70-49e6f0ed6aa1 tempest-ProjectReaderTests-346463393 None] Volume fa9be7f3-6ee9-4701-932c-e70d6b86168a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa9be7f3-6ee9-4701-932c-e70d6b86168a', 'volume_size': 1} Sep 28 09:42:28 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ad48d384-8a3a-4167-9e70-49e6f0ed6aa1 tempest-ProjectReaderTests-346463393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:42:28 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ad48d384-8a3a-4167-9e70-49e6f0ed6aa1 tempest-ProjectReaderTests-346463393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:42:28 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ad48d384-8a3a-4167-9e70-49e6f0ed6aa1 tempest-ProjectReaderTests-346463393 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:42:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1339424690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa9be7f3-6ee9-4701-932c-e70d6b86168a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ebdd5a1f33f400cae3aa89908488380',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:42:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:42:28Z,use_quota=True,user_id='8fc1fae2ea59441490e377c2ccc5b058',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:42:28 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-ad48d384-8a3a-4167-9e70-49e6f0ed6aa1 tempest-ProjectReaderTests-346463393 None] Creating volume fa9be7f3-6ee9-4701-932c-e70d6b86168a {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:42:28 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ad48d384-8a3a-4167-9e70-49e6f0ed6aa1 tempest-ProjectReaderTests-346463393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:42:28 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ad48d384-8a3a-4167-9e70-49e6f0ed6aa1 tempest-ProjectReaderTests-346463393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:42:28 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ad48d384-8a3a-4167-9e70-49e6f0ed6aa1 tempest-ProjectReaderTests-346463393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:42:28 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ad48d384-8a3a-4167-9e70-49e6f0ed6aa1 tempest-ProjectReaderTests-346463393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:42:28 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ad48d384-8a3a-4167-9e70-49e6f0ed6aa1 tempest-ProjectReaderTests-346463393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:42:28 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ad48d384-8a3a-4167-9e70-49e6f0ed6aa1 tempest-ProjectReaderTests-346463393 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:42:28 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-ad48d384-8a3a-4167-9e70-49e6f0ed6aa1 tempest-ProjectReaderTests-346463393 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:42:28 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ad48d384-8a3a-4167-9e70-49e6f0ed6aa1 tempest-ProjectReaderTests-346463393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-fa9be7f3-6ee9-4701-932c-e70d6b86168a 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:42:28 devstack sudo[108421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-fa9be7f3-6ee9-4701-932c-e70d6b86168a 1073741824 Sep 28 09:42:28 devstack sudo[108421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:42:28 devstack sudo[108421]: pam_unix(sudo:session): session closed for user root Sep 28 09:42:28 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ad48d384-8a3a-4167-9e70-49e6f0ed6aa1 tempest-ProjectReaderTests-346463393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-fa9be7f3-6ee9-4701-932c-e70d6b86168a 1073741824" returned: 0 in 0.416s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:42:28 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ad48d384-8a3a-4167-9e70-49e6f0ed6aa1 tempest-ProjectReaderTests-346463393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-fa9be7f3-6ee9-4701-932c-e70d6b86168a {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:42:28 devstack sudo[108427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-fa9be7f3-6ee9-4701-932c-e70d6b86168a Sep 28 09:42:28 devstack sudo[108427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:42:28 devstack sudo[108427]: pam_unix(sudo:session): session closed for user root Sep 28 09:42:28 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ad48d384-8a3a-4167-9e70-49e6f0ed6aa1 tempest-ProjectReaderTests-346463393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-fa9be7f3-6ee9-4701-932c-e70d6b86168a" returned: 0 in 0.237s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:42:28 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ad48d384-8a3a-4167-9e70-49e6f0ed6aa1 tempest-ProjectReaderTests-346463393 None] <== create_volume: return (696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:42:28 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ad48d384-8a3a-4167-9e70-49e6f0ed6aa1 tempest-ProjectReaderTests-346463393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:42:28 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ad48d384-8a3a-4167-9e70-49e6f0ed6aa1 tempest-ProjectReaderTests-346463393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5d2bd2d-0961-4208-a48e-b12037a9b071) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa9be7f3-6ee9-4701-932c-e70d6b86168a', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:42:28 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ad48d384-8a3a-4167-9e70-49e6f0ed6aa1 tempest-ProjectReaderTests-346463393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ace0253e-6298-46e8-a1e8-7da776f82521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:42:28 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-ad48d384-8a3a-4167-9e70-49e6f0ed6aa1 tempest-ProjectReaderTests-346463393 None] Volume volume-fa9be7f3-6ee9-4701-932c-e70d6b86168a (fa9be7f3-6ee9-4701-932c-e70d6b86168a): created successfully Sep 28 09:42:28 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ad48d384-8a3a-4167-9e70-49e6f0ed6aa1 tempest-ProjectReaderTests-346463393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ace0253e-6298-46e8-a1e8-7da776f82521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:42:29 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ad48d384-8a3a-4167-9e70-49e6f0ed6aa1 tempest-ProjectReaderTests-346463393 None] Flow 'volume_create_manager' (d4027294-5ba8-4660-87f7-5935abd2148c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:42:29 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-ad48d384-8a3a-4167-9e70-49e6f0ed6aa1 tempest-ProjectReaderTests-346463393 None] Created volume successfully. Sep 28 09:42:29 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-f2c370df-bfdd-474f-b4ae-61d1fee56401 tempest-ProjectReaderTests-346463393 None] Acquiring lock "cinder-fa9be7f3-6ee9-4701-932c-e70d6b86168a-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:42:29 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-f2c370df-bfdd-474f-b4ae-61d1fee56401 tempest-ProjectReaderTests-346463393 None] Lock "cinder-fa9be7f3-6ee9-4701-932c-e70d6b86168a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:42:29 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-f2c370df-bfdd-474f-b4ae-61d1fee56401 tempest-ProjectReaderTests-346463393 None] Acquiring lock "cinder-quobyte-fa9be7f3-6ee9-4701-932c-e70d6b86168a" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:42:29 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-f2c370df-bfdd-474f-b4ae-61d1fee56401 tempest-ProjectReaderTests-346463393 None] Lock "cinder-quobyte-fa9be7f3-6ee9-4701-932c-e70d6b86168a" acquired by "delete_volume" :: waited 0.018s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:42:29 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f5e83f-b82f-454d-9a0c-74894d1bbb99]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:42:29 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f2c370df-bfdd-474f-b4ae-61d1fee56401 tempest-ProjectReaderTests-346463393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-fa9be7f3-6ee9-4701-932c-e70d6b86168a {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:42:29 devstack sudo[108430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-fa9be7f3-6ee9-4701-932c-e70d6b86168a Sep 28 09:42:29 devstack sudo[108430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:42:29 devstack sudo[108430]: pam_unix(sudo:session): session closed for user root Sep 28 09:42:29 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f2c370df-bfdd-474f-b4ae-61d1fee56401 tempest-ProjectReaderTests-346463393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-fa9be7f3-6ee9-4701-932c-e70d6b86168a" returned: 0 in 0.355s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:42:29 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f2c370df-bfdd-474f-b4ae-61d1fee56401 tempest-ProjectReaderTests-346463393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-fa9be7f3-6ee9-4701-932c-e70d6b86168a {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:42:29 devstack sudo[108435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-fa9be7f3-6ee9-4701-932c-e70d6b86168a Sep 28 09:42:29 devstack sudo[108435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:42:29 devstack sudo[108435]: pam_unix(sudo:session): session closed for user root Sep 28 09:42:29 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f2c370df-bfdd-474f-b4ae-61d1fee56401 tempest-ProjectReaderTests-346463393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-fa9be7f3-6ee9-4701-932c-e70d6b86168a" returned: 0 in 0.239s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:42:29 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-f2c370df-bfdd-474f-b4ae-61d1fee56401 tempest-ProjectReaderTests-346463393 None] Lock "cinder-quobyte-fa9be7f3-6ee9-4701-932c-e70d6b86168a" released by "delete_volume" :: held 0.641s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:42:30 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-f2c370df-bfdd-474f-b4ae-61d1fee56401 tempest-ProjectReaderTests-346463393 None] Created reservations ['0d564891-2f29-4666-94ac-70522671fef8', '425579d6-f376-40b7-811c-cb50aceeffeb', 'ba51414e-3485-46b0-a72c-b8372eb67d7a', 'baf2bc95-eec4-4c77-86f7-b97bf4cbd859'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:42:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-f2c370df-bfdd-474f-b4ae-61d1fee56401 tempest-ProjectReaderTests-346463393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:42:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-f2c370df-bfdd-474f-b4ae-61d1fee56401 tempest-ProjectReaderTests-346463393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:42:30 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-f2c370df-bfdd-474f-b4ae-61d1fee56401 tempest-ProjectReaderTests-346463393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:42:30 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-f2c370df-bfdd-474f-b4ae-61d1fee56401 tempest-ProjectReaderTests-346463393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:42:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-f2c370df-bfdd-474f-b4ae-61d1fee56401 tempest-ProjectReaderTests-346463393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:42:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f2c370df-bfdd-474f-b4ae-61d1fee56401 tempest-ProjectReaderTests-346463393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:42:30 devstack sudo[108438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:42:30 devstack sudo[108438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:42:30 devstack sudo[108438]: pam_unix(sudo:session): session closed for user root Sep 28 09:42:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-f2c370df-bfdd-474f-b4ae-61d1fee56401 tempest-ProjectReaderTests-346463393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.245s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:42:30 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-f2c370df-bfdd-474f-b4ae-61d1fee56401 tempest-ProjectReaderTests-346463393 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:42:30 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-f2c370df-bfdd-474f-b4ae-61d1fee56401 tempest-ProjectReaderTests-346463393 None] Deleted volume successfully. Sep 28 09:42:30 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-f2c370df-bfdd-474f-b4ae-61d1fee56401 tempest-ProjectReaderTests-346463393 None] Lock "cinder-fa9be7f3-6ee9-4701-932c-e70d6b86168a-delete_volume" released by "delete_volume" :: held 1.094s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:42:30 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-d13556a7-9d02-4bab-9c49-da037990fd01 tempest-ProjectReaderTests-346463393 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:42:30 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-d13556a7-9d02-4bab-9c49-da037990fd01 tempest-ProjectReaderTests-346463393 None] Flow 'volume_create_manager' (b0f78f15-e06c-4e6b-9e40-103899b1dc7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:42:30 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-d13556a7-9d02-4bab-9c49-da037990fd01 tempest-ProjectReaderTests-346463393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4f6f1a9-535e-4185-a28f-047ec09a62ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:42:30 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-d13556a7-9d02-4bab-9c49-da037990fd01 tempest-ProjectReaderTests-346463393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4f6f1a9-535e-4185-a28f-047ec09a62ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:42:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-204742466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b074f8a5-ec14-4a42-ab3f-3741ab55b588,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ebdd5a1f33f400cae3aa89908488380',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:42:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:42:31Z,use_quota=True,user_id='8fc1fae2ea59441490e377c2ccc5b058',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:42:30 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-d13556a7-9d02-4bab-9c49-da037990fd01 tempest-ProjectReaderTests-346463393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c6155dd-70ef-45e2-a8a0-042c5f8b48d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:42:30 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-d13556a7-9d02-4bab-9c49-da037990fd01 tempest-ProjectReaderTests-346463393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c6155dd-70ef-45e2-a8a0-042c5f8b48d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:42:30 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-d13556a7-9d02-4bab-9c49-da037990fd01 tempest-ProjectReaderTests-346463393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96add0a1-2269-45d9-92dc-10765eba7fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:42:30 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-d13556a7-9d02-4bab-9c49-da037990fd01 tempest-ProjectReaderTests-346463393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96add0a1-2269-45d9-92dc-10765eba7fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b074f8a5-ec14-4a42-ab3f-3741ab55b588', 'volume_name': 'volume-b074f8a5-ec14-4a42-ab3f-3741ab55b588', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:42:30 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-d13556a7-9d02-4bab-9c49-da037990fd01 tempest-ProjectReaderTests-346463393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e67c6e8-5a0f-4d57-88e5-cab381b1a71d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:42:30 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-d13556a7-9d02-4bab-9c49-da037990fd01 tempest-ProjectReaderTests-346463393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e67c6e8-5a0f-4d57-88e5-cab381b1a71d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:42:30 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-d13556a7-9d02-4bab-9c49-da037990fd01 tempest-ProjectReaderTests-346463393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d2ac583-aac4-40a5-b0a4-e18710ea0c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:42:30 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-d13556a7-9d02-4bab-9c49-da037990fd01 tempest-ProjectReaderTests-346463393 None] Volume b074f8a5-ec14-4a42-ab3f-3741ab55b588: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b074f8a5-ec14-4a42-ab3f-3741ab55b588', 'volume_size': 1} Sep 28 09:42:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-d13556a7-9d02-4bab-9c49-da037990fd01 tempest-ProjectReaderTests-346463393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:42:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-d13556a7-9d02-4bab-9c49-da037990fd01 tempest-ProjectReaderTests-346463393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:42:30 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-d13556a7-9d02-4bab-9c49-da037990fd01 tempest-ProjectReaderTests-346463393 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:42:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-204742466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b074f8a5-ec14-4a42-ab3f-3741ab55b588,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ebdd5a1f33f400cae3aa89908488380',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:42:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:42:31Z,use_quota=True,user_id='8fc1fae2ea59441490e377c2ccc5b058',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:42:30 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-d13556a7-9d02-4bab-9c49-da037990fd01 tempest-ProjectReaderTests-346463393 None] Creating volume b074f8a5-ec14-4a42-ab3f-3741ab55b588 {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:42:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-d13556a7-9d02-4bab-9c49-da037990fd01 tempest-ProjectReaderTests-346463393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:42:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-d13556a7-9d02-4bab-9c49-da037990fd01 tempest-ProjectReaderTests-346463393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:42:30 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-d13556a7-9d02-4bab-9c49-da037990fd01 tempest-ProjectReaderTests-346463393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:42:30 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-d13556a7-9d02-4bab-9c49-da037990fd01 tempest-ProjectReaderTests-346463393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:42:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-d13556a7-9d02-4bab-9c49-da037990fd01 tempest-ProjectReaderTests-346463393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:42:30 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-d13556a7-9d02-4bab-9c49-da037990fd01 tempest-ProjectReaderTests-346463393 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:42:30 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-d13556a7-9d02-4bab-9c49-da037990fd01 tempest-ProjectReaderTests-346463393 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:42:30 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-d13556a7-9d02-4bab-9c49-da037990fd01 tempest-ProjectReaderTests-346463393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b074f8a5-ec14-4a42-ab3f-3741ab55b588 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:42:30 devstack sudo[108441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b074f8a5-ec14-4a42-ab3f-3741ab55b588 1073741824 Sep 28 09:42:30 devstack sudo[108441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:42:31 devstack sudo[108441]: pam_unix(sudo:session): session closed for user root Sep 28 09:42:31 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-d13556a7-9d02-4bab-9c49-da037990fd01 tempest-ProjectReaderTests-346463393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b074f8a5-ec14-4a42-ab3f-3741ab55b588 1073741824" returned: 0 in 0.409s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:42:31 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-d13556a7-9d02-4bab-9c49-da037990fd01 tempest-ProjectReaderTests-346463393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b074f8a5-ec14-4a42-ab3f-3741ab55b588 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:42:31 devstack sudo[108446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b074f8a5-ec14-4a42-ab3f-3741ab55b588 Sep 28 09:42:31 devstack sudo[108446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:42:31 devstack sudo[108446]: pam_unix(sudo:session): session closed for user root Sep 28 09:42:31 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-d13556a7-9d02-4bab-9c49-da037990fd01 tempest-ProjectReaderTests-346463393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b074f8a5-ec14-4a42-ab3f-3741ab55b588" returned: 0 in 0.257s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:42:31 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-d13556a7-9d02-4bab-9c49-da037990fd01 tempest-ProjectReaderTests-346463393 None] <== create_volume: return (706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:42:31 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-d13556a7-9d02-4bab-9c49-da037990fd01 tempest-ProjectReaderTests-346463393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:42:31 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-d13556a7-9d02-4bab-9c49-da037990fd01 tempest-ProjectReaderTests-346463393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d2ac583-aac4-40a5-b0a4-e18710ea0c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b074f8a5-ec14-4a42-ab3f-3741ab55b588', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:42:31 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-d13556a7-9d02-4bab-9c49-da037990fd01 tempest-ProjectReaderTests-346463393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ead87243-86b6-40b0-859e-46eff0f5081a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:42:31 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-d13556a7-9d02-4bab-9c49-da037990fd01 tempest-ProjectReaderTests-346463393 None] Volume volume-b074f8a5-ec14-4a42-ab3f-3741ab55b588 (b074f8a5-ec14-4a42-ab3f-3741ab55b588): created successfully Sep 28 09:42:31 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-d13556a7-9d02-4bab-9c49-da037990fd01 tempest-ProjectReaderTests-346463393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ead87243-86b6-40b0-859e-46eff0f5081a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:42:31 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-d13556a7-9d02-4bab-9c49-da037990fd01 tempest-ProjectReaderTests-346463393 None] Flow 'volume_create_manager' (b0f78f15-e06c-4e6b-9e40-103899b1dc7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:42:31 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-d13556a7-9d02-4bab-9c49-da037990fd01 tempest-ProjectReaderTests-346463393 None] Created volume successfully. Sep 28 09:42:31 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-6df2012d-a4c9-4f03-a1d1-22dc9385d59c tempest-ProjectReaderTests-346463393 None] Acquiring lock "cinder-b074f8a5-ec14-4a42-ab3f-3741ab55b588-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:42:31 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-6df2012d-a4c9-4f03-a1d1-22dc9385d59c tempest-ProjectReaderTests-346463393 None] Lock "cinder-b074f8a5-ec14-4a42-ab3f-3741ab55b588-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:42:31 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-6df2012d-a4c9-4f03-a1d1-22dc9385d59c tempest-ProjectReaderTests-346463393 None] Acquiring lock "cinder-quobyte-b074f8a5-ec14-4a42-ab3f-3741ab55b588" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:42:31 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-6df2012d-a4c9-4f03-a1d1-22dc9385d59c tempest-ProjectReaderTests-346463393 None] Lock "cinder-quobyte-b074f8a5-ec14-4a42-ab3f-3741ab55b588" acquired by "delete_volume" :: waited 0.014s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:42:31 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee6db2a6-f134-4e68-964c-dce80573079f]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:42:31 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-6df2012d-a4c9-4f03-a1d1-22dc9385d59c tempest-ProjectReaderTests-346463393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b074f8a5-ec14-4a42-ab3f-3741ab55b588 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:42:32 devstack sudo[108455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b074f8a5-ec14-4a42-ab3f-3741ab55b588 Sep 28 09:42:32 devstack sudo[108455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:42:32 devstack sudo[108455]: pam_unix(sudo:session): session closed for user root Sep 28 09:42:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-6df2012d-a4c9-4f03-a1d1-22dc9385d59c tempest-ProjectReaderTests-346463393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b074f8a5-ec14-4a42-ab3f-3741ab55b588" returned: 0 in 0.363s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:42:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-6df2012d-a4c9-4f03-a1d1-22dc9385d59c tempest-ProjectReaderTests-346463393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b074f8a5-ec14-4a42-ab3f-3741ab55b588 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:42:32 devstack sudo[108460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b074f8a5-ec14-4a42-ab3f-3741ab55b588 Sep 28 09:42:32 devstack sudo[108460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:42:32 devstack sudo[108460]: pam_unix(sudo:session): session closed for user root Sep 28 09:42:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-6df2012d-a4c9-4f03-a1d1-22dc9385d59c tempest-ProjectReaderTests-346463393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-b074f8a5-ec14-4a42-ab3f-3741ab55b588" returned: 0 in 0.240s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:42:32 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-6df2012d-a4c9-4f03-a1d1-22dc9385d59c tempest-ProjectReaderTests-346463393 None] Lock "cinder-quobyte-b074f8a5-ec14-4a42-ab3f-3741ab55b588" released by "delete_volume" :: held 0.644s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:42:32 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-6df2012d-a4c9-4f03-a1d1-22dc9385d59c tempest-ProjectReaderTests-346463393 None] Created reservations ['8d1a2e0d-12cf-4095-a018-0bd7e19fa226', '02ddbf60-4de7-4c1c-b0fd-a495afb8d1a5', '37f3fac3-25b6-471e-8176-bc335485a38a', '61beb15b-fe14-4d2c-aa21-7590422c8ec6'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:42:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-6df2012d-a4c9-4f03-a1d1-22dc9385d59c tempest-ProjectReaderTests-346463393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:42:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-6df2012d-a4c9-4f03-a1d1-22dc9385d59c tempest-ProjectReaderTests-346463393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:42:32 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-6df2012d-a4c9-4f03-a1d1-22dc9385d59c tempest-ProjectReaderTests-346463393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:42:32 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-6df2012d-a4c9-4f03-a1d1-22dc9385d59c tempest-ProjectReaderTests-346463393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:42:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-6df2012d-a4c9-4f03-a1d1-22dc9385d59c tempest-ProjectReaderTests-346463393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:42:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-6df2012d-a4c9-4f03-a1d1-22dc9385d59c tempest-ProjectReaderTests-346463393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:42:32 devstack sudo[108463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:42:32 devstack sudo[108463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:42:32 devstack sudo[108463]: pam_unix(sudo:session): session closed for user root Sep 28 09:42:32 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-6df2012d-a4c9-4f03-a1d1-22dc9385d59c tempest-ProjectReaderTests-346463393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.237s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:42:32 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-6df2012d-a4c9-4f03-a1d1-22dc9385d59c tempest-ProjectReaderTests-346463393 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:42:32 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-6df2012d-a4c9-4f03-a1d1-22dc9385d59c tempest-ProjectReaderTests-346463393 None] Deleted volume successfully. Sep 28 09:42:32 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-6df2012d-a4c9-4f03-a1d1-22dc9385d59c tempest-ProjectReaderTests-346463393 None] Lock "cinder-b074f8a5-ec14-4a42-ab3f-3741ab55b588-delete_volume" released by "delete_volume" :: held 1.068s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:42:42 devstack cinder-volume[86553]: DEBUG dbcounter [-] [86553] Writing DB stats cinder:SELECT=27,cinder:UPDATE=41,cinder:INSERT=17,cinder:DELETE=3 {{(pid=86553) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 09:42:42 devstack cinder-volume[86553]: DEBUG dbcounter [-] [86553] Writing DB stats cinder:UPDATE=47,cinder:INSERT=3,cinder:DELETE=5,cinder:SELECT=29 {{(pid=86553) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 09:42:55 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dbb5516-477b-4fbd-af1f-af3b315d04b9 tempest-SnapshotDependencyTests-1904524745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:42:55 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-3dbb5516-477b-4fbd-af1f-af3b315d04b9 tempest-SnapshotDependencyTests-1904524745 None] Flow 'volume_create_manager' (9ab31972-5777-4025-808c-6720f453e6b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:42:55 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-3dbb5516-477b-4fbd-af1f-af3b315d04b9 tempest-SnapshotDependencyTests-1904524745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6be5417f-de3f-4e0c-93e1-5222d7219d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:42:55 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-3dbb5516-477b-4fbd-af1f-af3b315d04b9 tempest-SnapshotDependencyTests-1904524745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6be5417f-de3f-4e0c-93e1-5222d7219d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:42:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1704314608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20cd491f-f0b5-42ae-82d3-58c0f589af7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfd6b53d16704609b8eaa74bb4dfd82e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:42:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:42:55Z,use_quota=True,user_id='1c7d96e9d9b0470b9800630cbe94e409',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:42:55 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-3dbb5516-477b-4fbd-af1f-af3b315d04b9 tempest-SnapshotDependencyTests-1904524745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18dfd2a8-2584-47ac-8175-1a2f2b912504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:42:55 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-3dbb5516-477b-4fbd-af1f-af3b315d04b9 tempest-SnapshotDependencyTests-1904524745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18dfd2a8-2584-47ac-8175-1a2f2b912504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:42:55 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-3dbb5516-477b-4fbd-af1f-af3b315d04b9 tempest-SnapshotDependencyTests-1904524745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82be6fb4-92fc-49a1-9027-707fb9cedcec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:42:55 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-3dbb5516-477b-4fbd-af1f-af3b315d04b9 tempest-SnapshotDependencyTests-1904524745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82be6fb4-92fc-49a1-9027-707fb9cedcec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20cd491f-f0b5-42ae-82d3-58c0f589af7c', 'volume_name': 'volume-20cd491f-f0b5-42ae-82d3-58c0f589af7c', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:42:55 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-3dbb5516-477b-4fbd-af1f-af3b315d04b9 tempest-SnapshotDependencyTests-1904524745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7db6a728-ec64-488f-a5d2-e70435616f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:42:55 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-3dbb5516-477b-4fbd-af1f-af3b315d04b9 tempest-SnapshotDependencyTests-1904524745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7db6a728-ec64-488f-a5d2-e70435616f25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:42:55 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-3dbb5516-477b-4fbd-af1f-af3b315d04b9 tempest-SnapshotDependencyTests-1904524745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e27e0c76-e8c7-47b4-aa81-3fe9090f502d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:42:55 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-3dbb5516-477b-4fbd-af1f-af3b315d04b9 tempest-SnapshotDependencyTests-1904524745 None] Volume 20cd491f-f0b5-42ae-82d3-58c0f589af7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20cd491f-f0b5-42ae-82d3-58c0f589af7c', 'volume_size': 1} Sep 28 09:42:55 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-3dbb5516-477b-4fbd-af1f-af3b315d04b9 tempest-SnapshotDependencyTests-1904524745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:42:55 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-3dbb5516-477b-4fbd-af1f-af3b315d04b9 tempest-SnapshotDependencyTests-1904524745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:42:55 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-3dbb5516-477b-4fbd-af1f-af3b315d04b9 tempest-SnapshotDependencyTests-1904524745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:42:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1704314608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20cd491f-f0b5-42ae-82d3-58c0f589af7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfd6b53d16704609b8eaa74bb4dfd82e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:42:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:42:55Z,use_quota=True,user_id='1c7d96e9d9b0470b9800630cbe94e409',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)}" {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 09:42:55 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-3dbb5516-477b-4fbd-af1f-af3b315d04b9 tempest-SnapshotDependencyTests-1904524745 None] Creating volume 20cd491f-f0b5-42ae-82d3-58c0f589af7c {{(pid=86553) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 09:42:55 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-3dbb5516-477b-4fbd-af1f-af3b315d04b9 tempest-SnapshotDependencyTests-1904524745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:42:55 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-3dbb5516-477b-4fbd-af1f-af3b315d04b9 tempest-SnapshotDependencyTests-1904524745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:42:55 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-3dbb5516-477b-4fbd-af1f-af3b315d04b9 tempest-SnapshotDependencyTests-1904524745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:42:55 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-3dbb5516-477b-4fbd-af1f-af3b315d04b9 tempest-SnapshotDependencyTests-1904524745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:42:55 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-3dbb5516-477b-4fbd-af1f-af3b315d04b9 tempest-SnapshotDependencyTests-1904524745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:42:55 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-3dbb5516-477b-4fbd-af1f-af3b315d04b9 tempest-SnapshotDependencyTests-1904524745 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:42:55 devstack cinder-volume[86553]: INFO cinder.volume.drivers.remotefs [None req-3dbb5516-477b-4fbd-af1f-af3b315d04b9 tempest-SnapshotDependencyTests-1904524745 None] casted to osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d Sep 28 09:42:55 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3dbb5516-477b-4fbd-af1f-af3b315d04b9 tempest-SnapshotDependencyTests-1904524745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20cd491f-f0b5-42ae-82d3-58c0f589af7c 1073741824 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:42:55 devstack sudo[108469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20cd491f-f0b5-42ae-82d3-58c0f589af7c 1073741824 Sep 28 09:42:55 devstack sudo[108469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:42:55 devstack sudo[108469]: pam_unix(sudo:session): session closed for user root Sep 28 09:42:55 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3dbb5516-477b-4fbd-af1f-af3b315d04b9 tempest-SnapshotDependencyTests-1904524745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20cd491f-f0b5-42ae-82d3-58c0f589af7c 1073741824" returned: 0 in 0.412s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:42:55 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3dbb5516-477b-4fbd-af1f-af3b315d04b9 tempest-SnapshotDependencyTests-1904524745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20cd491f-f0b5-42ae-82d3-58c0f589af7c {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:42:56 devstack sudo[108474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20cd491f-f0b5-42ae-82d3-58c0f589af7c Sep 28 09:42:56 devstack sudo[108474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:42:56 devstack sudo[108474]: pam_unix(sudo:session): session closed for user root Sep 28 09:42:56 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-3dbb5516-477b-4fbd-af1f-af3b315d04b9 tempest-SnapshotDependencyTests-1904524745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20cd491f-f0b5-42ae-82d3-58c0f589af7c" returned: 0 in 0.249s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:42:56 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-3dbb5516-477b-4fbd-af1f-af3b315d04b9 tempest-SnapshotDependencyTests-1904524745 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'} {{(pid=86553) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 09:42:56 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-3dbb5516-477b-4fbd-af1f-af3b315d04b9 tempest-SnapshotDependencyTests-1904524745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.707s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:42:56 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-3dbb5516-477b-4fbd-af1f-af3b315d04b9 tempest-SnapshotDependencyTests-1904524745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e27e0c76-e8c7-47b4-aa81-3fe9090f502d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20cd491f-f0b5-42ae-82d3-58c0f589af7c', 'volume_size': 1}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:42:56 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-3dbb5516-477b-4fbd-af1f-af3b315d04b9 tempest-SnapshotDependencyTests-1904524745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc76640f-9560-4efd-b6d9-3a2178590465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:42:56 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-3dbb5516-477b-4fbd-af1f-af3b315d04b9 tempest-SnapshotDependencyTests-1904524745 None] Volume volume-20cd491f-f0b5-42ae-82d3-58c0f589af7c (20cd491f-f0b5-42ae-82d3-58c0f589af7c): created successfully Sep 28 09:42:56 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-3dbb5516-477b-4fbd-af1f-af3b315d04b9 tempest-SnapshotDependencyTests-1904524745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc76640f-9560-4efd-b6d9-3a2178590465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:42:56 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-3dbb5516-477b-4fbd-af1f-af3b315d04b9 tempest-SnapshotDependencyTests-1904524745 None] Flow 'volume_create_manager' (9ab31972-5777-4025-808c-6720f453e6b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:42:56 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-3dbb5516-477b-4fbd-af1f-af3b315d04b9 tempest-SnapshotDependencyTests-1904524745 None] Created volume successfully. Sep 28 09:42:56 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-226ea94b-3c26-4bfb-a4f4-15bf9aa3bf4e tempest-SnapshotDependencyTests-1904524745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:42:56 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-226ea94b-3c26-4bfb-a4f4-15bf9aa3bf4e tempest-SnapshotDependencyTests-1904524745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:42:56 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-226ea94b-3c26-4bfb-a4f4-15bf9aa3bf4e tempest-SnapshotDependencyTests-1904524745 None] Creating offline snapshot 0b40d57a-35c1-447d-a5ab-eb33dae4fab2 of volume 20cd491f-f0b5-42ae-82d3-58c0f589af7c {{(pid=86553) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 09:42:56 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[329f0b1a-2807-4c74-a061-eadb93efc6fd]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:42:56 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-226ea94b-3c26-4bfb-a4f4-15bf9aa3bf4e tempest-SnapshotDependencyTests-1904524745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20cd491f-f0b5-42ae-82d3-58c0f589af7c {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:42:56 devstack sudo[108477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20cd491f-f0b5-42ae-82d3-58c0f589af7c Sep 28 09:42:56 devstack sudo[108477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:42:57 devstack sudo[108477]: pam_unix(sudo:session): session closed for user root Sep 28 09:42:57 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-226ea94b-3c26-4bfb-a4f4-15bf9aa3bf4e tempest-SnapshotDependencyTests-1904524745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20cd491f-f0b5-42ae-82d3-58c0f589af7c" returned: 0 in 0.359s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:42:57 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-226ea94b-3c26-4bfb-a4f4-15bf9aa3bf4e tempest-SnapshotDependencyTests-1904524745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20cd491f-f0b5-42ae-82d3-58c0f589af7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20cd491f-f0b5-42ae-82d3-58c0f589af7c.0b40d57a-35c1-447d-a5ab-eb33dae4fab2 1G {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:42:57 devstack sudo[108482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20cd491f-f0b5-42ae-82d3-58c0f589af7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20cd491f-f0b5-42ae-82d3-58c0f589af7c.0b40d57a-35c1-447d-a5ab-eb33dae4fab2 1G Sep 28 09:42:57 devstack sudo[108482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:42:57 devstack sudo[108482]: pam_unix(sudo:session): session closed for user root Sep 28 09:42:57 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-226ea94b-3c26-4bfb-a4f4-15bf9aa3bf4e tempest-SnapshotDependencyTests-1904524745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20cd491f-f0b5-42ae-82d3-58c0f589af7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20cd491f-f0b5-42ae-82d3-58c0f589af7c.0b40d57a-35c1-447d-a5ab-eb33dae4fab2 1G" returned: 0 in 0.394s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:42:57 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-226ea94b-3c26-4bfb-a4f4-15bf9aa3bf4e tempest-SnapshotDependencyTests-1904524745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20cd491f-f0b5-42ae-82d3-58c0f589af7c -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20cd491f-f0b5-42ae-82d3-58c0f589af7c.0b40d57a-35c1-447d-a5ab-eb33dae4fab2 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:42:57 devstack sudo[108487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20cd491f-f0b5-42ae-82d3-58c0f589af7c -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20cd491f-f0b5-42ae-82d3-58c0f589af7c.0b40d57a-35c1-447d-a5ab-eb33dae4fab2 Sep 28 09:42:57 devstack sudo[108487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:42:57 devstack sudo[108487]: pam_unix(sudo:session): session closed for user root Sep 28 09:42:57 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-226ea94b-3c26-4bfb-a4f4-15bf9aa3bf4e tempest-SnapshotDependencyTests-1904524745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20cd491f-f0b5-42ae-82d3-58c0f589af7c -F qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20cd491f-f0b5-42ae-82d3-58c0f589af7c.0b40d57a-35c1-447d-a5ab-eb33dae4fab2" returned: 0 in 0.291s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:42:57 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-226ea94b-3c26-4bfb-a4f4-15bf9aa3bf4e tempest-SnapshotDependencyTests-1904524745 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20cd491f-f0b5-42ae-82d3-58c0f589af7c.0b40d57a-35c1-447d-a5ab-eb33dae4fab2 is being set with open permissions: ugo+rw Sep 28 09:42:57 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-226ea94b-3c26-4bfb-a4f4-15bf9aa3bf4e tempest-SnapshotDependencyTests-1904524745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20cd491f-f0b5-42ae-82d3-58c0f589af7c.0b40d57a-35c1-447d-a5ab-eb33dae4fab2 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:42:57 devstack sudo[108492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20cd491f-f0b5-42ae-82d3-58c0f589af7c.0b40d57a-35c1-447d-a5ab-eb33dae4fab2 Sep 28 09:42:57 devstack sudo[108492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:42:57 devstack sudo[108492]: pam_unix(sudo:session): session closed for user root Sep 28 09:42:57 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-226ea94b-3c26-4bfb-a4f4-15bf9aa3bf4e tempest-SnapshotDependencyTests-1904524745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20cd491f-f0b5-42ae-82d3-58c0f589af7c.0b40d57a-35c1-447d-a5ab-eb33dae4fab2" returned: 0 in 0.234s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:42:58 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-226ea94b-3c26-4bfb-a4f4-15bf9aa3bf4e tempest-SnapshotDependencyTests-1904524745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20cd491f-f0b5-42ae-82d3-58c0f589af7c.info {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:42:58 devstack sudo[108495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20cd491f-f0b5-42ae-82d3-58c0f589af7c.info Sep 28 09:42:58 devstack sudo[108495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:42:58 devstack sudo[108495]: pam_unix(sudo:session): session closed for user root Sep 28 09:42:58 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-226ea94b-3c26-4bfb-a4f4-15bf9aa3bf4e tempest-SnapshotDependencyTests-1904524745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20cd491f-f0b5-42ae-82d3-58c0f589af7c.info" returned: 0 in 0.253s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:42:58 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-226ea94b-3c26-4bfb-a4f4-15bf9aa3bf4e tempest-SnapshotDependencyTests-1904524745 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20cd491f-f0b5-42ae-82d3-58c0f589af7c.info is being set with open permissions: ugo+rw Sep 28 09:42:58 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-226ea94b-3c26-4bfb-a4f4-15bf9aa3bf4e tempest-SnapshotDependencyTests-1904524745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20cd491f-f0b5-42ae-82d3-58c0f589af7c.info {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:42:58 devstack sudo[108499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20cd491f-f0b5-42ae-82d3-58c0f589af7c.info Sep 28 09:42:58 devstack sudo[108499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:42:58 devstack sudo[108499]: pam_unix(sudo:session): session closed for user root Sep 28 09:42:58 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-226ea94b-3c26-4bfb-a4f4-15bf9aa3bf4e tempest-SnapshotDependencyTests-1904524745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20cd491f-f0b5-42ae-82d3-58c0f589af7c.info" returned: 0 in 0.236s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:42:58 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-226ea94b-3c26-4bfb-a4f4-15bf9aa3bf4e tempest-SnapshotDependencyTests-1904524745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.851s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:42:58 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-226ea94b-3c26-4bfb-a4f4-15bf9aa3bf4e tempest-SnapshotDependencyTests-1904524745 None] Create snapshot completed successfully Sep 28 09:42:59 devstack cinder-volume[86553]: DEBUG cinder.volume.flows.manager.create_volume [None req-97491f80-3ec3-49f7-a0af-8a1b458acaa5 tempest-SnapshotDependencyTests-1904524745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86553) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 09:42:59 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-97491f80-3ec3-49f7-a0af-8a1b458acaa5 tempest-SnapshotDependencyTests-1904524745 None] Flow 'volume_create_manager' (03eddac5-6bfa-4cc7-8c96-f6fc30fea0be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:42:59 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-97491f80-3ec3-49f7-a0af-8a1b458acaa5 tempest-SnapshotDependencyTests-1904524745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb4f401a-9ec2-4125-a00a-4f024f4c6b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:42:59 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-97491f80-3ec3-49f7-a0af-8a1b458acaa5 tempest-SnapshotDependencyTests-1904524745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb4f401a-9ec2-4125-a00a-4f024f4c6b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T07:42:59Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af590213-d18e-4cc2-82f6-b0e5a99cc917,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfd6b53d16704609b8eaa74bb4dfd82e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T07:42:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0b40d57a-35c1-447d-a5ab-eb33dae4fab2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T07:42:59Z,use_quota=True,user_id='1c7d96e9d9b0470b9800630cbe94e409',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137),volume_type_id=f0f4fa3b-be48-49a5-b6fc-fa0a0efb0137)' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:42:59 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-97491f80-3ec3-49f7-a0af-8a1b458acaa5 tempest-SnapshotDependencyTests-1904524745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5fd95f9-f221-4e5d-b696-cee6a9c7d087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:42:59 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-97491f80-3ec3-49f7-a0af-8a1b458acaa5 tempest-SnapshotDependencyTests-1904524745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5fd95f9-f221-4e5d-b696-cee6a9c7d087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:42:59 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-97491f80-3ec3-49f7-a0af-8a1b458acaa5 tempest-SnapshotDependencyTests-1904524745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09979a04-7900-44af-8467-f0258add5d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:42:59 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-97491f80-3ec3-49f7-a0af-8a1b458acaa5 tempest-SnapshotDependencyTests-1904524745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09979a04-7900-44af-8467-f0258add5d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'af590213-d18e-4cc2-82f6-b0e5a99cc917', 'volume_name': 'volume-af590213-d18e-4cc2-82f6-b0e5a99cc917', 'volume_size': 1, 'snapshot_id': '0b40d57a-35c1-447d-a5ab-eb33dae4fab2'}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:42:59 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-97491f80-3ec3-49f7-a0af-8a1b458acaa5 tempest-SnapshotDependencyTests-1904524745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (827535c8-4240-4b4e-b200-e830ff8f9fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:42:59 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-97491f80-3ec3-49f7-a0af-8a1b458acaa5 tempest-SnapshotDependencyTests-1904524745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (827535c8-4240-4b4e-b200-e830ff8f9fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:42:59 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-97491f80-3ec3-49f7-a0af-8a1b458acaa5 tempest-SnapshotDependencyTests-1904524745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c832050d-8774-46e8-ac04-6e07951d29bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:42:59 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-97491f80-3ec3-49f7-a0af-8a1b458acaa5 tempest-SnapshotDependencyTests-1904524745 None] Volume af590213-d18e-4cc2-82f6-b0e5a99cc917: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-af590213-d18e-4cc2-82f6-b0e5a99cc917', 'volume_size': 1, 'snapshot_id': '0b40d57a-35c1-447d-a5ab-eb33dae4fab2'} Sep 28 09:42:59 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-97491f80-3ec3-49f7-a0af-8a1b458acaa5 tempest-SnapshotDependencyTests-1904524745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:42:59 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-97491f80-3ec3-49f7-a0af-8a1b458acaa5 tempest-SnapshotDependencyTests-1904524745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:42:59 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-97491f80-3ec3-49f7-a0af-8a1b458acaa5 tempest-SnapshotDependencyTests-1904524745 None] Acquiring lock "cinder-quobyte-0b40d57a-35c1-447d-a5ab-eb33dae4fab2-af590213-d18e-4cc2-82f6-b0e5a99cc917" by "_create_volume_from_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:42:59 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-97491f80-3ec3-49f7-a0af-8a1b458acaa5 tempest-SnapshotDependencyTests-1904524745 None] Lock "cinder-quobyte-0b40d57a-35c1-447d-a5ab-eb33dae4fab2-af590213-d18e-4cc2-82f6-b0e5a99cc917" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:42:59 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-97491f80-3ec3-49f7-a0af-8a1b458acaa5 tempest-SnapshotDependencyTests-1904524745 None] Creating volume af590213-d18e-4cc2-82f6-b0e5a99cc917 from snapshot 0b40d57a-35c1-447d-a5ab-eb33dae4fab2 {{(pid=86553) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 09:42:59 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-97491f80-3ec3-49f7-a0af-8a1b458acaa5 tempest-SnapshotDependencyTests-1904524745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:42:59 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-97491f80-3ec3-49f7-a0af-8a1b458acaa5 tempest-SnapshotDependencyTests-1904524745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:42:59 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-97491f80-3ec3-49f7-a0af-8a1b458acaa5 tempest-SnapshotDependencyTests-1904524745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:42:59 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-97491f80-3ec3-49f7-a0af-8a1b458acaa5 tempest-SnapshotDependencyTests-1904524745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:42:59 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-97491f80-3ec3-49f7-a0af-8a1b458acaa5 tempest-SnapshotDependencyTests-1904524745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:42:59 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-97491f80-3ec3-49f7-a0af-8a1b458acaa5 tempest-SnapshotDependencyTests-1904524745 None] Selected osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d as target Quobyte volume. {{(pid=86553) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 09:42:59 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-97491f80-3ec3-49f7-a0af-8a1b458acaa5 tempest-SnapshotDependencyTests-1904524745 None] Acquiring lock "cinder-quobyte-af590213-d18e-4cc2-82f6-b0e5a99cc917" by "_copy_volume_from_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:42:59 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-97491f80-3ec3-49f7-a0af-8a1b458acaa5 tempest-SnapshotDependencyTests-1904524745 None] Lock "cinder-quobyte-af590213-d18e-4cc2-82f6-b0e5a99cc917" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:42:59 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-97491f80-3ec3-49f7-a0af-8a1b458acaa5 tempest-SnapshotDependencyTests-1904524745 None] snapshot: 0b40d57a-35c1-447d-a5ab-eb33dae4fab2, volume: af590213-d18e-4cc2-82f6-b0e5a99cc917, {{(pid=86553) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 09:42:59 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-97491f80-3ec3-49f7-a0af-8a1b458acaa5 tempest-SnapshotDependencyTests-1904524745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:42:59 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-97491f80-3ec3-49f7-a0af-8a1b458acaa5 tempest-SnapshotDependencyTests-1904524745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:42:59 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-97491f80-3ec3-49f7-a0af-8a1b458acaa5 tempest-SnapshotDependencyTests-1904524745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:42:59 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-97491f80-3ec3-49f7-a0af-8a1b458acaa5 tempest-SnapshotDependencyTests-1904524745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:42:59 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-97491f80-3ec3-49f7-a0af-8a1b458acaa5 tempest-SnapshotDependencyTests-1904524745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:42:59 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[6baeee62-aeec-4850-9fee-f07879d4f068]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:42:59 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-97491f80-3ec3-49f7-a0af-8a1b458acaa5 tempest-SnapshotDependencyTests-1904524745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20cd491f-f0b5-42ae-82d3-58c0f589af7c.0b40d57a-35c1-447d-a5ab-eb33dae4fab2 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:42:59 devstack sudo[108503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20cd491f-f0b5-42ae-82d3-58c0f589af7c.0b40d57a-35c1-447d-a5ab-eb33dae4fab2 Sep 28 09:42:59 devstack sudo[108503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:42:59 devstack sudo[108503]: pam_unix(sudo:session): session closed for user root Sep 28 09:42:59 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-97491f80-3ec3-49f7-a0af-8a1b458acaa5 tempest-SnapshotDependencyTests-1904524745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20cd491f-f0b5-42ae-82d3-58c0f589af7c.0b40d57a-35c1-447d-a5ab-eb33dae4fab2" returned: 0 in 0.359s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:42:59 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-97491f80-3ec3-49f7-a0af-8a1b458acaa5 tempest-SnapshotDependencyTests-1904524745 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20cd491f-f0b5-42ae-82d3-58c0f589af7c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86553) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 09:42:59 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eaeafe3-93dd-4865-9c0c-f88aff55274e]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:42:59 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-97491f80-3ec3-49f7-a0af-8a1b458acaa5 tempest-SnapshotDependencyTests-1904524745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20cd491f-f0b5-42ae-82d3-58c0f589af7c {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:42:59 devstack sudo[108508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20cd491f-f0b5-42ae-82d3-58c0f589af7c Sep 28 09:42:59 devstack sudo[108508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:43:00 devstack sudo[108508]: pam_unix(sudo:session): session closed for user root Sep 28 09:43:00 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-97491f80-3ec3-49f7-a0af-8a1b458acaa5 tempest-SnapshotDependencyTests-1904524745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20cd491f-f0b5-42ae-82d3-58c0f589af7c" returned: 0 in 0.353s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:43:00 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-97491f80-3ec3-49f7-a0af-8a1b458acaa5 tempest-SnapshotDependencyTests-1904524745 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20cd491f-f0b5-42ae-82d3-58c0f589af7c {{(pid=86553) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 09:43:00 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-97491f80-3ec3-49f7-a0af-8a1b458acaa5 tempest-SnapshotDependencyTests-1904524745 None] Creating direct copy from snapshot {{(pid=86553) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 09:43:00 devstack cinder-volume[86553]: DEBUG cinder.utils [None req-97491f80-3ec3-49f7-a0af-8a1b458acaa5 tempest-SnapshotDependencyTests-1904524745 None] Path /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-af590213-d18e-4cc2-82f6-b0e5a99cc917 not found in is_blk_device check {{(pid=86553) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 09:43:00 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-97491f80-3ec3-49f7-a0af-8a1b458acaa5 tempest-SnapshotDependencyTests-1904524745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20cd491f-f0b5-42ae-82d3-58c0f589af7c /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-af590213-d18e-4cc2-82f6-b0e5a99cc917 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:43:00 devstack sudo[108513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20cd491f-f0b5-42ae-82d3-58c0f589af7c /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-af590213-d18e-4cc2-82f6-b0e5a99cc917 Sep 28 09:43:00 devstack sudo[108513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:43:06 devstack sudo[108513]: pam_unix(sudo:session): session closed for user root Sep 28 09:43:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-97491f80-3ec3-49f7-a0af-8a1b458acaa5 tempest-SnapshotDependencyTests-1904524745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20cd491f-f0b5-42ae-82d3-58c0f589af7c /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-af590213-d18e-4cc2-82f6-b0e5a99cc917" returned: 0 in 5.857s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:43:06 devstack cinder-volume[86553]: DEBUG cinder.image.image_utils [None req-97491f80-3ec3-49f7-a0af-8a1b458acaa5 tempest-SnapshotDependencyTests-1904524745 None] Image conversion details: src /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20cd491f-f0b5-42ae-82d3-58c0f589af7c, size 1024.00 MB, duration 5.86 sec, destination /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-af590213-d18e-4cc2-82f6-b0e5a99cc917 {{(pid=86553) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 09:43:06 devstack cinder-volume[86553]: INFO cinder.image.image_utils [None req-97491f80-3ec3-49f7-a0af-8a1b458acaa5 tempest-SnapshotDependencyTests-1904524745 None] Converted 1024.00 MB image at 174.80 MB/s Sep 28 09:43:06 devstack cinder-volume[86553]: WARNING cinder.volume.drivers.remotefs [None req-97491f80-3ec3-49f7-a0af-8a1b458acaa5 tempest-SnapshotDependencyTests-1904524745 None] /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-af590213-d18e-4cc2-82f6-b0e5a99cc917 is being set with open permissions: ugo+rw Sep 28 09:43:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-97491f80-3ec3-49f7-a0af-8a1b458acaa5 tempest-SnapshotDependencyTests-1904524745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-af590213-d18e-4cc2-82f6-b0e5a99cc917 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:43:06 devstack sudo[108528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-af590213-d18e-4cc2-82f6-b0e5a99cc917 Sep 28 09:43:06 devstack sudo[108528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:43:06 devstack sudo[108528]: pam_unix(sudo:session): session closed for user root Sep 28 09:43:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-97491f80-3ec3-49f7-a0af-8a1b458acaa5 tempest-SnapshotDependencyTests-1904524745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-af590213-d18e-4cc2-82f6-b0e5a99cc917" returned: 0 in 0.234s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:43:06 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-97491f80-3ec3-49f7-a0af-8a1b458acaa5 tempest-SnapshotDependencyTests-1904524745 None] Lock "cinder-quobyte-af590213-d18e-4cc2-82f6-b0e5a99cc917" released by "_copy_volume_from_snapshot" :: held 6.885s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:43:06 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-97491f80-3ec3-49f7-a0af-8a1b458acaa5 tempest-SnapshotDependencyTests-1904524745 None] Lock "cinder-quobyte-0b40d57a-35c1-447d-a5ab-eb33dae4fab2-af590213-d18e-4cc2-82f6-b0e5a99cc917" released by "_create_volume_from_snapshot" :: held 6.940s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:43:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-97491f80-3ec3-49f7-a0af-8a1b458acaa5 tempest-SnapshotDependencyTests-1904524745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.953s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:43:06 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-97491f80-3ec3-49f7-a0af-8a1b458acaa5 tempest-SnapshotDependencyTests-1904524745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c832050d-8774-46e8-ac04-6e07951d29bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af590213-d18e-4cc2-82f6-b0e5a99cc917', 'volume_size': 1, 'snapshot_id': '0b40d57a-35c1-447d-a5ab-eb33dae4fab2'}' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:43:06 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-97491f80-3ec3-49f7-a0af-8a1b458acaa5 tempest-SnapshotDependencyTests-1904524745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27ba7d0f-3658-4dd4-943a-560ee21cb278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 09:43:06 devstack cinder-volume[86553]: INFO cinder.volume.flows.manager.create_volume [None req-97491f80-3ec3-49f7-a0af-8a1b458acaa5 tempest-SnapshotDependencyTests-1904524745 None] Volume volume-af590213-d18e-4cc2-82f6-b0e5a99cc917 (af590213-d18e-4cc2-82f6-b0e5a99cc917): created successfully Sep 28 09:43:06 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-97491f80-3ec3-49f7-a0af-8a1b458acaa5 tempest-SnapshotDependencyTests-1904524745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27ba7d0f-3658-4dd4-943a-560ee21cb278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86553) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 09:43:06 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-97491f80-3ec3-49f7-a0af-8a1b458acaa5 tempest-SnapshotDependencyTests-1904524745 None] Flow 'volume_create_manager' (03eddac5-6bfa-4cc7-8c96-f6fc30fea0be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86553) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 09:43:06 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-97491f80-3ec3-49f7-a0af-8a1b458acaa5 tempest-SnapshotDependencyTests-1904524745 None] Created volume successfully. Sep 28 09:43:06 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-dcc9c1af-1280-444b-9c0f-3aa726c9e9d0 tempest-SnapshotDependencyTests-1904524745 None] Acquiring lock "cinder-0b40d57a-35c1-447d-a5ab-eb33dae4fab2-delete_snapshot" by "delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:43:06 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-dcc9c1af-1280-444b-9c0f-3aa726c9e9d0 tempest-SnapshotDependencyTests-1904524745 None] Lock "cinder-0b40d57a-35c1-447d-a5ab-eb33dae4fab2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:43:06 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-dcc9c1af-1280-444b-9c0f-3aa726c9e9d0 tempest-SnapshotDependencyTests-1904524745 None] Acquiring lock "cinder-quobyte-20cd491f-f0b5-42ae-82d3-58c0f589af7c" by "delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:43:06 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-dcc9c1af-1280-444b-9c0f-3aa726c9e9d0 tempest-SnapshotDependencyTests-1904524745 None] Lock "cinder-quobyte-20cd491f-f0b5-42ae-82d3-58c0f589af7c" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:43:06 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-dcc9c1af-1280-444b-9c0f-3aa726c9e9d0 tempest-SnapshotDependencyTests-1904524745 None] Acquiring lock "cinder-quobyte-0b40d57a-35c1-447d-a5ab-eb33dae4fab2" by "_delete_snapshot" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:43:06 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-dcc9c1af-1280-444b-9c0f-3aa726c9e9d0 tempest-SnapshotDependencyTests-1904524745 None] Lock "cinder-quobyte-0b40d57a-35c1-447d-a5ab-eb33dae4fab2" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:43:06 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-dcc9c1af-1280-444b-9c0f-3aa726c9e9d0 tempest-SnapshotDependencyTests-1904524745 None] Deleting offline snapshot 0b40d57a-35c1-447d-a5ab-eb33dae4fab2 of volume 20cd491f-f0b5-42ae-82d3-58c0f589af7c {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 09:43:06 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-dcc9c1af-1280-444b-9c0f-3aa726c9e9d0 tempest-SnapshotDependencyTests-1904524745 None] snapshot_file for this snap is: volume-20cd491f-f0b5-42ae-82d3-58c0f589af7c.0b40d57a-35c1-447d-a5ab-eb33dae4fab2 {{(pid=86553) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 09:43:06 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[9669b5c2-c961-4d17-81c6-43585197d81e]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:43:06 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-dcc9c1af-1280-444b-9c0f-3aa726c9e9d0 tempest-SnapshotDependencyTests-1904524745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20cd491f-f0b5-42ae-82d3-58c0f589af7c.0b40d57a-35c1-447d-a5ab-eb33dae4fab2 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:43:07 devstack sudo[108531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20cd491f-f0b5-42ae-82d3-58c0f589af7c.0b40d57a-35c1-447d-a5ab-eb33dae4fab2 Sep 28 09:43:07 devstack sudo[108531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:43:07 devstack sudo[108531]: pam_unix(sudo:session): session closed for user root Sep 28 09:43:07 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-dcc9c1af-1280-444b-9c0f-3aa726c9e9d0 tempest-SnapshotDependencyTests-1904524745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20cd491f-f0b5-42ae-82d3-58c0f589af7c.0b40d57a-35c1-447d-a5ab-eb33dae4fab2" returned: 0 in 0.354s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:43:07 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.remotefs [None req-dcc9c1af-1280-444b-9c0f-3aa726c9e9d0 tempest-SnapshotDependencyTests-1904524745 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20cd491f-f0b5-42ae-82d3-58c0f589af7c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86553) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 09:43:07 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe72f29-a4eb-4008-97ea-787459dfe55b]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:43:07 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-dcc9c1af-1280-444b-9c0f-3aa726c9e9d0 tempest-SnapshotDependencyTests-1904524745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20cd491f-f0b5-42ae-82d3-58c0f589af7c {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:43:07 devstack sudo[108536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20cd491f-f0b5-42ae-82d3-58c0f589af7c Sep 28 09:43:07 devstack sudo[108536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:43:07 devstack sudo[108536]: pam_unix(sudo:session): session closed for user root Sep 28 09:43:07 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-dcc9c1af-1280-444b-9c0f-3aa726c9e9d0 tempest-SnapshotDependencyTests-1904524745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20cd491f-f0b5-42ae-82d3-58c0f589af7c" returned: 0 in 0.521s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:43:07 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-dcc9c1af-1280-444b-9c0f-3aa726c9e9d0 tempest-SnapshotDependencyTests-1904524745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20cd491f-f0b5-42ae-82d3-58c0f589af7c.0b40d57a-35c1-447d-a5ab-eb33dae4fab2 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:43:07 devstack sudo[108541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20cd491f-f0b5-42ae-82d3-58c0f589af7c.0b40d57a-35c1-447d-a5ab-eb33dae4fab2 Sep 28 09:43:07 devstack sudo[108541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:43:08 devstack sudo[108541]: pam_unix(sudo:session): session closed for user root Sep 28 09:43:08 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-dcc9c1af-1280-444b-9c0f-3aa726c9e9d0 tempest-SnapshotDependencyTests-1904524745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20cd491f-f0b5-42ae-82d3-58c0f589af7c.0b40d57a-35c1-447d-a5ab-eb33dae4fab2" returned: 0 in 0.324s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:43:08 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-dcc9c1af-1280-444b-9c0f-3aa726c9e9d0 tempest-SnapshotDependencyTests-1904524745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20cd491f-f0b5-42ae-82d3-58c0f589af7c.0b40d57a-35c1-447d-a5ab-eb33dae4fab2 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:43:08 devstack sudo[108547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20cd491f-f0b5-42ae-82d3-58c0f589af7c.0b40d57a-35c1-447d-a5ab-eb33dae4fab2 Sep 28 09:43:08 devstack sudo[108547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:43:08 devstack sudo[108547]: pam_unix(sudo:session): session closed for user root Sep 28 09:43:08 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-dcc9c1af-1280-444b-9c0f-3aa726c9e9d0 tempest-SnapshotDependencyTests-1904524745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20cd491f-f0b5-42ae-82d3-58c0f589af7c.0b40d57a-35c1-447d-a5ab-eb33dae4fab2" returned: 0 in 0.245s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:43:08 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-dcc9c1af-1280-444b-9c0f-3aa726c9e9d0 tempest-SnapshotDependencyTests-1904524745 None] Lock "cinder-quobyte-0b40d57a-35c1-447d-a5ab-eb33dae4fab2" released by "_delete_snapshot" :: held 1.545s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:43:08 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-dcc9c1af-1280-444b-9c0f-3aa726c9e9d0 tempest-SnapshotDependencyTests-1904524745 None] Lock "cinder-quobyte-20cd491f-f0b5-42ae-82d3-58c0f589af7c" released by "delete_snapshot" :: held 1.566s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:43:08 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-dcc9c1af-1280-444b-9c0f-3aa726c9e9d0 tempest-SnapshotDependencyTests-1904524745 None] Created reservations ['f8ea7b13-50b4-4b13-87b0-238d09457bb8', '71f6470f-1171-472d-975e-199b9d816429', 'b7f18450-0f1c-45c1-bed5-334d984b263e', '7a03bb76-0c8b-4b5f-b3f2-6756ba91beb1'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:43:08 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-dcc9c1af-1280-444b-9c0f-3aa726c9e9d0 tempest-SnapshotDependencyTests-1904524745 None] Delete snapshot completed successfully. Sep 28 09:43:08 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-dcc9c1af-1280-444b-9c0f-3aa726c9e9d0 tempest-SnapshotDependencyTests-1904524745 None] Lock "cinder-0b40d57a-35c1-447d-a5ab-eb33dae4fab2-delete_snapshot" released by "delete_snapshot" :: held 1.690s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:43:08 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-77541aa7-868e-496a-a459-edce3f0c2cfe tempest-SnapshotDependencyTests-1904524745 None] Acquiring lock "cinder-20cd491f-f0b5-42ae-82d3-58c0f589af7c-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:43:09 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-77541aa7-868e-496a-a459-edce3f0c2cfe tempest-SnapshotDependencyTests-1904524745 None] Lock "cinder-20cd491f-f0b5-42ae-82d3-58c0f589af7c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:43:09 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-77541aa7-868e-496a-a459-edce3f0c2cfe tempest-SnapshotDependencyTests-1904524745 None] Acquiring lock "cinder-quobyte-20cd491f-f0b5-42ae-82d3-58c0f589af7c" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:43:09 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-77541aa7-868e-496a-a459-edce3f0c2cfe tempest-SnapshotDependencyTests-1904524745 None] Lock "cinder-quobyte-20cd491f-f0b5-42ae-82d3-58c0f589af7c" acquired by "delete_volume" :: waited 0.018s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:43:09 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[7398ca5e-4abb-4e39-a81f-277aca3a95d8]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:43:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-77541aa7-868e-496a-a459-edce3f0c2cfe tempest-SnapshotDependencyTests-1904524745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20cd491f-f0b5-42ae-82d3-58c0f589af7c {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:43:09 devstack sudo[108551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20cd491f-f0b5-42ae-82d3-58c0f589af7c Sep 28 09:43:09 devstack sudo[108551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:43:09 devstack sudo[108551]: pam_unix(sudo:session): session closed for user root Sep 28 09:43:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-77541aa7-868e-496a-a459-edce3f0c2cfe tempest-SnapshotDependencyTests-1904524745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20cd491f-f0b5-42ae-82d3-58c0f589af7c" returned: 0 in 0.356s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:43:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-77541aa7-868e-496a-a459-edce3f0c2cfe tempest-SnapshotDependencyTests-1904524745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20cd491f-f0b5-42ae-82d3-58c0f589af7c {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:43:09 devstack sudo[108556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20cd491f-f0b5-42ae-82d3-58c0f589af7c Sep 28 09:43:09 devstack sudo[108556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:43:09 devstack sudo[108556]: pam_unix(sudo:session): session closed for user root Sep 28 09:43:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-77541aa7-868e-496a-a459-edce3f0c2cfe tempest-SnapshotDependencyTests-1904524745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-20cd491f-f0b5-42ae-82d3-58c0f589af7c" returned: 0 in 0.246s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:43:09 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-77541aa7-868e-496a-a459-edce3f0c2cfe tempest-SnapshotDependencyTests-1904524745 None] Lock "cinder-quobyte-20cd491f-f0b5-42ae-82d3-58c0f589af7c" released by "delete_volume" :: held 0.663s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:43:09 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-77541aa7-868e-496a-a459-edce3f0c2cfe tempest-SnapshotDependencyTests-1904524745 None] Created reservations ['fc34363f-1e7e-4045-afba-a6d2f8ecb957', 'df156579-c335-4f47-bc6e-6b00daa4cf04', '4271db42-f407-4d00-b61d-0b0a15273b29', 'c3fc804e-b20c-4edd-b388-f86f68f8a0ac'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:43:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-77541aa7-868e-496a-a459-edce3f0c2cfe tempest-SnapshotDependencyTests-1904524745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:43:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-77541aa7-868e-496a-a459-edce3f0c2cfe tempest-SnapshotDependencyTests-1904524745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:43:09 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-77541aa7-868e-496a-a459-edce3f0c2cfe tempest-SnapshotDependencyTests-1904524745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:43:09 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-77541aa7-868e-496a-a459-edce3f0c2cfe tempest-SnapshotDependencyTests-1904524745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:43:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-77541aa7-868e-496a-a459-edce3f0c2cfe tempest-SnapshotDependencyTests-1904524745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:43:09 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-77541aa7-868e-496a-a459-edce3f0c2cfe tempest-SnapshotDependencyTests-1904524745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:43:09 devstack sudo[108559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:43:09 devstack sudo[108559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:43:10 devstack sudo[108559]: pam_unix(sudo:session): session closed for user root Sep 28 09:43:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-77541aa7-868e-496a-a459-edce3f0c2cfe tempest-SnapshotDependencyTests-1904524745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.248s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:43:10 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-77541aa7-868e-496a-a459-edce3f0c2cfe tempest-SnapshotDependencyTests-1904524745 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:43:10 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-77541aa7-868e-496a-a459-edce3f0c2cfe tempest-SnapshotDependencyTests-1904524745 None] Deleted volume successfully. Sep 28 09:43:10 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-77541aa7-868e-496a-a459-edce3f0c2cfe tempest-SnapshotDependencyTests-1904524745 None] Lock "cinder-20cd491f-f0b5-42ae-82d3-58c0f589af7c-delete_volume" released by "delete_volume" :: held 1.109s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:43:10 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-18dcba3f-8e40-417e-9d6e-9f6953bacfe0 tempest-SnapshotDependencyTests-1904524745 None] Acquiring lock "cinder-af590213-d18e-4cc2-82f6-b0e5a99cc917-delete_volume" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:43:10 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-18dcba3f-8e40-417e-9d6e-9f6953bacfe0 tempest-SnapshotDependencyTests-1904524745 None] Lock "cinder-af590213-d18e-4cc2-82f6-b0e5a99cc917-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:43:10 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-18dcba3f-8e40-417e-9d6e-9f6953bacfe0 tempest-SnapshotDependencyTests-1904524745 None] Acquiring lock "cinder-quobyte-af590213-d18e-4cc2-82f6-b0e5a99cc917" by "delete_volume" {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 09:43:10 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-18dcba3f-8e40-417e-9d6e-9f6953bacfe0 tempest-SnapshotDependencyTests-1904524745 None] Lock "cinder-quobyte-af590213-d18e-4cc2-82f6-b0e5a99cc917" acquired by "delete_volume" :: waited 0.014s {{(pid=86553) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 09:43:10 devstack cinder-volume[86553]: DEBUG oslo.privsep.daemon [-] privsep: reply[adfb2546-c121-41c3-966d-29a62f8933dd]: (4, 'qcow2') {{(pid=87488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 09:43:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-18dcba3f-8e40-417e-9d6e-9f6953bacfe0 tempest-SnapshotDependencyTests-1904524745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-af590213-d18e-4cc2-82f6-b0e5a99cc917 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:43:10 devstack sudo[108562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-af590213-d18e-4cc2-82f6-b0e5a99cc917 Sep 28 09:43:10 devstack sudo[108562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:43:10 devstack sudo[108562]: pam_unix(sudo:session): session closed for user root Sep 28 09:43:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-18dcba3f-8e40-417e-9d6e-9f6953bacfe0 tempest-SnapshotDependencyTests-1904524745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-af590213-d18e-4cc2-82f6-b0e5a99cc917" returned: 0 in 0.379s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:43:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-18dcba3f-8e40-417e-9d6e-9f6953bacfe0 tempest-SnapshotDependencyTests-1904524745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-af590213-d18e-4cc2-82f6-b0e5a99cc917 {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:43:10 devstack sudo[108567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-af590213-d18e-4cc2-82f6-b0e5a99cc917 Sep 28 09:43:10 devstack sudo[108567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:43:10 devstack sudo[108567]: pam_unix(sudo:session): session closed for user root Sep 28 09:43:10 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-18dcba3f-8e40-417e-9d6e-9f6953bacfe0 tempest-SnapshotDependencyTests-1904524745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa/volume-af590213-d18e-4cc2-82f6-b0e5a99cc917" returned: 0 in 0.262s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:43:10 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-18dcba3f-8e40-417e-9d6e-9f6953bacfe0 tempest-SnapshotDependencyTests-1904524745 None] Lock "cinder-quobyte-af590213-d18e-4cc2-82f6-b0e5a99cc917" released by "delete_volume" :: held 0.685s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:43:10 devstack cinder-volume[86553]: DEBUG cinder.quota [None req-18dcba3f-8e40-417e-9d6e-9f6953bacfe0 tempest-SnapshotDependencyTests-1904524745 None] Created reservations ['e4fddb86-955a-4b78-aa2a-bfee86138f7d', 'cb333999-7d82-461f-a206-7305930305b6', '0519004e-a379-4ad4-b1cb-15a79483a4ae', 'ceae9282-f68a-426f-b5cf-cfb0fd687982'] {{(pid=86553) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 09:43:11 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-18dcba3f-8e40-417e-9d6e-9f6953bacfe0 tempest-SnapshotDependencyTests-1904524745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:43:11 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-18dcba3f-8e40-417e-9d6e-9f6953bacfe0 tempest-SnapshotDependencyTests-1904524745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:43:11 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-18dcba3f-8e40-417e-9d6e-9f6953bacfe0 tempest-SnapshotDependencyTests-1904524745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:43:11 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-18dcba3f-8e40-417e-9d6e-9f6953bacfe0 tempest-SnapshotDependencyTests-1904524745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:43:11 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-18dcba3f-8e40-417e-9d6e-9f6953bacfe0 tempest-SnapshotDependencyTests-1904524745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:43:11 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-18dcba3f-8e40-417e-9d6e-9f6953bacfe0 tempest-SnapshotDependencyTests-1904524745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:43:11 devstack sudo[108570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:43:11 devstack sudo[108570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:43:11 devstack sudo[108570]: pam_unix(sudo:session): session closed for user root Sep 28 09:43:11 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-18dcba3f-8e40-417e-9d6e-9f6953bacfe0 tempest-SnapshotDependencyTests-1904524745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.254s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:43:11 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-18dcba3f-8e40-417e-9d6e-9f6953bacfe0 tempest-SnapshotDependencyTests-1904524745 None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:43:11 devstack cinder-volume[86553]: INFO cinder.volume.manager [None req-18dcba3f-8e40-417e-9d6e-9f6953bacfe0 tempest-SnapshotDependencyTests-1904524745 None] Deleted volume successfully. Sep 28 09:43:11 devstack cinder-volume[86553]: DEBUG cinder.coordination [None req-18dcba3f-8e40-417e-9d6e-9f6953bacfe0 tempest-SnapshotDependencyTests-1904524745 None] Lock "cinder-af590213-d18e-4cc2-82f6-b0e5a99cc917-delete_volume" released by "delete_volume" :: held 1.149s {{(pid=86553) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 09:43:21 devstack cinder-volume[86553]: DEBUG dbcounter [-] [86553] Writing DB stats cinder:SELECT=18,cinder:UPDATE=32,cinder:INSERT=7,cinder:DELETE=1 {{(pid=86553) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 09:43:21 devstack cinder-volume[86553]: DEBUG dbcounter [-] [86553] Writing DB stats cinder:SELECT=32,cinder:UPDATE=27,cinder:INSERT=8,cinder:DELETE=4 {{(pid=86553) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 09:43:21 devstack cinder-volume[86553]: DEBUG oslo_service.periodic_task [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86553) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 09:43:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 09:43:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 09:43:21 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d': None} {{(pid=86553) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 09:43:21 devstack cinder-volume[86553]: DEBUG cinder.volume.drivers.quobyte [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a78da719-0bcc-4cea-9503-9fe4da11542d'] {{(pid=86553) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 09:43:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.lockutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86553) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 09:43:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 09:43:21 devstack sudo[108579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa Sep 28 09:43:21 devstack sudo[108579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 09:43:21 devstack sudo[108579]: pam_unix(sudo:session): session closed for user root Sep 28 09:43:21 devstack cinder-volume[86553]: DEBUG oslo_concurrency.processutils [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bafb3d6ff6a035cd2394d86cf877f3aa" returned: 0 in 0.245s {{(pid=86553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 09:43:21 devstack cinder-volume[86553]: DEBUG cinder.manager [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Notifying Schedulers of capabilities ... {{(pid=86553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 09:43:21 devstack cinder-volume[86553]: DEBUG oslo_service.periodic_task [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] Running periodic task VolumeManager._thread_info {{(pid=86553) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 09:43:21 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] thread count: 28 {{(pid=86553) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 09:43:21 devstack cinder-volume[86553]: DEBUG cinder.volume.manager [None req-ba262fec-5136-4c77-8562-a712a25cf06d None None] thread info: [<_MainThread(MainThread, started 134684877779072)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86553) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}